So if this Mac uses 30-50W, that's 40-60 tok/Wh...vs maybe 80k for a modern GPU ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

herf 17 days ago | parent | context | favorite | on: Run Kimi K3 using 29 GB of RAM at 0.50 tok/s

So if this Mac uses 30-50W, that's 40-60 tok/Wh...vs maybe 80k for a modern GPU cluster? So that's about 1000-2000x more power for the SSD streaming, unfortunately.

walrus01 16 days ago [–]

GPU sufficient to hold and run Kimi have a totally different up front capex cost, however.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact