M1 doesn't exactly have stellar memory bandwidth for this day and age though | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

wkat4242 9 months ago | parent | context | favorite | on: Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5

M1 doesn't exactly have stellar memory bandwidth for this day and age though

Aurornis 9 months ago [–]

M1 Max with 64GB has 400GB/s memory bandwidth.

You have to get into the highest 16-core M4 Max configurations to begin pulling away from that number.

wkat4242 9 months ago | [–]

Oh sorry I thought it was only about 100. I'd read that before but I must have remembered incorrectly. 400 is indeed very serviceable.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact