Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

How’s that been going?


The 27b model inference speed is amazing at 35 tok/s with power limit to 260W. My cpu is 5950x, maybe that matters too. Really enjoying it and it’s my default now.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: