Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I am talking about reconfigurable gates to implement an LLM in silicon, i.e. an FPGA...


What might the “parameters/layers to gates” ratio look like? My naive and uninformed guess would be that 1B+ parameter would also need a 1B+ gate FPGA, but according to google they typically range from tens of thousands to several million (which would still be a fraction of a billion).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: