Re:Ask HN: How can ChatGPT serve 700M users when I can't run...
by hnpolicestate on Saturday August 09, 2025 @02:38AM
(#44844530)
This caught my attention "But today even “small” models run so close to hardware limits".
Sounds analogous to the 60's and 70's i.e "even small programs run so close to hardware limits". If optimization and efficiency is dead in software engineering, it's certainly alive and well in LLM development.
Sounds analogous to the 60's and 70's i.e "even small programs run so close to hardware limits". If optimization and efficiency is dead in software engineering, it's certainly alive and well in LLM development.