News for hackers. Stuff that matters.

A comment on Hi everyone yes, I left OpenAI yesterday. Parent comment

Re:Hi everyone yes, I left OpenAI yesterday by sjwhevvvvvsj on Wednesday February 14, 2024 @03:55PM (#39375199)
Yes but if a 7b LLM will give you the same “Hello World” as the 70b, and that’s literally all you need, using a bigger model is just burning energy for no reason at all.
[ Parent | on HN ]
Re:Hi everyone yes, I left OpenAI yesterday by huytersd on Wednesday February 14, 2024 @05:18PM (#39376364)
The cost is fixed for me at least at this point so why would I choose the inferior version.
[ Parent | on HN ]
Re:Hi everyone yes, I left OpenAI yesterday by sjwhevvvvvsj on Wednesday February 14, 2024 @06:51PM (#39377238)
It’s not fixed whatsoever. Mistral 7B runs on a MacBook Air, and it’s free. Zero cost LLM, no network latency.
[ Parent | on HN ]