Re:OpenAI GPT-4 vs. Groq Mistral-8x7B
by wruza on Friday March 22, 2024 @06:58AM
(#39789388)
Yep, everyone seems to forget that ML was available before 2021. Had a conversation recently with my former colleague who learned about some plastic packaging company which used "AI" to predict client orders and inform them about scheduling implications. When I told him that you don't need Transformers and 30GB models for that, he was quasi-confused, cause he kinda knew it but the hype just overtook his knowledge.
[ Parent
| on HN ]
Re:OpenAI GPT-4 vs. Groq Mistral-8x7B
by anon373839 on Friday March 22, 2024 @08:09AM
(#39789852)
In ML courses, you’re taught to try simpler methods and models before turning to more complex ones. I think that’s something that hasn’t made it into the mainstream yet.
A lot of people seem to be using GPT-4 for tasks like text classification and NER, and they’d be much better off fine-tuning a BERT model instead. In vision, too, transformers are great but a lot of times, a CNN is all you really need.