News for hackers. Stuff that matters.

A comment on Ilya Sutskever to leave OpenAI. Parent comment

Re:Ilya Sutskever to leave OpenAI by Gud on Wednesday May 15, 2024 @12:39PM (#40369213)
How do you know massive datasets are required? Just because that’s how current LLMs operate, doesn’t mean it’s necessarily the only solution.
[ Parent | on HN ]
Re:Ilya Sutskever to leave OpenAI by datameta on Wednesday May 15, 2024 @01:40PM (#40370038)
Then the resources needed to discover an alternative to brute-forcing a large model are a huge barrier.

I think academia and startups are currently better suited to optimize tinyml and edge ai hardware/compilers/frameworks etc.

[ Parent | on HN ]