News for hackers. Stuff that matters.

A comment on Do Simpler Machine Learning Models Exist and How Can We Find Them?. Parent comment

Re:Do Simpler Machine Learning Models Exist and How Can We F... by visarga on Friday December 23, 2022 @06:23AM (#34104620)
I know RL is very hard. But we have about 1 TeraWord of text in current datasets and about 10 TeraWord could be scraped if we did a thorough job. RL is how language models can generate more. By solving many problems and training on problem solving AI can create its own data.
[ Parent | on HN ]
Re:Do Simpler Machine Learning Models Exist and How Can We F... by PartiallyTyped on Friday December 23, 2022 @10:27AM (#34106790)
This does not compute.

To generate more, you need to interact with an environment, and you also need an objective function. If we could magically generate more textual data, then we have a language model already and don't need to train another language model.

You can't bootstrap a model for language synthesis unless you give it access to the internet to interact with users, at which point ... you have a Tay [1]

[1] https://en.wikipedia.org/wiki/Tay_(bot)

[ Parent | on HN ]