News for hackers. Stuff that matters.

A comment on What does a leaked Google memo reveal about the future of AI?. Parent comment

Re:What does a leaked Google memo reveal about the future of... by sitkack on Sunday May 14, 2023 @01:47PM (#35939799)
Data pollution isn't the problem it is made out to be. You can even use a model trained on garbage data to relabel the original set and retrain.

Google of all companies is sitting on exaflops of TPU capacity, they can retrain models larger than anyone else, faster than anyone else.

[ Parent | on HN ]
Re:What does a leaked Google memo reveal about the future of... by visarga on Sunday May 14, 2023 @06:33PM (#35941958)
I agree, but it would probably require to use LLMs to filter or augment the raw text. They can afford it.
[ Parent | on HN ]