Re:Pirate Library Mirror: Preserving 7TB of books (that are ...
by visarga on Monday July 04, 2022 @03:22AM
(#31974390)
The gap between research and publication is real but its length is less than one year. I don't think even Google has the resources to do it secretly. Who would work on it and how could they have kept the secret so tight? AI researchers want to publish, especially the best ones, it's essential for their careers. Someone else could plant the flag on their discovery and claim the fame.
Re:Pirate Library Mirror: Preserving 7TB of books (that are ...
by philsnow on Tuesday July 05, 2022 @02:46AM
(#31985134)
For a time while I was working at Google I nursed the idea of transferring to the natural language processing / language modeling areas, but I only have a bachelors in linguistics whereas it seems like they strongly prefer PhDs. Linguistics PhDs can pretty much teach linguistics or go into another field. It would not be hard for Google to find a couple hundred of them and entice them to join up.
... pull the other one.
Okay, your statement could be true depending on what you mean by "large". But what makes you think that companies like Google haven't been working on language models without releasing them and/or without discussing them publicly? There's an advantage to be had by keeping corporate secrets.