News for hackers. Stuff that matters.
Re:Recent Advances in Natural Language Processing by rland on Sunday August 16, 2020 @09:43PM (#24183028)
Yes, fundamentally I agree, of course. If you could find a way to get all of natural knowledge into a sufficient enough network, you would probably have a very intelligent network. But getting text in is easy. It's the most manipulable proxy model. Getting other data in, data that represents what I'm talking about, is much much more difficult.
Re:Recent Advances in Natural Language Processing by p1esk on Monday August 17, 2020 @05:30AM (#24185526)
Getting in, say, video frames instead of words is more difficult, but possible imo. After all, they demonstrated it’s possible to do with raw audio: https://openai.com/blog/jukebox