Re:GPT-Neo – Building a GPT-3-sized model, open source and free
by comboy on Monday January 18, 2021 @11:54AM
(#25823692)
Have you tried conversing with it, after a few lines of setting a proper context? Like two scientist talking or something like that. It can provide very interesting outputs that are not googlable.
Yes, every time you see something that for human obviously doesn't make sense it makes you dismiss it. You would look at that output differently though if you were talking with a child. Just like a child can miss some information making it say something ridiculous it may miss some patterns connections.
But have you ever observed carefully how we connect patterns and make sentences? Our highly sophisticated discussions and reasoning is just pattern matching. Then most prominent patterns ordered in time also known as consciousness.
Watch hackernews comments and look how after somebody used a rare adjective or cluster of words more commenters tend to use it without even paying conscious attention to that.
Long story short, give it a try and see what examples of what people already did with it even in it's limited form.
To me you are looking at an early computer and saying that it's not doing anything that a bunch of people with calculators couldn't do.
Yes, every time you see something that for human obviously doesn't make sense it makes you dismiss it. You would look at that output differently though if you were talking with a child. Just like a child can miss some information making it say something ridiculous it may miss some patterns connections.
But have you ever observed carefully how we connect patterns and make sentences? Our highly sophisticated discussions and reasoning is just pattern matching. Then most prominent patterns ordered in time also known as consciousness.
Watch hackernews comments and look how after somebody used a rare adjective or cluster of words more commenters tend to use it without even paying conscious attention to that.
Long story short, give it a try and see what examples of what people already did with it even in it's limited form.
To me you are looking at an early computer and saying that it's not doing anything that a bunch of people with calculators couldn't do.