News for hackers. Stuff that matters.
Re:The bigger-is-better approach to AI is running out of road by rco8786 on Saturday June 24, 2023 @05:22PM (#36462763)
Bingo. I've been beating this drum since the initial GPT-3 awe.. The future of AI is bespoke, purpose-driven models trained on a combination of public and (importantly) proprietary data.

Data is still king.

Re:The bigger-is-better approach to AI is running out of road by JimtheCoder on Saturday June 24, 2023 @05:29PM (#36462813)
So, search isn't dead after all...
Re:The bigger-is-better approach to AI is running out of road by stavros on Saturday June 24, 2023 @05:37PM (#36462876)
Search has definitely been dead since before LLMs, we just don't have a replacement yet.
Re:The bigger-is-better approach to AI is running out of road by JimtheCoder on Saturday June 24, 2023 @05:39PM (#36462885)
I mean more the concept of search, not the current implementation
Re:The bigger-is-better approach to AI is running out of road by stavros on Saturday June 24, 2023 @05:40PM (#36462891)
Oh, I don't think we'll ever stop wanting to search for things. Maybe not everything, but some things.
Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:46AM (#36467214)
Search is about finding existing results. The opposite of search is to start from first principles and work your way up until you have created the desired result yourself.

In the real world, search reduces information acquisition costs as you only have to spend time and resources on finding an existing result rather than recreating it.

Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @06:23PM (#36463174)
For a while my replacement was “use google, add ‘reddit’ at the end.” Not sure how much longer that will work given even just this limited blackout impacted how effective that was lol
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Saturday June 24, 2023 @06:43PM (#36463303)
That hasn’t worked since about three months after companies found out people do it. It’s all astroturfing now days anyway and if it applies to products (which it for sure does) you can be sure that government actors caught on as well.
Re:The bigger-is-better approach to AI is running out of road by mitchdoogle on Saturday June 24, 2023 @07:28PM (#36463657)
I'm not really sure what you're saying. It seems to me the number of shills creating content is vastly outnumbered by normal people creating content, so the trick of adding "reddit" to the end of queries is still very much useful (blackout protests aside) since it's usefulness derives from getting information from normal people and then having normal people upvote the "best" comments. Just the other day I tried this with data recovery software very quickly found some free software that was highly praised. If I had just searched "data recovery software" on Google I get whichever data recovery place as the best SEO, including many of them who claim that a novice should be trying it at all and should use their services pronto. Using reddit in this case gave me the exact information I wanted, where Google alone was next to useless.
Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @10:28PM (#36464645)
Yeah I don’t know their experience, but mine is when I add “Reddit” i often get 2-3 threads talking about the exact thing I’m looking up in the top 10 results.
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Sunday June 25, 2023 @01:22PM (#36470580)
What I’m getting at is that those threads have a high likelihood of being gamed to make you think a certain way
Re:The bigger-is-better approach to AI is running out of road by quesera on Saturday June 24, 2023 @09:57PM (#36464491)
I'm not sure if it would help or restore the kinds of results you were seeing previously, but instead of adding "reddit", you can add "site:reddit.com" to get only results from that site. (Originally a Google feature, but works on Duck Duck Go also. Not sure about others.)

Unless you mean that Reddit is astroturfed with the SEO garbage you're trying to avoid, in which case this will definitely not help.

Is search on Reddit itself still useless?

Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @10:26PM (#36464642)
Search on Reddit several years ago went from “useless” to I don’t know…a C-? It can work.
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Monday June 26, 2023 @10:53AM (#36480366)
Yeah I mean it’s astroturfed and likely in ways beyond just corporate
Re:The bigger-is-better approach to AI is running out of road by samstave on Saturday June 24, 2023 @06:24PM (#36463185)
It will be a terrific moment when we can browse a galaxy map or other lists of LLMs, and select "context" groups - so you can say from history, give me X
Re:The bigger-is-better approach to AI is running out of road by thelittleone on Saturday June 24, 2023 @06:29PM (#36463209)
That doesn't sound ideal at all to me. It also sounds like a bottleneck. I want to ask AI once and it recommends or selects the best "context" group.
Re:The bigger-is-better approach to AI is running out of road by samstave on Saturday June 24, 2023 @06:59PM (#36463439)
It would bea good visual training tool for kids so they can get an understanding early on other than a block-box view.
Re:The bigger-is-better approach to AI is running out of road by danielvaughn on Saturday June 24, 2023 @07:19PM (#36463600)
I’d be really interested to see an AI model built off of Sci Hub data.
Re:The bigger-is-better approach to AI is running out of road by fooker on Saturday June 24, 2023 @09:34PM (#36464384)
Facebook announced this a month or so before chatgpt took off, and got lambasted everywhere because of hallucinations.
Re:The bigger-is-better approach to AI is running out of road by croes on Saturday June 24, 2023 @09:20PM (#36464319)
This would only work if thinks like GPT were actually intelligent.

Train on dataset A to learn to think, use thinking on dataset B to become an export in B's field.

Re:The bigger-is-better approach to AI is running out of road by Animats on Sunday June 25, 2023 @12:34AM (#36465164)
You need sort of a "primary education" data set which gets the model up to roughly a high school education level. Then augment it with special-purpose models for specific areas.

But until "I don't know" comes out, rather than hallucinations, we're in trouble.

Re:The bigger-is-better approach to AI is running out of road by rco8786 on Sunday June 25, 2023 @08:03AM (#36467325)
> You need sort of a "primary education" data set which gets the model up to roughly a high school education level.

Yea that was what I was getting at with the "combination" of data. The publicly available data provides the base/primary education, then you specialize it with your proprietary data and bam, you have an AI model that nobody else can produce...an actual product moat.