News for hackers. Stuff that matters.
Re:Google scrambles to manually remove weird AI answers in s... by PreInternet01 on Saturday May 25, 2024 @12:47PM (#40476179)
It's debatable whether Google has truly lost the plot because of the "AI wars", but the moment the statement "Bing returns more sensible results than you" becomes verifiably true, it's... cause for concern?

The approach that Google appears to have taken, which is to assume that the top-ranked part of its current search index is a sensible knowledge base, may have been true some years ago, but definitely isn't now: for whatever reasons, it's now 33% spam, 33% clickbait/propaganda, with the rest being equally divided between what could be called "truths" and miscellaneous detritus.

To me, it seems that returning to the concept that search results should at least reflect a broad consensus of what is true is a necessary first step for Google. As part of that, learning to flag obvious trolling, clickbait and bad-faith content is paramount. And then, maybe then, they can start touting their LLM benefits. But until the realities of the Internet are taken into account (i.e.: it's 80% spam!), any "we offer automated answers!" play is doomed.

Re:Google scrambles to manually remove weird AI answers in s... by rurp on Saturday May 25, 2024 @02:12PM (#40476775)
Not only is the current internet 80% spam, it's rapidly approaching 99% thanks in large part to LLMs. At this point I would be shocked if Google had a solid plan for how to handle this going forward as the problem space gets more difficult.
Re:Google scrambles to manually remove weird AI answers in s... by EasyMark on Saturday May 25, 2024 @02:37PM (#40476955)
that's the part that scares me. I railed on someone's comment the other day about "indexes will come back into fashion" but the more I think about how much garbage has increased in just the past 2 to 3 years, I think I was wrong. Indexes and forums may be the only way to have a sane net where you can find things. Perhaps communities linking together in a ring like format, a "web ring" of sorts.
Re:Google scrambles to manually remove weird AI answers in s... by ysavir on Saturday May 25, 2024 @02:42PM (#40476988)
What I've been wanting to see for a while now is a social-network based search engine:

* No pages are indexed automatically. The only indexed pages are pages that users say are worth indexing. Probably have a browser add-on for a one button click that people can use. * You can friend/follow others * Your search results are a combination of your own indexed pages and the pages indexed by people in your network.

Re:Google scrambles to manually remove weird AI answers in s... by noncoml on Saturday May 25, 2024 @05:52PM (#40478151)
Spammers will find a way to beat it.
Re:Google scrambles to manually remove weird AI answers in s... by manquer on Saturday May 25, 2024 @08:33PM (#40478870)
Isn’t that what Reddit is or digg was ? Link aggregators ?

Gaming that is solved problem , you can use human bot farms to brigade and astroturf and you can even motivate people to do it for free .

If cost of spamming is cheaper than cost of moderation, spam will win

Re:Google scrambles to manually remove weird AI answers in s... by ysavir on Sunday May 26, 2024 @08:29AM (#40481652)
Not quite like reddit and digg. You can bot farm those because the lists are common to all.

In this search engine, let's say there's you, me, person three, and spammer. You you are following me, and I'm following person three. Spammer isn't in any of our networks.

When you use the search engine, you only see results that you, me, or person three manually tagged as worthwhile. Any pages or content that Spammer tagged as worthwhile aren't part of your results, because they aren't in your network. So they can try to game the system all they want, but it won't affect you.

If person three starts following Spammer, I can unfollow them and then Spammer's results will no longer be included in your search results (or you can unfollow me and avoid those results).

I imagine rankings would also be affected by degrees of separation, so even if you followed me, I followed person three, and person three followed spammer, results tagged by me and you would take much higher precedence than results tagged by Spammer.

This also allows you to make custom searches by choosing which people you follow to include. Suppose you want to search for good headphones, so you make a search, but only include people in your network that you know are music and audio savvy, so that the results reflect the pages tagged by those people.

Re:Google scrambles to manually remove weird AI answers in s... by antifa on Sunday May 26, 2024 @10:53AM (#40482621)
What happens when I need to search a term that's outside the scope of topics that my followees are trusted for? Then it's a spammer free-for-all?
Re:Google scrambles to manually remove weird AI answers in s... by im3w1l on Saturday May 25, 2024 @03:26PM (#40477243)
Good indices lead to good search engines (engines can make use of indices) Good search engines lead to bad indices (by obsoleting them) Bad indices lead to bad search engines Bad search engines lead to good indices
Re:Google scrambles to manually remove weird AI answers in s... by whateverevetahw on Saturday May 25, 2024 @04:57PM (#40477817)
That sounds kind of like what Groupsy does. It creates a spider web of ideas.

https://groupsy.applicationfitness.com/post/healthymeals/664...

Re:Google scrambles to manually remove weird AI answers in s... by reustle on Saturday May 25, 2024 @02:19PM (#40476832)
Re:Google scrambles to manually remove weird AI answers in s... by zogrodea on Saturday May 25, 2024 @03:11PM (#40477164)
I do see incredibly weird kids content on YouTube sometimes (most likely bot generated?) which makes me think kids have been experiencing a worse internet before the rest of us have.
Re:Google scrambles to manually remove weird AI answers in s... by rchaud on Saturday May 25, 2024 @03:48PM (#40477363)
Kids are far less knowledgeable about how modern software works because they don't know of an Internet that didn't have algorithmic recommendations. They have to be taught to do things like click "Not Interested/Don't recommend channel" to improve their feed. Dark pattern designs make this harder by hiding these options behind tiny 3-dot buttons.
Re:Google scrambles to manually remove weird AI answers in s... by freshpretzels on Sunday May 26, 2024 @01:01PM (#40483628)
I don’t think this is a real problem because as users start being more intentional about who they subscribe to and more thorough in ranking content according to its usefulness and quality, the low quality stuff or regurgitated stuff will just vanish.

Why would it matter if there are clones of the best, say, blog post on how to make spicy ramen? If they are not adding anything new or making that original effort better, then they will not surface in searches as search tools improve. Nobody will save that content or recirculate it or refer to it when they need to remember how to make spicy ramen.

And people will build curated subscriptions and followings and recommendations that are more tailored to the individual, and we will spend more time determining who is trustworthy and who is not.

Re:Google scrambles to manually remove weird AI answers in s... by greg_V on Saturday May 25, 2024 @01:17PM (#40476377)
Oh it gets even better. The public has been hearing about AI this and AI that for over a year, but the existing use cases and deployment was confined to some super special niches like writing or the creative industries and programming.

This is the first nation-scale deployment of the technology, running on Google's biggest and most profitable market in one of the most widely used internet services, and it's a shitshow.

They can try manually fine tuning it, but all of the investors who have been throwing money at AI for the past year are now learning what this tech is like in the day-to-day, beyond just speculations, and it's looking... bad.

Re:Google scrambles to manually remove weird AI answers in s... by itronitron on Saturday May 25, 2024 @01:35PM (#40476510)
It's especially embarrassing for Google considering they have indexed virtually all of the world's information for the last 25 years.
Re:Google scrambles to manually remove weird AI answers in s... by PreInternet01 on Saturday May 25, 2024 @01:27PM (#40476452)
Yeah, the most likely take here is that Google's leadership truly did not recognize how utterly awful the quality of their flagship search index had become over the years.

I mean, it explains a lot, but still... you're recruited using industry-leading practices out of an overflowing pool of abundant talent... and this is what you make of it? As the kids say: SMH!

Re:Google scrambles to manually remove weird AI answers in s... by neilv on Saturday May 25, 2024 @03:20PM (#40477201)
> you're recruited using industry-leading practices out of an overflowing pool of abundant talent... and this is what you make of it?

That's exactly what to make of their frathouse nonsense.

Google has gotten away with it because smart people and a sweet moment of opportunity 20-25 years ago gave them... uh, an inheritance. They can coast on that inherited monopoly position, and afford to pay 100 people to do the work of 1, use the company's position to push whatever they build onto the market, and then probably cancel it anyway, always going back to the inherited money machine from the ancestors.

And then a lot of companies who didn't understand software development blindly tried to copy whatever the richest company they saw was doing, not understanding the real difference between the companies. While VC growth investment schemes let some of those companies get away with that, because they didn't have to be profitable, viable, responsible, nor legal, nor even have reasonably maintainable software.

Poor Zoomers are now a generation separated from before the tech industry's cocaine bender. For whatever software jobs will be available to them, and with the density of nonsense "knowledge" that will be in the air, I don't know how they'll all learn non-dysfunctional practices.

Re:Google scrambles to manually remove weird AI answers in s... by lawn on Saturday May 25, 2024 @01:46PM (#40476587)
> you're recruited using industry-leading practices out of an overflowing pool of abundant talent

The ridiculous focus on on leet-code is surely industry-leading (because whatever Google does becomes industry-leading) but it sure isn't a good way to filter for competency.

Re:Google scrambles to manually remove weird AI answers in s... by chucke1992 on Saturday May 25, 2024 @06:03PM (#40478190)
I heard a funny quote that "today we have a new generation of developers who learnt how to pass interviews but don't know how code, and we have an old generation of developers who know how to code but forgot how to pass interviews. Or maybe never knew".
Re:Google scrambles to manually remove weird AI answers in s... by rm_-rf_slash on Saturday May 25, 2024 @01:33PM (#40476497)
Plenty of people have been using ChatGPT for daily tasks for almost two years now. GPT-4 isn’t perfect but is otherwise really really good, and deftly handling use cases in my industry that would be impossible without it or however many billion dollars it would take to make GPT-4.

From the black Nazis to the suggestion to jump off the Golden Gate Bridge b/c depression, it’s pretty clear that this fiasco isn’t an LLM problem, it’s a Google problem.

Re:Google scrambles to manually remove weird AI answers in s... by lupire on Saturday May 25, 2024 @01:58PM (#40476676)
Because no one cares when ChatGPT gets things wrong.
Re:Google scrambles to manually remove weird AI answers in s... by chucke1992 on Saturday May 25, 2024 @05:45PM (#40478108)
the future is in-context search - basically not even going to google search to find something, but straight up doing that from your current window from any location. Basically a chat bot following you everywhere.
Re:Google scrambles to manually remove weird AI answers in s... by latentsea on Saturday May 25, 2024 @11:00PM (#40479489)
One that you can turn down, but not off.
Re:Google scrambles to manually remove weird AI answers in s... by freshpretzels on Sunday May 26, 2024 @12:54PM (#40483571)
> To me, it seems that returning to the concept that search results should at least reflect a broad consensus of what is true is a necessary first step for Google. As part of that, learning to flag obvious trolling, clickbait and bad-faith content is paramount.

Who will decide what is obvious trolling and bad-faith content and how will they decide it? The problem they have is that search is only useful if it gives users what they are looking for. Their business model though is predicated on finding a way to introduce ads into the mix, and if they are also then trying to become arbiters of what truth people find and see, then all the conflicting goals will create a series of contradictory requirements. The search tools that usefully find what the user is looking for, with helpful suggestions, will win. Once users find that their experience is curated and that they are coerced by unelected arbiters and censors they will not trust the platform in question and someone else will get that market share.