News for hackers. Stuff that matters.
Re:Google Search document leak reveals inner workings of ran... by vouaobrasil on Wednesday May 29, 2024 @07:04AM (#40510603)
Sometimes I wonder how much better the internet would be hits on Google weren't directly tied to revenue from Google itself through its ad program. I am certain Google has made the internet and the world a worse place to live.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @07:18AM (#40510691)
As a user of Kagi and search.marginalia.nu I can tell you:

Quite a bit.

So much that now that I have what "everyone" asked Google for for years - that is blacklists - I hardly use them.

Why? Because with Kagi I get much better results out of the box.

I am fairly sure Googlers will tell me there are multiple safeguards to prevent the inclusion of Google ads from affecting ranking, to which I just have to say that the results speak for themselves.

Please note: I have only used Kagi for two years. I am only one user. But I am a user with 20 years of experience with Google and that got to count for something.

Re:Google Search document leak reveals inner workings of ran... by esperent on Wednesday May 29, 2024 @08:16AM (#40511121)
Kagi is worth the money, but it isn't magic. It's about as good as Google was ~five years ago, before they made all the search operators stop work. There's also a whole bunch of things it's worse at that Google - especially local search and shopping. Plus I still get plenty of blogspam and AI generated crap from Kagi.
Re:Google Search document leak reveals inner workings of ran... by mozman on Wednesday May 29, 2024 @08:30AM (#40511230)
The search operators makes big difference in result quality, I also don’t like how Google now returns zero results for something obscure. In the past I could find something peripheral and eventually get to what I was looking for.
Re:Google Search document leak reveals inner workings of ran... by orangevelcro on Wednesday May 29, 2024 @10:22AM (#40512318)
Exactly! It's so frustrating because the results were usually useful enough to at least point me in the right direction or help me figure out what I was doing wrong to find what I wanted.
Re:Google Search document leak reveals inner workings of ran... by Nevolihs on Wednesday May 29, 2024 @07:55AM (#40510947)
I actually use pinning, blocking and raising/lowering the value of individual sites every day. I wish this is the direction search engines went in the first place and it's the direction I hope Kagi continues. I want a personalized search engine that's personalized by me, not by a company trying to profile me and make money off of my clicks.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:15AM (#40511640)
I am all for Kagi keeping that feature. If for nothing else then to rub it in the face of every googler who have argued that it was impossible.

And if you use it I am happy, that gives Kagi an incentive to keep it around.

I'm just saying that for me the results are so good out of the box that with a couple of exceptions I never had to block anything.

Re:Google Search document leak reveals inner workings of ran... by the_snooze on Wednesday May 29, 2024 @09:42AM (#40511920)
When each user can personalize the results themselves, you make SEO completely impractical because they can no longer target a single monolithic algorithm controled by one entity. Websites would actually have to have organic appeal to users, who get the final say to hide away bad sites from the results page (looking at you, Quora, Pinterest, and Fandom).
Re:Google Search document leak reveals inner workings of ran... by beeboobaa3 on Wednesday May 29, 2024 @07:59AM (#40510990)
Is kagi good for finding things like old forum posts (not reddit)? I know some of those sites are still up but google seems to ignore them.
Re:Google Search document leak reveals inner workings of ran... by stuffoverflow on Wednesday May 29, 2024 @08:23AM (#40511175)
In my experience kagi is decent, definitely gives more forum results than google. I've found yandex to be the best at finding all kinds of forum /discussion sites.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:20AM (#40511696)
There is a seperate "lens" (think like "images", "videos" and "news" in Google, only there are more and you can create your own) for "Small Web" which only includes what they describe as "Results that favor noncommercial domains and topics".

(Other standard lenses include

- Forums

- Fediverse forums

- Usenet/archive

and I think 7 others.)

Re:Google Search document leak reveals inner workings of ran... by nalinidash on Wednesday May 29, 2024 @09:29AM (#40511794)
Try search.marginalia.nu

From the website about: "This is an independent DIY search engine that focuses on non-commercial content, and attempts to show you sites you perhaps weren't aware of in favor of the sort of sites you probably already knew existed."

Re:Google Search document leak reveals inner workings of ran... by amelius on Wednesday May 29, 2024 @08:08AM (#40511054)
How do you know that Kagi won't become as bad as Google at some point?
Re:Google Search document leak reveals inner workings of ran... by spacebanana7 on Wednesday May 29, 2024 @08:22AM (#40511164)
Also it’s unlikely Kagi will ever become big enough for SEO people to specifically target with manipulative content.

Even if they got 100 million active paying users it’d still be a tiny fraction of overall search traffic.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:34AM (#40511833)
If anything, Kagi has proven that Googles "SEO ruined it" argument isn't valid.

In the beginning, Kagi was mostly just API calls to Google and Bing AFAIK. Their results were still better for some reason, probably because they didn't have to consider how valuable the ads on garbage site were before throwing the site out of my results.

Re:Google Search document leak reveals inner workings of ran... by spacebanana7 on Wednesday May 29, 2024 @10:04AM (#40512154)
I agree with you to some extent. For example, there's no reason I can think of why Google couldn't allow user selected domain blacklisting or custom bangs.

But I fear that if a large search engine copied some of Kagi's filters/lenses for non-commercial blogs & forums then SEO agencies would dedicate immense resources to polluting them.

Re:Google Search document leak reveals inner workings of ran... by freediver on Wednesday May 29, 2024 @11:57PM (#40519930)
Not possible by definition. Kagi Small Web is non commercial sites only, by definition. And the list is fixed (and open source). There is nothing SEO can do to infiltrate it.
Re:Google Search document leak reveals inner workings of ran... by Kye on Wednesday May 29, 2024 @10:37AM (#40512441)
It doesn't have to be big if it's rich.

People will target Kagi because it's packed to the brim with people who have $5-10/month to spend on a search engine, and likely have $5-10/month to spend on other things too.

Re:Google Search document leak reveals inner workings of ran... by p3rls on Wednesday May 29, 2024 @09:27AM (#40511769)
Why would they? The same manipulative techniques that work in my niche on Google seem to work even better on Kagi
Re:Google Search document leak reveals inner workings of ran... by breakfastduck on Wednesday May 29, 2024 @08:13AM (#40511088)
We don't, but a model where a user pays for a service rather than being free and ad supported is significantly less likely to enact user unfriendly changes.

If the way you make money is by convincing people to pay, you are highly incentivised to make the product good, especially where there are many other free competitors who are ad supported.

Re:Google Search document leak reveals inner workings of ran... by glitchc on Wednesday May 29, 2024 @08:21AM (#40511156)
Tell that to cable companies, sports broadcasts and now streaming services. The one incontrovertible fact of modern society is that ads eat everything else. No other revenue source compares.
Re:Google Search document leak reveals inner workings of ran... by karma_pharmer on Wednesday May 29, 2024 @08:33AM (#40511260)
ads eat everything else

Well duh. Because it's the only value you're allowed to collect from retail customers without having to deal with either chargebacks or kyc.

We've deliberately made every other form of micropayment infeasible. It shouldn't be surprising that the only one left is insanely popular.

Re:Google Search document leak reveals inner workings of ran... by sseagull on Wednesday May 29, 2024 @09:28AM (#40511783)
Partly. But also because it's just a way to make more money. If you make X from payments, and you can make Y from ads, then X+Y > X.

You might lose some people, but probably not many - we've been conditioned to really accept ads everywhere.

Re:Google Search document leak reveals inner workings of ran... by glitchc on Wednesday May 29, 2024 @10:43AM (#40512506)
Also because Y>>X.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:31AM (#40511806)
Kagi is worth the price every month, unlike a number of other things I have supported it is not an investment for me in the hope that it will one day be worth it but rather a service that I pay a small sum for which in turns removes lots of frustration from my life every month.

If they do become bad then at least I have had a fantastic search engine for another few years of my life like I had from 2002 until 2009 ish.

And also, already at this point, they and marginalia has proven that it isn't impossible to enter the search engine marked even now. This was long considered impossible, at least here on HN.

Re:Google Search document leak reveals inner workings of ran... by duckmysick on Wednesday May 29, 2024 @12:21PM (#40513683)
What's the argument you're trying to make?

That because there's a chance Kagi will become bad, there's no point in using it now and thus we should stick to Google, which is already bad? That doesn't make sense.

The same line of thought can be applied to anything. We don't know what will happen in the future, therefore we can't be sure that things won't go bad. Is there even a way to have such a guarantee?

Assuming I don't want to use Google (because it's bad) and I won't use Kagi or Perplexity or others (because they might become bad), what's the realistic solution? Roll my own search engine? I don't have resources and I don't trust the future me to maintain it.

Re:Google Search document leak reveals inner workings of ran... by abhijat on Wednesday May 29, 2024 @07:34AM (#40510793)
I switched to Kagi in June last year. I just realized I tried it initially because I wanted to try out blocking sites in search results, and I have only ever needed to block three domains.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @07:41AM (#40510843)
Thats exactly what I am talking about.

Kagi is kind of like Google in 2009, seriously good coverage, good ranking

... but also:

- more modern

- more features (summarizer, bangs like in DDG, FastGPT and probably a few I forgot)

- blocklists for websites (and also options to pin, raise and lower)

- with actual support: report a bug and you get an answer from a real engineer, a follow up when it is fixed and a shout out in the relevant release notes

- no tracking

Re:Google Search document leak reveals inner workings of ran... by dustincoates on Wednesday May 29, 2024 @08:13AM (#40511100)
I like Kagi a lot (just look at my comment history), but I'm letting my subscription lapse when it comes time to renew. I've found myself going to Google a lot more often, and I'm finding more and more transparently spammy sites in the Kagin index. Some, for example, are clearly Gen AI created.

If I were a rich man, I would probably keep my subscription just to support a Google competitor. Alas, I'm not, and so I'll be going back to Google.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:23AM (#40511721)
I see your point. I was not always this well paid.

Did you try blocking the problematic sites and if it didn't work, did you file support requests?

Re:Google Search document leak reveals inner workings of ran... by dustincoates on Wednesday May 29, 2024 @10:20AM (#40512302)
I didn't block them, because they were rarely the same site repeatedly, so I'm not sure it would help.

I didn't on support requests, either, perhaps I should. I have before, and the team did a great job at addressing what wasn't working.

Re:Google Search document leak reveals inner workings of ran... by freediver on Wednesday May 29, 2024 @11:51PM (#40519899)
Have you reported any of this to Kagi? (things that are reported usually get fixed)
Re:Google Search document leak reveals inner workings of ran... by nolist_policy on Wednesday May 29, 2024 @07:57AM (#40510973)
Is it only me or do these constant Kagi ads on HN sound fishy?
Re:Google Search document leak reveals inner workings of ran... by danielheath on Wednesday May 29, 2024 @08:30AM (#40511239)
It’s not surprising that folks who pay for a service when there’s a free alternative are pretty serious fans.
Re:Google Search document leak reveals inner workings of ran... by ysavir on Wednesday May 29, 2024 @08:02AM (#40511003)
I wouldn't necessarily call them fishy, but I am very tired of them. They have a very evangelizing tone. But I think they're ultimately just people excited about the tool they're using and wanting to share it with others.
Re:Google Search document leak reveals inner workings of ran... by tomrod on Wednesday May 29, 2024 @08:18AM (#40511137)
I took a screenshot years ago where 10/14 of the viewable top headlines on my screen where positive Google discussion. From an advertising perspective it was all earned marketing (satisfied customers speaking highly).

While these situations could be a pg-style astroturf submarine, or they could be satisfied customers (the best kind of advertising), I wouldn't necessarily say fishy (you can look at the satisfied users' previous contributions to make that judgment yourself! :)).

Personally, I've not used Kagi, but I hear positive things from people I trust that use it. So I'll likely try it in the future.

Re:Google Search document leak reveals inner workings of ran... by drpossum on Wednesday May 29, 2024 @08:03AM (#40511014)
Maybe they're not ads but people who genuinely like the service?
Re:Google Search document leak reveals inner workings of ran... by epr on Wednesday May 29, 2024 @08:12AM (#40511082)
Did we not all evangelize Google in it's early days?

Also, none of these accounts saying nice things appear to be bots or kagi-focused in any way, so I think it's safe to assume they do actually just like it.

Re:Google Search document leak reveals inner workings of ran... by orangevelcro on Wednesday May 29, 2024 @10:26AM (#40512351)
I don't know...my spidey sense has been going off a bit.

Kagi has a free trial, but you have to pay, which is the difference between it and early Google.

Of course, now we have Google ads instead, so who knows, maybe not bots.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @06:13PM (#40517681)
Go check my history. Send me a mail and I'll send a photo of the fields and the wind breaks here that you can geolocate.

I am definitely not a bot.

I am however extremely fed up with Google. And equally thankful that I have found something that works as well as old Google (or better).

Re:Google Search document leak reveals inner workings of ran... by breakfastduck on Wednesday May 29, 2024 @08:14AM (#40511104)
Google Search being a bit rubbish has been in the zeitgeist for a while, it's not surprising that people then talk about an alternative they've found that is much better in their experience
Re:Google Search document leak reveals inner workings of ran... by mannycalavera42 on Wednesday May 29, 2024 @08:10AM (#40511066)
kagi is the new crossfit
Re:Google Search document leak reveals inner workings of ran... by JTyQZSnP3cQGa8B on Wednesday May 29, 2024 @10:22AM (#40512313)
I never say it but here it is: for the price of 2 packs of cookies, I went from being a 1x programmer to a 1.5x programmer without doing anything. If the results are good, it’s good for me and my job which brings me way more money and satisfaction than $10.

The alternative is Searx and I may try it sometimes, but so far Kagi is cheap and very efficient for me (C++ coding and other languages).

Re:Google Search document leak reveals inner workings of ran... by elorant on Wednesday May 29, 2024 @08:26AM (#40511206)
I use FastGPT quite often although I’m not a subscriber to Kagi itself. For me it’s everything an AI search engine should be. Here is your answer, and here are a bunch of links to research further. Something that works without making the web obsolete. Not like the walled off garden of OpenAi which often hallucinates links, or Google’s “I through everything at the wall to find what sticks” effort.
Re:Google Search document leak reveals inner workings of ran... by karma_pharmer on Wednesday May 29, 2024 @08:27AM (#40511209)
Kagi is simply reselling google search results.
Re:Google Search document leak reveals inner workings of ran... by ptman on Wednesday May 29, 2024 @08:38AM (#40511305)
Re:Google Search document leak reveals inner workings of ran... by karma_pharmer on Wednesday May 29, 2024 @09:33AM (#40511822)
... and 99% of the results come from just one of those.
Re:Google Search document leak reveals inner workings of ran... by super256 on Wednesday May 29, 2024 @08:36AM (#40511288)
Re:Google Search document leak reveals inner workings of ran... by karma_pharmer on Wednesday May 29, 2024 @09:34AM (#40511838)
Then why does kagi have the same artificially-massive github boost that google does and no other engine (bing, duckduckgo) does?

They're just reselling google searches. With maybe 1% salted in from elsewhere for deniability.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:37AM (#40511862)
Because that is what most of us prefer?

Or at least I thought so?

But with Kagi you can always lower github results if you want to. Or boost other sites that you prefer.

Re:Google Search document leak reveals inner workings of ran... by karma_pharmer on Wednesday May 29, 2024 @11:47PM (#40519883)
> Because that is what most of us prefer?

If that is true why hasn't Bing noticed it?

The github bias in google results is huge compared to bing. Just try running the same search on both sites. I find it hard to believe that the Bing engineers simply haven't noticed this.

Re:Google Search document leak reveals inner workings of ran... by scutrell on Wednesday May 29, 2024 @08:48AM (#40511388)
I was excited to try Kagi, but I couldn't justify the cost. I find DDG with the occasional Google search to function almost as well. I'll try Kagi again at some point, but it wasn't the panacea people here made it out to be
Re:Google Search document leak reveals inner workings of ran... by packetlost on Wednesday May 29, 2024 @09:20AM (#40511684)
I dunno, the first thing I did was blacklist G**ksf*rG**ks from my search results (and others, of course) and I couldn't be happier.
Re:Google Search document leak reveals inner workings of ran... by p3rls on Wednesday May 29, 2024 @09:26AM (#40511746)
Kagi is the same garbage as google in my niche. Even worse, maybe. It looks like it's weighing backlinks and SEO garbage even higher. Well done.

I don't know how people keep talking about it. The results, as you say, speak for themselves.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:35AM (#40511843)
Well, don't use it then.

I am happy for alternatives, otherwise I guess Kagi wouldn't improve so fast in areas I care about.

Re:Google Search document leak reveals inner workings of ran... by p3rls on Wednesday May 29, 2024 @09:59AM (#40512102)
I won't use it. I am pushing back on your belief that it has figured something out about anything, because to me it looks like Kagi takes Google's results and then makes them worse. I have total shit ranking #1 on Kagi and Google. On other pages I am struggling to break into the top 10 where I should be right under wikipedia in a just world.

I think many people whose lives don't revolve around these things (as in your finances/mortgage are not dependent on google search) get weird magical views about search engines where it's sorta like a modern delphic oracle where the magic works as long as you believe in it. Of course I have the opposite problem where Google is angry chthonic god to be supplicated/scorned.

Oh well, I do know I will not be worshipping a new god that cannot even destroy the abominations sitting at the top of the rankings.

Re:Google Search document leak reveals inner workings of ran... by bitcharmer on Wednesday May 29, 2024 @11:06AM (#40512722)
> Kagi takes Google's results and then makes them worse

And this is how I know you haven't used Kagi at all.

Re:Google Search document leak reveals inner workings of ran... by p3rls on Wednesday May 29, 2024 @12:19PM (#40513636)
> And this is how I know you haven't used Kagi at all.

I guess the identical search results in my niche are an example of convergent enshittification of both Kagi and Google then

Re:Google Search document leak reveals inner workings of ran... by bitcharmer on Wednesday May 29, 2024 @02:11PM (#40514958)
Ok, if that's the case then I give up. Totally possible for different people to have wildly different experience.
Re:Google Search document leak reveals inner workings of ran... by oooyay on Wednesday May 29, 2024 @05:29PM (#40517244)
> I won't use it. I am pushing back on your belief that it has figured something out about anything, because to me it looks like Kagi takes Google's results and then makes them worse.

Kagi is pretty clear about how they do what they do: https://help.kagi.com/kagi/search-details/search-sources.htm.... You're half right, except that Google is not a vertical that they leverage for their index. Their solution works for me, but I'm also a techy. Anecdotally, my partner uses it, and she is not a techy.

> Oh well, I do know I will not be worshipping a new god that cannot even destroy the abominations sitting at the top of the rankings.

The only way this statement applies (to me) is if you can optimize for Kagi. The only way I can think of to do that is organically, but admittedly I haven't put much effort into it because the magic of Kagi's flavor of search is that it puts me in near proximity to information density and sources that I already trust. The real proving grounds for Kagi are a decade out.

Re:Google Search document leak reveals inner workings of ran... by p3rls on Wednesday May 29, 2024 @06:38PM (#40517913)
Lol, it's just complete bullshit marketing on that page. But I do find it fascinating how they obfuscate what is actually happening behind the scenes and cannot come out and clearly say how their technology works, or that they are using google's index.

>Kagi is known for delivering a unique flavor of high-quality search results, sourced from our own web index (internally named "Teclis") and news index (internally named "TinyGem").

The marketing at least is pretty good -- I haven't seen this many committed devotees since the iPhone was announced.

But here on the ground, I can type a few queries and reveal that Kagi is the same shit as Google. Perhaps you are seeing some manually adjusted queries?

P.S. there are lots of other concerns about Kagi too, I'm just talking about the search https://hackers.town/@lori/112255132348604770

Re:Google Search document leak reveals inner workings of ran... by eitland on Thursday May 30, 2024 @05:22AM (#40521673)
> But here on the ground, I can type a few queries and reveal that Kagi is the same shit as Google.

Here on the ground in Norway I just say "lucky you" if Google serves the same results as Kagi.

My experience is Google expands my search terms beyond recognition and I am absolutely and utterly fed up with starting to read an article about a problem I searched for, getting a result from a trustworthy site, starting to read only to realize Google secretly behind my back expanded my search from "unpopular-ancient-javascript-framework-from-2021" to "currently-popular-js-framework-with-kinda-similar-name".

My time is valuable. Not having to babysit my search engine is something I happily pay for.

Could probably get my employer to pay for it too.

If Google by some miracle has you in an experimental group where they don't mess with your queries, or if you have time to babysit it - more power to you.

Re:Google Search document leak reveals inner workings of ran... by p3rls on Thursday May 30, 2024 @10:30AM (#40524197)
Why do Kagi supporters keep insisting I am supporting Google? I save all my best vituperative comments for how Google has destroyed the internet.

I am only saying Kagi is just as shitty as Google for my queries and certainly is using their index based off the 30 or so searches I made. I am not in a technical niche however, so maybe they're using something different for that or you saw a manually-adjusted query?

But for the regular, everyday people queries, yeah 100% it's just google bro.

Re:Google Search document leak reveals inner workings of ran... by eitland on Friday May 31, 2024 @12:45AM (#40531594)
Ok, thanks for the clarification.

Let me also clarify: I am absolutely not denying that Kagi uses Googles index.

I am just pointing out that for some reason when I search with Google I get lots and lots of results for things I didn't search for. For a while I kept them away by sprinkling doublequotes everywhere but the last few years, no amount of double quotes or even the verbatim operator works anymore.

With Kagi however not only does doublequotes work (for now at least), - I usually don't even need to apply them, my queries work just like they used to do in "old" Google back in 2009.

That is what I pay Kagi for.

I can be totally open that for what I know the reason might be as simple as the fact that Kagis API access gets results directly from Googles search API without passing through what I think of as a "search broadening" function and without applying A/B testing experiments to the results that come back.

I don't care. I get my results.

And if someone come along and present a better alternative that uses only their own independent index, I'll be inclined to pay even more just because I'd love to see it. (I was a marginalia supporter for months and might become again in the future.)

Re:Google Search document leak reveals inner workings of ran... by DarkNova6 on Wednesday May 29, 2024 @07:20AM (#40510711)
You mean the way Google worked originally? The founders were very careful in creating a barrier between ads and search.

A barrier whose erosion has been well documented over the last 10 years.

Re:Google Search document leak reveals inner workings of ran... by vouaobrasil on Wednesday May 29, 2024 @07:44AM (#40510867)
A barrier whose only purpose was to establish trust so that it could be later taken advantage of.
Re:Google Search document leak reveals inner workings of ran... by DarkNova6 on Wednesday May 29, 2024 @11:00AM (#40512663)
As much of a cynic I typically am, there is a well established record of events which shows that this is not true.

Google search was taken over by an ambitious clique of failed yahoo managers that successfully destroyed their former company for their own financial advantage then did the same at google.

Acting as parasites on society at large.

Re:Google Search document leak reveals inner workings of ran... by benterix on Wednesday May 29, 2024 @07:18AM (#40510695)
It's not black and white. There was a lot of junk that was forced on us and that was removed thanks to Google. But I agree the direct relationship is inherently corrupting.
Re:Google Search document leak reveals inner workings of ran... by GTP on Wednesday May 29, 2024 @07:43AM (#40510855)
Larry Page and Sergei Brin even stated very clearly in their original paper that using ads as revenue source can impact the quality of results returned from the search engine.
Re:Google Search document leak reveals inner workings of ran... by Workaccount2 on Wednesday May 29, 2024 @07:33AM (#40510789)
The fundamental problem with the Internet is that people don't want to pay for things on it.

No matter what, whatever we ended up with was going to be shitty and exploitive.

Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @07:44AM (#40510863)
Now you have a chance. Kagi is there.

I made my decision two years ago and I would probably do it even if it was just on par with Google, to support competition and to avoid supporting Google.

But in hindsight it is just exeptionally much better. There is no going back unless Kagi does something monumentally stupid.

Re:Google Search document leak reveals inner workings of ran... by jacob019 on Wednesday May 29, 2024 @08:07AM (#40511042)
I'm a Kagi user too. I like your enthusiasm, but I can't say it's been all that life changing for me. DuckDuckGo is ok too, I still use it on some machines when I don't feel like logging in. GPT has been more life changing.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:12AM (#40511625)
Don't know what I am doing wrong but except the first few times I really didn't get good results with Kagi.

It might be that I rely a lot on precise queries and doublequoted words and also cannot get myself to use the conversational style that at least Google seems to prefer now.

Re:Google Search document leak reveals inner workings of ran... by L-four on Wednesday May 29, 2024 @07:45AM (#40510873)
It's not that people don't want to pay it's that it's difficult to pay small sums. The web browsers could solve this problem but they make money from ads so it's not in there best interest.
Re:Google Search document leak reveals inner workings of ran... by nradov on Wednesday May 29, 2024 @08:09AM (#40511059)
Jakob Nielsen's article "The Case for Micropayments" from 1998 still seems relevant. Nothing has really changed in 26 years so I'm skeptical whether it could ever work, but in principle it would be great for users and website owners to have that option.

https://www.nngroup.com/articles/the-case-for-micropayments/

Re:Google Search document leak reveals inner workings of ran... by UI_at_80x24 on Wednesday May 29, 2024 @09:07AM (#40511588)
And this was one of the hopes/goals/dreams that crypto offered that I really wish had come true.
Re:Google Search document leak reveals inner workings of ran... by tjpnz on Wednesday May 29, 2024 @08:55AM (#40511468)
How much of that is due to ad-tech companies like Google conditioning people into thinking that way? What if online payments weren't so god awful and allowed people to throw in a few dollars as easily as they might at a toll booth? That's still an unsolved problem too. Credit card companies have solidified their involvement in every facet of the process and the alternatives are non-starters for frictionless commerce.

I'm still happy to put my money where my mouth is and do pay for services which are genuinely useful to me. But this is not the kind of internet I imagined when growing up.

Re:Google Search document leak reveals inner workings of ran... by heresie-dabord on Wednesday May 29, 2024 @07:59AM (#40510987)
Instead of a semantic Web of knowledge, we got "grep the HTML... with ads".
Re:Google Search document leak reveals inner workings of ran... by josefx on Wednesday May 29, 2024 @09:17AM (#40511663)
You dropped the -v . Modern day Google seems fine tuned to return results that contain everything except for the words I searched for.
Re:Google Search document leak reveals inner workings of ran... by blowski on Wednesday May 29, 2024 @07:14AM (#40510667)
I imagine it would be a different flavour to what we have today, but the same intensity. Anything that so deeply penetrates daily life across the globe is going to bring enormous problems with it.
Re:Google Search document leak reveals inner workings of ran... by greg_V on Wednesday May 29, 2024 @07:19AM (#40510700)
I mean... maybe, but not really. The first problem of the internet was that there wasn't that much content specifically. The first internet companies were the broadband providers who were developing content themselves, like AOL.

Google and the ad ecosystem they acquired was basically the flywheel that spurred content creation at scale. Anyone could jump in, follow a few guidelines and earn a living by producing content on the internet. The Youtube acquisition and monetization followed the same pattern.

Over time the market consolidated and got less and less competitive: less platforms with complete control of traffic and one-sided revenue sharing agreements. The guidelines so to speak on how content should look and feel like were algorithmically made stricter and stricter until everything looks, feels, sounds and reads the same.

The problem right now is that the platforms are still tightening their grip, and it's all tied to the approach of using AI to replace the content creators on the platforms from Google to Spotify to Meta, and carving the spared money to shareholders. And while the web has been shitty for a few years now, we're now seeing a sudden drop in quality because the average user has no recourse or alternative, and neither does the average creator have the means of distribution and monetization (not just publishing, that's been solved) to even find, let alone meet the new kinds of demand.

I'm certain that in a few years this will even out: new search engines, new aggregators and new feeds will emerge, but the content - money - network problem triangle remains as a fundamental problem of the internet.

Re:Google Search document leak reveals inner workings of ran... by linsomniac on Wednesday May 29, 2024 @07:18AM (#40510696)
Did you experience the Internet before google? The idea of a world where Alta Vista won is truly chilling.
Re:Google Search document leak reveals inner workings of ran... by thsksbd on Wednesday May 29, 2024 @07:26AM (#40510740)
You mean a world where people still knew how to use a library catalog, still relied on more than one source of information and curious crazy tid bits are still out there?

The internet is boring. And the trash is still there. Its just become reputable instead.

Re:Google Search document leak reveals inner workings of ran... by linsomniac on Wednesday May 29, 2024 @07:49AM (#40510907)
There's a lot to unpack here...

Can you expand on how a card catalog improved the world? As a kid I used the card catalog a lot, both the physical version and the later electronic versions. Full text search definitely leads to pulling in information from a wider selection of sources.

I remember a lot of stratification of news sources pre-Google (which news channel you watched, which papers/magazines you read). Did Google cause reliance on one source of information, or does Google simply exist in a world where people tend towards echo chambers? How would Alta Vista have improved that?

Re:Google Search document leak reveals inner workings of ran... by jareklupinski on Wednesday May 29, 2024 @10:04AM (#40512147)
> how a card catalog improved the world

i was lamenting the library recently and remembered how books were organized on shelves using the dewey decimal system

this meant that if you knew of one book that has something you're looking for, you can find all the _other_ books about the same topic right next to the first book, even if you knew nothing about the contents of the related books

Re:Google Search document leak reveals inner workings of ran... by staticman2 on Wednesday May 29, 2024 @10:31AM (#40512404)
Libraries still exist and sort books like that, don't they?
Re:Google Search document leak reveals inner workings of ran... by yencabulator on Wednesday May 29, 2024 @02:44PM (#40515316)
I believe the point is that the commenter wishes more things operated like that, where adjacent items were related and likely of similar quality, not just boosted with money and SEO trickery.
Re:Google Search document leak reveals inner workings of ran... by thsksbd on Wednesday May 29, 2024 @07:50PM (#40518512)
They're being ripped down and replaced by coffee shops with plugs and wifi
Re:Google Search document leak reveals inner workings of ran... by badpun on Wednesday May 29, 2024 @08:48AM (#40511389)
> still relied on more than one source of information and curious crazy tid bits are still out there?

I think the curious crazy tid bits are still there.

Re:Google Search document leak reveals inner workings of ran... by washadjeffmad on Wednesday May 29, 2024 @07:27AM (#40510753)
I'd be okay with a world in which everyone else in search didn't lose, too.
Re:Google Search document leak reveals inner workings of ran... by vouaobrasil on Wednesday May 29, 2024 @07:45AM (#40510874)
Yes, I did! I used to use Yahoo search where the results were more hand-curated and people did not create websties for intensive commercial purposes with useless SEO fluff like it is today.
Re:Google Search document leak reveals inner workings of ran... by linsomniac on Wednesday May 29, 2024 @07:55AM (#40510949)
I have been thinking a lot about Yahoo (pre yahoo-search, largely) lately. I don't fully understand how we lost the curated catalog, especially considering the success of Wikipedia. The latter demonstrates users willingness to curate knowledge bases... We have "awesome" lists, but I rarely seem to use them.
Re:Google Search document leak reveals inner workings of ran... by xnx on Wednesday May 29, 2024 @08:19AM (#40511147)
Yahoo directory was largely pay-to-play and very affected by proto-SEOs trying to game the system for direct traffic or PageRank value. Collaborative directories like dmoz.org suffered the same fate before shutting down.
Re:Google Search document leak reveals inner workings of ran... by A_D_E_P_T on Wednesday May 29, 2024 @08:37AM (#40511295)
Pay-to-play is actually a very decent business model for a directory, though. Pay a one-time fee, establish that you're a legitimate business or website, undergo a quality assessment, and you're in. There's no paying for extra promotion, e.g. with ads, and website owners don't need to warp their sites in anticipation of what they think the search engine wants. (Which often results in a decrease in usability, e.g. all of those recipe sites with low-quality 2000-word essays before they get to the actual recipe.)

It's a more level playing field, and it's intrinsically more human-friendly.

Re:Google Search document leak reveals inner workings of ran... by msk-lywenn on Wednesday May 29, 2024 @07:25AM (#40510737)
In some way, didn't Google become Alta Vista?
Re:Google Search document leak reveals inner workings of ran... by linsomniac on Wednesday May 29, 2024 @07:37AM (#40510814)
How so? My memory of Alta Vista was so-so search results with a top page littered with garbage.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @07:49AM (#40510898)
Exactly like Google since 2011 +/- 2 years (the so-so search results part) and Google the last few years (the littered with garbage part)?

I have used Google since probably 2001-2002 sometime and a number of other search engines before. It is rather obvious to me and I have writing and screenshots from around the time quality took a dive that supports it.

Re:Google Search document leak reveals inner workings of ran... by marginalia_nu on Wednesday May 29, 2024 @08:54AM (#40511458)
I think over time the story has become that AV and Yahoo were overtaken by Google because the latter had a cleaner design, which if you think about it for more than a moment doesn't really constitute much of a moat.
Re:Google Search document leak reveals inner workings of ran... by eitland on Wednesday May 29, 2024 @09:07AM (#40511586)
Google was also technically better when it released and importantly there was no way to buy ones way to the top.

Back then I think people mostly agreed that the results that ranked on top in Google generally were there because of criteria that benefited the end user.

I mean, even as crazy as Google results has been the last few years they have still managed to be better than Bing and DDG who both manages to have worse ranking and also like Google completely ignore my doublequotes.

Re:Google Search document leak reveals inner workings of ran... by linsomniac on Wednesday May 29, 2024 @07:58AM (#40510977)
Re:Google Search document leak reveals inner workings of ran... by solardev on Wednesday May 29, 2024 @07:40AM (#40510836)
Exactly
Re:Google Search document leak reveals inner workings of ran... by mastercheph on Wednesday May 29, 2024 @08:58AM (#40511487)
Google
Re:Google Search document leak reveals inner workings of ran... by wslh on Wednesday May 29, 2024 @07:45AM (#40510870)
Google was really great and revolutionary, they helped zillions of small companies to thrive. It was another cycle.

Then, now, it is like media before the 90s: you need to pay a lot of money to be in the center page of the newspaper.

But, hopefully we are talking about LLMs now, seems like one of the answers to search engines in general. Beyond AI, I see LLMs as a good evolution from PageRank.

A little bit general but lately I use the expression: "Complexity as Scam". Google always pointed to their "algorithms" and played with this term as if algorithms couldn't be adjusted to whatever you want to be. Initially the coined term was sound because it was based on a scientific paper and eventually it evolution but it seems like the PageRank original idea has detoured from being a "pure" graph algorithm.

Another context where I use "Complexity as Scam" is Web3. It is like Matryoshka dolls where there is always one more step of complexity to probe a point, but it never ends.

Re:Google Search document leak reveals inner workings of ran... by 1vuio0pswjnm7 on Wednesday May 29, 2024 @05:23PM (#40517185)
There is something truly strange about the idea than people "trust" a website operator and can rely on it to provide them with useful information when that same operator is well-known to be secretive, deceptive and dishonest in order to protect its own interests. It's like imagining that a fact witness who tells the truth on some occasions and lies on others is credible.

https://ipullrank.com/google-algo-leak