News for hackers. Stuff that matters.
Re:The Tragedy of Google Search by bayindirh on Friday September 22, 2023 @05:27PM (#37618017)
So, how paid search engines like Kagi manages to bring useful results every time?

Its results are superior, with way less spam and SEO optimized content.

Re:The Tragedy of Google Search by mattnewton on Friday September 22, 2023 @05:39PM (#37618137)
I have no idea; but I speculate this is one area challengers have it easier because

a) there is no giant industry optimizing for ranking on Kagi. There are whole armies of people trying to game google search, meaning whatever heuristics they have would probably be rendered useless shortly if google were to adopt them.

And

b) Kagi has a much smaller, more technical userbase. So like the early web they can get away with a search experience tailored for those kinds of people and not millions of people powering on a smartphone as their first computer.

Re:The Tragedy of Google Search by bayindirh on Friday September 22, 2023 @05:47PM (#37618228)
The biggest power of Kagi is “you” are the algorithm. A page is optimizing for Kagi and providing bad results? Block them. You found a good website burrowed down? Raise/promote them.

Kagi works for you, with your input. It doesn’t do “advanced guessing” by implicitly and opaquely processing your interaction with it.

Re:The Tragedy of Google Search by mattnewton on Friday September 22, 2023 @06:04PM (#37618384)
Explicit control can work for ranking but can’t scale to the retrieval step of search - you aren’t going to sift through thousands of thousands of pages of potential results to give feedback on a meaningful portion of them, there must be some method of pulling pages to be ranked. This is where the gaming happens, with basically limitless spam domains that need to be filtered out. There just is no way Kagi is 100% relying on self reports for this.
Re:The Tragedy of Google Search by asdff on Friday September 22, 2023 @07:32PM (#37619140)
The whole idea of the model is to fit it on some reference so you can project it onto new data you haven't classified yet. So your first few weeks, you might get some spam sure. But eventually if you are optimizing the system by e.g. only ranking technical blogs with no seo bullshit, then technical blogs with no seo bullshit is what would fit best with that model among the new data and what you see on your results. That can't be gamed without knowing the sort of model fit you are generating and this fit is defined by the user.
Re:The Tragedy of Google Search by bayindirh on Saturday September 23, 2023 @02:52PM (#37626223)
The ranking is only relevant to you. It's part of Kagi's lenses and search tailored for you, by you approach.

I guess their "Universal Summarizer" is a part of their indexer, so they try to understand what you want and provide you more relevant results.

They probably have other signals and systems to detect spam and other unwanted things.

Re:The Tragedy of Google Search by amelius on Friday September 22, 2023 @06:33PM (#37618640)
Also Kagi is still in the phase of "let's give users what they want" instead of in the phase of "let's give shareholders what they want".
Re:The Tragedy of Google Search by bayindirh on Saturday September 23, 2023 @02:54PM (#37626242)
Since users are the ones who're financing Kagi, that phase will have no end until they become free and sell user data in a way.
Re:The Tragedy of Google Search by xnx on Friday September 22, 2023 @05:39PM (#37618146)
A lot of people on HN are very happy with Kagi, but I haven't seen examples of searches to understand where it is better. In a blind "taste test", I would be surprised if Kagi or Bing is preferred to Google for most searches.
Re:The Tragedy of Google Search by bayindirh on Friday September 22, 2023 @05:44PM (#37618201)
Well, all my daily searches, whether it be technical or daily mundane things return better results with less cruft than Google. Also, it notifies you if a page has excessive number of trackers.

Combine it with personal website ranking and lenses, it surpasses Google easily.

Also since it has no ads, there’s no noise.

I don’t use Microsoft products, so I can’t comment on Bing.

Re:The Tragedy of Google Search by fnordpiglet on Friday September 22, 2023 @05:46PM (#37618217)
I did side by side for a while and Kagi was consistently superior to Google and bing. I think it boils down to they don’t try to cross sell advertisements so they’re more oriented towards actually providing better results rather than better paying results.
Re:The Tragedy of Google Search by dharmab on Friday September 22, 2023 @05:57PM (#37618323)
Kagi's killer feature can't be blind tested, because Google and Bing don't have it. The ability to pin, raise or block sites in your results is a game changer.
Re:The Tragedy of Google Search by nostrademons on Friday September 22, 2023 @08:05PM (#37619344)
Interestingly, Google had that in 2008 (SearchWiki), but it got extremely low usage - enough that at a time when Google was serving 30K QPS, you could read the queries with SearchWiki interaction as they came in on a screen.

I suspect this is a niche feature for power-users only. HN is filled with power users, so they love Kagi, but it doesn't necessarily translate to the masses.

Re:The Tragedy of Google Search by dharmab on Friday September 22, 2023 @08:32PM (#37619524)
2008 didn't have Pinterest, fewer listicles, conspiracy websites were less mainstream, and mobile web was in its toddler phase.
Re:The Tragedy of Google Search by nostrademons on Friday September 22, 2023 @08:55PM (#37619669)
The feature was basically used exclusively to kill ExpertsExchange, so the problem existed, but yes, it wasn't quite as bad as today.
Re:The Tragedy of Google Search by janalsncm on Friday September 22, 2023 @08:53PM (#37619658)
Well, you would still compare Google as-is. It’s an apples to oranges comparison but you can still compare apples and oranges side by side.

I think it’s important to measure and quantify these things.

Re:The Tragedy of Google Search by dharmab on Saturday September 23, 2023 @12:18AM (#37620544)
"How do these products compare if I ignore their unique advantages" is not a useful measure.
Re:The Tragedy of Google Search by JohnFen on Friday September 22, 2023 @06:23PM (#37618532)
Do you need examples of searches? If people get more useful results from one search engine over another, that's all that matters.

I can't provide you with side-by-side examples because I don't compile lists of such examples. I'm searching to find stuff, not researching search quality. I just know that I have more problems getting good search results from Google over a couple of the other engines.

Re:The Tragedy of Google Search by xnx on Friday September 22, 2023 @06:31PM (#37618627)
Yes. I would love to see some actual examples. People have said that verbatim search doesn't work for them and I've never observed this, so I'm also skeptical of claims of dramatically better search results.
Re:The Tragedy of Google Search by JohnFen on Friday September 22, 2023 @06:43PM (#37618746)
So you think everyone is lying?
Re:The Tragedy of Google Search by ipaddr on Friday September 22, 2023 @07:41PM (#37619185)
No one can provide examples. But it doesn't mean they are lying. They may think it's better but actually isn't. Maybe it is worse but people are protective over it because their identity is connected to it's success.
Re:The Tragedy of Google Search by JohnFen on Monday September 25, 2023 @01:01PM (#37647056)
> They may think it's better but actually isn't.

If a user of service thinks a different service is better, then it is better for them by definition. "Better" is a subjective thing. If X seems better for me than Y, then it is.

Re:The Tragedy of Google Search by xnx on Friday September 22, 2023 @06:55PM (#37618853)
No. What they consider "better", I might consider "worse".
Re:The Tragedy of Google Search by dpkirchner on Friday September 22, 2023 @08:43PM (#37619600)
I can almost guarantee you that you'd find better results if you could block all results from spammy domains (without using an extension). It's practically a tautology.
Re:The Tragedy of Google Search by xnx on Friday September 22, 2023 @08:47PM (#37619628)
It's probably a good thing that just one week ago Google rolled out their "helpful content update" that incorporates a site-wide quality signal: https://developers.google.com/search/updates/helpful-content...
Re:The Tragedy of Google Search by dpkirchner on Friday September 22, 2023 @08:53PM (#37619657)
It looks like this uses some sort of automated system controlled by Google -- I am skeptical we'll see any improvements, given how bad results have been for so long (see all the SO and GH clones returned by Google for many examples). Who knows, though; I've certainly been wrong before.
Re:The Tragedy of Google Search by smcin on Friday September 22, 2023 @07:16PM (#37619018)
I cited [above](https://news.ycombinator.com/item?id=37618517) a Google search for

"Are US drivers licenses forgery-proof?" and "Can US Real-ID drivers licenses be forged?"

gave utterly irrelevant #1 or #2 hits: nothing to do with US or Real-ID (zero mentions), it's about New South Wales, Australia (lots of mentions of "NSW"). (although from US magazine Wired.com, but Google can still tell this article is totally irrelevant).

2) I previously in 2022 posted "Google search relevance fail: result for “Africa longitude” [https://news.ycombinator.com/item?id=30337563] where the #1 site hit and text result were the grossly misleading "Africa/Coordinates 8.7832° S, 34.5085° E", which is not a range, or even a centroid, just a junk location in southern Tanzania, where a (Russian?) SEO spam person seemed to have dropped a bogus pin, mislabeled "оф. 3, 27 ул. Хабаровская, Bila Tserkva, Russia". In Tanzania. 17 months later and same gloriously unfixed garbage results.

Other bizarre top hits were the small Ottawa e-commerce digital-map site https://www.mapsofworld.com/lat_long/africa.html, with the incomplete and inaccurate non-sentence "Africa's latitude and longitude lies between 9.1021° N, 18.2812° E." (That e-ecommerce store seems to have an autogenerated page with incorrect information on latitude and missing longitude for each country).

These are cases where Google itself 5 years ago would have done better. Or compare to Kagi.

Re:The Tragedy of Google Search by janalsncm on Friday September 22, 2023 @08:57PM (#37619684)
I’ve thought about making an account and spending the free quota on a side by side comparison. The problem is you need a representative sample of queries. The things I search might not be what you search or what my mom searches.
Re:The Tragedy of Google Search by nilespotter on Friday September 22, 2023 @06:25PM (#37618564)
80% good enough results and this [1] was all I needed to switch and not look back.

[1] https://kagi.com/privacy