News for hackers. Stuff that matters.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by someperson on Tuesday November 04, 2025 @07:13PM (#45817472)
Feels weird to say but I have found using Yandex of all places an excellent search engine for content that get taken down by DMCA requests.

Eg if you want to watch a movie that's not on Netflix using a web stream the search results are far better.

Feels like Google circa 2005.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by chneu on Tuesday November 04, 2025 @07:50PM (#45817765)
I've been playing around with a variety of search engines such as Kagi, Startpage, Ecosia, DDG.

All of them are better than google in finding relevant results. Lol

Google is way too "personalized".

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by qiqitori on Tuesday November 04, 2025 @07:54PM (#45817788)
You can turn off personalization. (Operating under the assumption that most people search for facts, I personally don't see why one would ever want personalized results.)
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by skulk on Tuesday November 04, 2025 @08:21PM (#45817941)
> I personally don't see why one would ever want personalized results.

The same short combination of words can mean very different things to different people. My favorite example of this is "C string" because when I was a kid learning C I was introduced to a whole new class of lingerie because Google didn't really personalize results back then. Now when I search "C string" Google knows exactly what I mean.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by Ariarule on Tuesday November 04, 2025 @08:24PM (#45817956)
I won't bother defending Google-style personalization as it exists for their search results, but since collisions in terminology across fields are common, it's not that hard to see how actual, thoughtful personalization could be useful. Someone searching for "Kafka" is going to want very different results based on whether they're thinking of software or literature. Opinions may also differ over the usefulness of sources, even for people ultimately interested primarily in facts; I find Kagi-style personalization (make your own domain list) very useful, but across Kagi's userbase Reddit is simultaneously one of the most lowered, most raised, and most pinned domains: https://kagi.com/stats?stat=leaderboard
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by p1necone on Tuesday November 04, 2025 @08:37PM (#45818044)
Anecdotally I find myself appending 'reddit' to search terms very frequently. It's effectively shorthand for "I want to read about peoples direct experience with this thing", and reddit is huge and well crawled by search engines. It's astroturfed to hell especially around political topics, but I feel like it's easy to tell when discussions about random products are authentic.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by dboreham on Tuesday November 04, 2025 @08:31PM (#45817995)
> Kafka" is going to want very different results based on whether they're thinking of software or literature.

Speak for yourself. I've worked in several "Kafka-esque" software organizations.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by dotancohen on Wednesday November 05, 2025 @05:56AM (#45821554)
Arguably Google SERPs are getting closer to The Trial.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by p1necone on Tuesday November 04, 2025 @08:28PM (#45817978)
Location based personalization is pretty useful - if I search for 'Bob's Discount Linguine' I want the one in my neighborhood.

Lots of niche things (like programming) also reuse common english words to mean specific things - if I search e.g. 'locking' it's nice to get results related to asynchronous programming instead of locksmiths because google knows I regularly search for programming related terminology.

Of course it's questionable whether google does a good job at any of this, but I absolutely see the value.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by edgineer on Tuesday November 04, 2025 @11:21PM (#45819026)
Personalization would be good if it meant recognizing that I dislike blogspam, SEO'd pages, advertisements, and assuming my location.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by goku12 on Tuesday November 04, 2025 @11:21PM (#45819028)
I often find myself searching for information that's not from my locality. This sort of 'location personalization' frustrate such efforts so much that I rarely 'google' these days. What's the point of having access to the internet if that access is going to be restricted like this without consent? If they want to make my search experience more relevant, they should provide me an option to limit my search, rather than callously assume my intentions.

It's much more egregious on the Android play store. Many apps like banking, transportation and online shopping apps are geolocked for installation, sometimes even without the developers' request or knowledge. What if I'm flying over there in two days, or just want to help someone who's already there? And even when I'm there, I have to prove my presence by supplying the local credit card details! Nothing else is enough - not GPS, not cell tower IDs, not the IP ranges or whatever else.

This is just outrageous because I can't even get a device that I paid for, to work for me. This is just sheer arrogance at this point - a wanton abuse of their co-monopoly privileges. However, I'm not under any delusions that they're here to improve my digital experience. These corporations profit by restricting their "users'" experience on an otherwise fully open internet.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by skydhash on Tuesday November 04, 2025 @09:35PM (#45818350)
I just add another keyword to narrow the search result. I don’t think I’ve ever wanted results based on anything other than the query.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by throwaway-0001 on Tuesday November 04, 2025 @10:53PM (#45818822)
Can you show me what results you see for “locking”? I see dancing move in all profiles I have.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by smcin on Tuesday November 04, 2025 @11:56PM (#45819324)
Wow you're right. Locking dance moves and videos.

Weere you expecting to see padlocks or doorlocks or what?

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by throwaway-0001 on Wednesday November 05, 2025 @01:45AM (#45820029)
I expected to be “personalized”. I’m definitely more into programming than dancing. I see 0 personalization tbh. And I tried a few different peoples phones.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by smcin on Wednesday November 05, 2025 @04:07AM (#45820947)
Oh I see, locking in the programming sense, yes. Either not every search term is personalized for your context, or else this particular search is being applied to some other demographic. But that's weird because "locking" doesn't also show door, windows, filing cabinets.

Anyway if you search for "programming locking" you get relevant results.

Google didn't used to do this. Anyone got a rough idea when this started?

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by p1necone on Wednesday November 05, 2025 @02:49PM (#45827046)
I was defending personalization in general, not saying that google is doing a good job of it now (see last paragraph of my first comment).
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by qiqitori on Wednesday November 05, 2025 @12:49AM (#45819661)
Search results are still location-specific even if you disable personalization.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by dotancohen on Wednesday November 05, 2025 @05:55AM (#45821547)
For the better part of a decade it seems that every verb or noun I search for, all the top search results are some movie or TV show named after that verb or noun. And I've watched exactly two movies in the past two decades (Star Wars VII when it came out, and Alien just last week).

Sometimes I consider actually enabling personalized search just to get to the things that I'm actually looking for.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by smcin on Tuesday November 04, 2025 @11:55PM (#45819307)
Some people search for shopping, or business details, in which case personalization can improve (or disimprove) result relevance based on knowing where you currently are, what day and time it is, what you tend to order etc. etc.

And some people search for songs/images/videos/books/articles.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by mtillman on Tuesday November 04, 2025 @09:33PM (#45818340)
Google hides the most relevant results on the 3rd page. It was confirmed in trial disclosures a few months ago. Their concern isn’t public search.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by smcin on Tuesday November 04, 2025 @11:51PM (#45819274)
Doesn't https://www.google.com/search?q=your+search+query&ei=...&sta... give you page 3? Or at least, try jittering it a bit and compare to frontpage results.

> &start= parameter. This parameter controls which result number the page starts with. Google displays 10 results per page by default. For page 1, start=0 For page 2, start=10 For page 3, start=20

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by superkuh on Tuesday November 04, 2025 @11:14PM (#45818980)
Google only ever returns a maximum of <400 results. If you actually click through at 100/page, you'll only get 3.something pages of results. Despite what is says at the top re: results. Those results are not accessible.

Bing only returns 900. Kagi only 200. Deep search and surfing is pretty much gone on all major search "engines".

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by locknitpicker on Wednesday November 05, 2025 @12:56AM (#45819706)
> Google only ever returns a maximum of <400 results.

That's perfectly fine. If I'm going to use a search engine, I'm not willing to sift through hundreds of potentially relevant results. I hope I find what I'm searching for in the first page, or at best in the first 3 pages or so.

What's not cool about Google is that now it hits you with AI slop with dubious quality right at the top, followed by a page of sponsored results, followed by some potentially useful results, followed by an entire ocean of spam traps and clone sites and really shady results with exotic never-seen-before TLDs that leaves you wondering whether clicking on a link will get in a hostile database. That's what's not cool about Google: is that you can't use it to search the web anymore.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by mschuster91 on Wednesday November 05, 2025 @06:26AM (#45821710)
It's not Google's fault alone.

SEO manipulation for example, that could be tackled by our legal system similar to existing slander, unfair competition and advertising regulations. But unfortunately, most representatives are not digital natives but old digital buffoons, and the post-2000/Gen Z kids never gained an understanding of what actually makes the web tick.

As for the TLD explosion, we definitely need a completely new setup for ICANN. The trouble all of that has caused, just for a measly 250k in fees for each new gTLD, is insane.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by nine_k on Tuesday November 04, 2025 @10:19PM (#45818600)
Seems to not be empirically true.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by mtillman on Wednesday November 05, 2025 @02:19AM (#45820282)
Edit: after the 3rd page

Source: https://www.courtlistener.com/docket/18552824/1436/united-st...

For fun what Gemini says: “The notion that Google explicitly admitted to "deprioritizing good results to sell more ads" is a common interpretation of these documents and expert testimony.”

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by thaumasiotes on Wednesday November 05, 2025 @05:09AM (#45821316)
> Source: https://www.courtlistener.com/docket/18552824/1436/united-st...

That's a 230-page pdf. Do you have a more specific citation?

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by giamma on Wednesday November 05, 2025 @06:35AM (#45821759)
I passed the PDF to Claude and asked it to check if there is any part of the document that states that google deprioritizes good search results in favor of advertisement. Here is the output from Claude:

Yes, the document contains highly significant factual findings by the Court regarding how Google deprioritized organic search results in favor of advertising. The most significant findings: The Court documents that the positioning of Google's AI features (AI Overviews, WebAnswers) on the search results page reduced users' interactions with organic web results - deliberately.

Relevant text:

"Some evidence suggests that placement of features like AI Overviews on the SERP has reduced user interactions with organic web results (i.e., the traditional "10 blue links")."

And:

"Placement of features like AI Overviews on the SERP has reduced user interactions with organic web results where Google's WebAnswers appears on the SERP"

Important note: these are not "admissions" in the sense of Google voluntarily confessing, but rather factual findings by the Court based on evidence presented during the trial - which is legally even more binding.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by n1xis10t on Wednesday November 05, 2025 @08:27AM (#45822594)
All that claude said there was that they made people interact with the blue links less, by using AI and stuff.

None of that confirmed the claim that they hide the most relevent results past page 3. I guess I have to read the thing myself

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by TranquilMarmot on Wednesday November 05, 2025 @01:00AM (#45819737)
I switched to Kagi a while back and ended up buying their annual subscription for unlimited searches. It's such a breath of fresh air, like a search engine from an alternate universe where Google just focused on search instead of adtech.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by mrweasel on Wednesday November 05, 2025 @06:42AM (#45821802)
The fact that Google seemingly returns results worse than Kagi, Startpage and Ecosia is just strange, given that Google provides search results for all three of them. Both Kagi and Ecosia uses other sources as well, I don't know about Startpage, so that's certainly part of it, but it still feels a little strange.

From using Ecosia, DuckDuckGo and Bing, I'd also argue that Bing is simply a better search engine at this point.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by TurboSkyline on Wednesday November 05, 2025 @06:48AM (#45821838)
Don’t Ecosia/Qwant have their own index now?

Do you find Bing better through Bing proper, or just as good through DDG (which uses the Bing index)?

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by mrweasel on Wednesday November 05, 2025 @07:23AM (#45822087)
Last I read the Ecosia/Qwant index is only used in German and French, so I think Ecosia is still running their weird Bing/Google/Other mix.

Bing felt about as good as Ecosia, until Ecosia started to mix in the Google results. At that point Ecosia became they better search engine. Bing vs. DDG, I'd say about the same. I stopped trying to use Bing once they rolled out all the Copilot nonsense. Now the UI is unusable and cluttered.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by spragl on Wednesday November 05, 2025 @07:01AM (#45821932)
DDG is okay. Startpage is quite good. I make a virtue of regularly shifting between search engines (not Google). Sometimes they are not so good, some times very good. On average Im sure my search experience is better than using Google.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by somenameforme on Wednesday November 05, 2025 @07:08AM (#45821981)
Brave search is also quite nice: https://search.brave.com/

I find Google to generally have some of the worst search results of modern engines with one exception - Google tends to be good at digging up results from things like forums/message boards that don't end up getting listed on other search engines.

I don't entirely understand why this is because other engines also have them indexed and work fine with something like: 'site:news.ycombinator.com anna's archive' [1][2] but yet those posts will basically never show up on the main results, regardless of how far down them you go.

[1] - https://search.brave.com/search?q=site%3Anews.ycombinator.co...

[2] - https://yandex.com/search/?text=site%3Anews.ycombinator.com+...

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by admaiora on Wednesday November 05, 2025 @07:10AM (#45822000)
I believe Kagi uses the Yandex index as their base as well.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by DanOpcode on Wednesday November 05, 2025 @06:34PM (#45829530)
Based on what? Have you read that somewhere?
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by quinncom on Thursday November 06, 2025 @12:15AM (#45831754)
[delayed]
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by negativelambda on Tuesday November 04, 2025 @07:41PM (#45817693)
I just tested, indeed very good results!
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by dzonga on Tuesday November 04, 2025 @08:55PM (#45818147)
yep Yandex all days when I wanna wear an eye patch and pirate the seas.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by smcin on Tuesday November 04, 2025 @11:59PM (#45819343)
Hmm, Yandex Ad Network is allowed monetize western e-commerce sites, they divested their Russian assets by 2024.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by bad_username on Tuesday November 04, 2025 @10:32PM (#45818684)
Ah yes, using a Russian service, what could go wrong. Weekly Yandex astroturfers strike again.
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by devsda on Wednesday November 05, 2025 @12:17AM (#45819448)
Where I am, both yandex and Google are services from a foreign land.

I can't say about Yandex because I haven't used it much, but I have used Google and its services enough to know that it may appear neutral but its services do reflect politics of its origin country. For an outsider, I doubt Yandex is going to be any different than Google in those matters.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by someperson on Tuesday November 04, 2025 @11:16PM (#45818996)
For what it's worth, this is my first pro-Yandex comment after 17 years on Hacker News.

It's a major tech company service based in Russia, so presumably controlled by the government of Russia.

But the results produces for a query like "watch (obscure movie) online stream" are far better than what Google or Bing produces. If you need to check a scene of a specific episode of an obscure TV show, it's the fastest method (but happy to hear alternatives).

Also, the websites it links to aren't operated by the government of Russia.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by noosphr on Tuesday November 04, 2025 @11:31PM (#45819097)
Genuine question: what can go wrong?
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by t-3 on Wednesday November 05, 2025 @01:05AM (#45819766)
The damn commies will destroy our film industry and blackmail pirates into revealing classified information! Or maybe nothing.
[dead]
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by nozzlegear on Wednesday November 05, 2025 @08:45AM (#45822752)
This but unironically
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by ForgetItJake on Wednesday November 05, 2025 @12:34AM (#45819570)
> Ah yes, using a Russian service, what could go wrong.

Nothing if you know what you're doing.

> Weekly Yandex astroturfers strike again.

People doing things you don't like doesn't mean they don't exist.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by egorfine on Wednesday November 05, 2025 @04:33AM (#45821101)
As a Ukrainian I cannot feel anything but hatred towards the propaganda machine Yandex has become.

As an engineer I cannot feel anything but respect to the multi-decade research legacy of the company and their incredible search engine.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by probably_wrong on Wednesday November 05, 2025 @06:41AM (#45821795)
This has been my search engine quality test for quite some time.

A good search engine will show you pirate websites because they have a comprehensive index. A great search engine will put them at the top of the list ahead of the fake results.

A great search engine that endures long enough attracts the type of attention that forces them to delist those results. Once you can no longer find that type of results you know it's time to look somewhere else.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by extraduder_ire on Wednesday November 05, 2025 @07:22AM (#45822081)
I started using yandex when searching for bittorrent infohashes (to find other trackers it might be indexed on) after google, bing, and duckduckgo all stopped returning good results a few years ago.

I know there's multiple full string matches out there, but all I can see on the first few pages are very short partial matches from various blockchain explorers like etherscan. I don't know if this was an intentional decision, or a result of them trying to find fuzzy matches, but they fail at this usecase regardless.

Re:Google Removed 749M Anna's Archive URLs from Its Search R... by gosub100 on Wednesday November 05, 2025 @09:32AM (#45823257)
That is brilliant, to search for the hash values. Thanks
Re:Google Removed 749M Anna's Archive URLs from Its Search R... by whatamidoingyo on Wednesday November 05, 2025 @10:37AM (#45824019)
Funny you say this. Just two days ago, my wife was telling me a little history about her country, and suggested a movie based on those events. I couldn't find it on Google, DDG, Bing, Brave, etc. So I tried it on Yandex and it appeared as a top 3 result.

Btw, DDG basically looked exactly like Google. And now they have "sponsored" items...