News for hackers. Stuff that matters.
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by godelski on Friday August 05, 2022 @03:15PM (#32360642)
Are there plans to do more search than wrapping Bing and Yandex?
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by yegg on Friday August 05, 2022 @03:32PM (#32360874)
That isn't an accurate characterization of what we do now. We have on the order of a million lines of search code at this point and have a lot of talented people working them. As an example, mobile searches are the largest category of searches, and local searches are the largest category of searches within mobile. We don't get any local search content from Bing. Instead our local search content is a combination of our own indexes in partnership with Apple, TripAdvisor, and others. And then we have to further have a lot of code to know when and where to display that content on the page relative to other types of results, when to reject that content for not being relevant enough to display, and how to display parts of it that are relevant enough. In addition, we currently do not use Yandex for search content.
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by lapcat on Friday August 05, 2022 @04:32PM (#32361648)
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by yegg on Friday August 05, 2022 @04:37PM (#32361688)
Best would be to report them to us and we can investigate. I see these ones coming up though right now: https://duckduckgo.com/?q=jessesquires.com, https://duckduckgo.com/?q=lapcatsoftware.com, https://duckduckgo.com/?q=bike.bikegremlin.com
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by BikeGremlin on Saturday August 06, 2022 @12:43AM (#32364889)
To help clarify the current situation:

One of those websites reported having problems for a month or so, then having it sorted out all by itself. The author's article on that:

https://www.jessesquires.com/blog/2022/07/25/my-website-disa...

My sites are technically present, but shown only when I search for the exact domain (bikegremlin.com) or the site name (BikeGremlin).

But none of my articles are shown in SERP when I search queries that otherwise get my articles to top-3 on Google.

I've tried submitting URLs for indexing, to see if that will help, now that at least some problems seem to have been fixed. We'll know in a few days... weeks... months if that's helped. :)

So far, articles in my native are back, at least to a degree. But none of my articles in English, even those that used to rank highly (both on Google and Bing/DuckDuckGo etc).

I've used this situation to check which search engines rely on Bing for their results (primitive, unscientific method, but I think it's accurate): https://io.bikegremlin.com/28530/microsoft-bing-serp-gone-ov...

Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by lapcat on Friday August 05, 2022 @05:15PM (#32362059)
Yes, I was able to restore some sites to Bing by Twitter DMing a Microsoft Bing VP. ;-)

Where can cases like this be reported to DuckDuckGo?

Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by yegg on Friday August 05, 2022 @05:22PM (#32362117)
Probably best is the 'Share Feedback' button on our SERP, though we're also listening on social channels.
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by solarkraft on Saturday August 06, 2022 @06:07AM (#32366664)
What are you doing to improve the quality of these results? I often find myself hitting !g because Google just understands what I want better. And that's not with these constantly hyped "local" or "contextual" searches, no, it's the searches for errors, programming problems or memes (which, of course, can be vague). I would gladly submit you some of the requests I use !g for if you had a low-friction UI for it. Maybe you could use some more data on this stuff.

You're also in a unique position to compete with Google by offering advanced search tools. You have the data! Yet I can only search images by "past day", "past week", "past month". Off to Google I go again.

In the same vein, what are you doing to combat SEO spam? Again, you're in the unique position to do something for the public good and your profits here. Your search engine also suffers from the many low quality results of "buy buy buy" (the thing I want information on, not buy, god damn it) and github/SO rehashing sites, ad-laden blog spam and the like.

But imagine if it didn't! Imagine the web being searchable again!

Currently I somewhat follow projects like search.marginalia.nu and mwmbwl (or something), but those don't even have 0.1% of your funding.

I just want to be able to find content made by humans again ...

Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by mda on Friday August 05, 2022 @06:51PM (#32362861)
Doesn't change the fact that ddg is basically a front for mostly Bing (plus a few others for local stuff etc) though. Why not actually investing in real search technology and become an actual search engine?
Re:More Privacy and Transparency for DuckDuckGo Web Tracking... by yegg on Friday August 05, 2022 @06:56PM (#32362892)
We've invested many tens of millions of dollars in search technology and continue to do so. Local was just one example, chosen because as noted it is the largest category of searches.