News for hackers. Stuff that matters.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Friday April 15, 2022 @06:25PM (#31046665)
I used them nearly exclusively and recommended them to all my friends. Once they started censoring content for political reasons (Ukraine), that ended instantly.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by 0134340 on Friday April 15, 2022 @07:56PM (#31047460)
Which enlightened search engine did you switch to that doesn't bias results?
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Friday April 15, 2022 @08:14PM (#31047605)
If I'm gonna use a biased engine why use a shit one like DDG?
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by antiframe on Friday April 15, 2022 @08:25PM (#31047667)
Which search engines are not "shit" in your estimation?
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by TobyTheDog123 on Friday April 15, 2022 @09:00PM (#31047969)
I'm not OP, but I'll weigh in:

Google - it's a really good search engine, but obviously biased and doesn't care about your privacy. I use it on my work machine.

Brave Search - I'm not sure if another service (like Bing) powers their results, but it works pretty well for my personal use cases.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by tag2103 on Friday April 15, 2022 @09:17PM (#31048119)
I switched to Brave Search and generally am pleased. I did notice current events is somewhat lacking. I was searching one of the wildfires in NM yesterday and no dice. Otherwise for general information or more "static" type info I've been pleased.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by TobyTheDog123 on Friday April 15, 2022 @09:47PM (#31048366)
Code / stackoverflow is also somewhat lacking on Brave Search, but I'm a big fan of the ability to do !g to redirect the request to Google (I don't care if they see that I'm trying to figure out why my build is failing c: )
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by cinquemb on Saturday April 16, 2022 @12:45AM (#31049562)
I compile my own fork of FF for myself and my family for years, and i've switched us all to brave search for the same reasons as ` colordrops`.

`yegg` can do whatever he want's, I just want no part of it.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by wyclif on Saturday April 16, 2022 @12:31AM (#31049504)
I switched to Brave Search and browser recently. It's based on chromium/Blink and feels a lot snappier than Firefox/Gecko.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Sunday April 17, 2022 @05:27PM (#31064658)
I've tried Firefox a few times over the years and always switched back for the same reason - it didn't feel "snappy" and some things didn't render properly. Something has changed recently though. Both these issues appear to be completely gone. And now that I've got the Containers extension installed, it's superior to chromium in all material ways, except maybe the dev tools.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by astrobe_ on Saturday April 16, 2022 @03:53AM (#31050513)
Maybe it's time to use those search bookmarklets again. When I think about it, many times I already know where the answer could be.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by mehdix on Saturday April 16, 2022 @09:20AM (#31052095)
I guess I have thousands of bookmarks. I always search my bookmarks first, known sites second, DDG next and Google last. In both Firefox and chrome there is exclusive bookmark search within the addressbar. In FF it is * and then space.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by 9935c101ab17a66 on Friday April 15, 2022 @09:50PM (#31048393)
Can you explain how an unbiased search engine would work? Sounds like a billion dollar idea tbh.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by karaterobot on Saturday April 16, 2022 @01:12AM (#31049681)
Compose an index by randomly spidering IP addresses. Return search results by randomly selecting an exact string match from the index. Rats, probably not a billion dollar idea after all!
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by MrBlueIncognito on Saturday April 16, 2022 @08:00AM (#31051629)
One could reproduce a similar effect by surrounding your query with double-quotes on Google.

> Return search results by randomly selecting an exact string match from the index.

It could potentially surface results that you could not have found otherwise. A random dump of links, each one's relevance you must determine on your own. Or another way to put it: you do the ranking. Not a very fun idea to most.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by mastazi on Friday April 15, 2022 @06:44PM (#31046850)
> censoring content for political reasons (Ukraine)

what type of content did they censor? Do you have a link with more info?

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by yeahman on Saturday April 16, 2022 @02:22AM (#31050042)
For example removing tass from their index
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by yegg on Saturday April 16, 2022 @06:46AM (#31051298)
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by m55au on Saturday April 16, 2022 @07:24AM (#31051479)
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by yegg on Saturday April 16, 2022 @07:52AM (#31051589)
Not sure what is going on with those URL params, but I see results just fine at https://duckduckgo.com/?q=site%3Atass.com and in any case an easier way to do things is to not use a site search but just put the domain or name in the query like 'ukraine tass' and something from that site will usually come up on top.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by crtasm on Saturday April 16, 2022 @10:17AM (#31052521)
GP's links include a filter for "past month".
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by yeahman on Saturday April 16, 2022 @09:31AM (#31052177)
I don't. I can't get a single hit on duckduckgo from tass.com. I tried "site:tass.com bucha" and variations there of.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by artificial on Friday April 15, 2022 @07:14PM (#31047108)
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by grapeskin on Friday April 15, 2022 @07:36PM (#31047279)
People complain about search engines like Google being full of garbage and fake info. DDG takes actions against that and people cry that it’s not fair.

Are they supposed to just let governments astroturf their way to the top with propaganda?

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by kube-system on Friday April 15, 2022 @08:07PM (#31047563)
I think some people are under the impression that it’s possible to build a useful search engine that is completely algorithmic and unbiased. It’s just not possible, though.

Any algorithm for which there is incentive to game, people will game. And legitimate sources often have no incentive to game the algorithms. There’s no one algorithm that will do everything perfectly. Eventually you’ll have some phishing scam, life-threatening suggestions, or illegal content popping up as a top result, and you’ll have to add manual exceptions.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by TobyTheDog123 on Friday April 15, 2022 @09:12PM (#31048079)
I think it all comes down to the type of curation being done and if the choices are made out of objectivity of subjectivity.

Like prioritizing a legitimate website over a scam website isn't punishing the scam website because of a controversial opinion or the search engine operator didn't like the content, it's because the website is objectively a scam, it's easy to objectively identify it as such, and everyone agrees it's one.

When it comes to Ukraine vs. Russia and propaganda, it is entirely impossible to have objectivity. As angry as this will make some people, opinions on the war in Ukraine are subjective. Russian outlets shouldn't be ranked lower than Ukrainian ones solely because a lot of people are on the side of Ukraine.

I'm sure some Russian outlets are spreading objective falsehoods, and some Ukrainian outlets are spreading objective falsehoods. These individual outlets should be punished in search rankings, but to classify all Russian outlets as spreading misinformation and all Ukrainian outlets as objective truth completely demolishes the objectivity a lot of people want their search engines to have.

It's a difficult topic, I feel like I talked in circles writing this comment.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by grapeskin on Friday April 15, 2022 @09:52PM (#31048410)
I think people are running with the idea that DDG is only punishing Russians. Russian media also loves pushing this idea.

I'm not convinced that DDG isn't downranking all junk. Russian disinfo spreaders and consumers just scream the hardest when their garbage is rightfully pushed aside. Same as the Q-worshipping crowd.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by ppseafield on Friday April 15, 2022 @10:11PM (#31048560)
> it's easy to objectively identify it as such [scams], and everyone agrees it's one.

Is it actually easy to identify all scam content? Then why is it possible to find scams in search results?

> When it comes to Ukraine vs. Russia and propaganda, it is entirely impossible to have objectivity.

So should they treat every news outlet as equally ranked? Because I'm struggling to think of any news reporting that could be said to be free of bias or could be said to be completely objective.

> ...to classify all Russian outlets as spreading misinformation and all Ukrainian outlets as objective truth

Is that what they did? Because what I read was that they would "down-rank sites associated with Russian disinformation." So you have to dig a few pages deeper to get to 'Russian disinformation', and I don't see any anything indicating that 'Russian disinformation' means everything published by a Russian News outlet (re: the invasion).

I don't think something being a top search results implies that it is an objective truth either, especially with ongoing news reports.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by TobyTheDog123 on Saturday April 16, 2022 @01:25AM (#31049746)
>Is it actually easy to identify all scam content? Then why is it possible to find scams in search results?

I think to a knowledgable observer and moderator, sure. Algorithmically it's probably more difficult, which is why you still see it in some search results. These scams are less prone to subjectivity, which is why you rarely see Twitter uproars about a bitcoin pyramid scheme being booted off a search engine.

>So should they treat every news outlet as equally ranked?

Yes....

>Because I'm struggling to think of any news reporting that could be said to be free of bias or could be said to be completely objective.

....and that is the reason for why they should be equally ranked. You can see on the initial page load the full spectrum of reporting from MSNBC to Fox News. Of course one of them has to be ranked above the other in the UI (it's a list of items) but that should relate to objective things like what words from the search query appear, etc.

>Is that what they did?

I think what people take issue with is that we're trusting these sites to determine what disinformation is. How is DDG deciding what is and isn't misinformation? Without a clearly defined process for misinformation, this becomes subjective.

>> "Weinberg didn’t elaborate on the decision, or how the down-ranking will work."

But other sites are simply doing a blanket ban:

>> "Since then, the internet industry has responded by blocking access to Russian state-sponsored media outlets such as RT and Sputnik News for users in the EU. In addition, Twitter has placed warning labels on tweets linking to Russian state media. (Google News decided to de-rank RT and Sputnik News back in 2017 for allegedly circulating propaganda.)"

>I don't think something being a top search results implies that it is an objective truth either, especially with ongoing news reports.

Not right now, no, and that's the issue. Most people assume it to be though.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by kube-system on Saturday April 16, 2022 @02:02AM (#31049940)
>>So should they treat every news outlet as equally ranked?

>Yes....

>>Because I'm struggling to think of any news reporting that could be said to be free of bias or could be said to be completely objective.

>....and that is the reason for why they should be equally ranked.

Just because you can find a fault with a source does not mean that all faults are equal. For instance, the AP should probably be ranked above the National Enquirer.

> I think what people take issue with is that we're trusting these sites to determine what disinformation is. How is DDG deciding what is and isn't misinformation? Without a clearly defined process for misinformation, this becomes subjective.

It is an inherently subjective process and always will be. There are organizations that have attempted to make the process objective (i.e. fact checking organizations) but they can all be criticized as subjective as well. Pure objectivity simply isn’t possible.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by hntaw012 on Saturday April 16, 2022 @02:51AM (#31050187)
This kind of thinking is exactly why the Russian misinformation campaigns have been extremely successful (especially in Russia). Russia doesn't care about the individual outlets as long as they help spread lies, no matter how absurd or obvious. This doesn't have to be done as carefully or subtly as the western world seems to think.

Russia is discrediting truth as a concept entirely, the narrative being "we are obviously lying, but so is anyone else". That others might not be lying as much seems to be harder and harder to understand by the targets of these campaigns (based on firsthand witnessing). With objective facts / reporting discredited what's left is opinions. Opinions generated by a carefully managed army of influencers promoting whatever cause is deemed useful (from bloggers to friendly/financed foreign government officials). And this _is_ done with the secrecy and subtlety you'd expect.

It might not be possible to have complete objectivity regarding the invasion of Ukraine, but imho a blanket ban of any media with Russian ties would be a heck of a lot better than to let Russia continue to destroy objective reporting, one of the foundations of our modern society.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by fauigerzigerk on Saturday April 16, 2022 @06:09AM (#31051141)
I think we should try to enforce transparency and make sure that false information can be disputed.

If Russia sends armies of trolls to clandestinely influence social media consumers as part of their information warfare operation then we should try to stop that.

But if Russia officially publishes its own position under the name of its own news agency or in their government media then we should not censor it and we should not keep it off western platforms where it can be clearly marked and disputed.

I want to know how Russia justifies its brutal war of aggression against a neighbour. I fully expect that their justification is full of lies and distortions. But it's truth in the sense that it is in fact how Russia justifies the war. I want to know that truth.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by licebmi__at__ on Saturday April 16, 2022 @04:10AM (#31050583)
"Manufacturing consent" was written in 1988. Did Russia's campaign against the truth was already happening?

When I was growing up, certainly before even RT existed, it was common knowledge that journalist will cover the events according to their own (or bosses) interests. IME (not russian, but also not american), the idea of objective reporting is the anomaly.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by ummonk on Friday April 15, 2022 @07:43PM (#31047345)
They certainly shouldn’t be singling out one specific country’s astroturfing for down ranking.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by kube-system on Friday April 15, 2022 @07:49PM (#31047394)
I agree, but a response to a topical issue is not necessarily evidence of that.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Friday April 15, 2022 @07:49PM (#31047393)
One of the reasons I left google is precisely because they started downranking content for political reasons, just as DDG started doing.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by throwmeariver1 on Saturday April 16, 2022 @12:23AM (#31049452)
Which search engine are you using now? I bet we will find them downranking for political reasons as well but I bet you are fine with their reasoning…
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Saturday April 16, 2022 @01:04AM (#31049650)
We are talking in circles. If I'm gonna use an engine that downranks for political reasons then I might as well not use a shit one like DDG.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by throwmeariver1 on Saturday April 16, 2022 @06:45AM (#31051292)
No you are avoiding a simple question with a nothing burger answer.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Sunday April 17, 2022 @10:27PM (#31066650)
Google. It provides better results than DDG in many cases. The one case where DDG provided better results than Google was unfiltered news and opinion. That is no longer the case, so I'll use the shitty search engine which works a bit better for things like technical searches.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by 9935c101ab17a66 on Friday April 15, 2022 @09:49PM (#31048386)
The whole point of a search engine is curation, and excluding garbage or in the case of Russia/Ukraine, making willful misinformation less prominent is an act of curation.

A search engine is largely two things:

(1) crawling and discovering all available resources (2) parsing a user’s request for a resource of some kind and providing the user with a means of accessing “best matches”

This process is inherently, unequivocally and fundamentally biased. It HAS TO be. There is no abject, absolute, canonical result for a search engine query. Ddg/google “censor” () all kinds of results constantly. Malware sites, sites that just mirror content from stackoverflow, sites that may cause public harm, etc. That’s the whole point.

Another note: they may be downranking those results because users are unsatisfied with their quality. DDGs job is to help the user find what they are looking for, and if the user finds a bunch of Russian propaganda that is blatantly not what they wanted when they search for something (perhaps because Russia is exploiting SEO or using other techniques to inflate their position), why wouldn’t they tweak their product?

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by logicchains on Saturday April 16, 2022 @05:37AM (#31051009)
> The whole point of a search engine is curation, and excluding garbage or in the case of Russia/Ukraine, making willful misinformation less prominent is an act of curation.

Unfortunately it seems that in 90%+ of cases "willful misinformation" is just anything that contradicts the political views of the democrat-leaning Google management.

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by 9935c101ab17a66 on Saturday April 16, 2022 @05:42AM (#31051032)
Please provide proof.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by bavell on Saturday April 16, 2022 @09:48AM (#31052289)
Hunter Biden laptop story is a good example of "right wing disinformation"... oops I meant reality!
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by 9935c101ab17a66 on Saturday April 16, 2022 @07:08PM (#31056902)
Not sure what that has to do with anything or what point you’re trying to make.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by colordrops on Sunday April 17, 2022 @10:26PM (#31066640)
The hunter biden laptop story was true and yet it was forcefully removed from many media outlets, more than any story I've ever seen. Glenn Greenwald was working the story and got pushed out of the organization he founded, The Intercept, because of it. There were very powerful forces aligned to blacklist the story to protect Biden's candidacy.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by moffkalast on Friday April 15, 2022 @06:43PM (#31046844)
I've always been a bit suspicious that despite having seemingly no way of making revenue they manage to plaster every corner of the internet with their paid ads. Like, aren't they supposed to be a damn nonprofit or something? Makes absolutely no sense.
Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by kube-system on Friday April 15, 2022 @07:37PM (#31047287)
I’m not aware of them being non-profit. Not that any particular tax status precludes ad spend.

DDG makes revenue from serving ads and participating in affiliates networks.

https://help.duckduckgo.com/duckduckgo-help-pages/company/ad...

Re:DuckDuckGo Removes Pirate Sites and YouTube-DL from Its S... by caslon on Friday April 15, 2022 @07:34PM (#31047264)
They serve ads on DuckDuckGo, though.