News for hackers. Stuff that matters.
Re:Most promoted and blocked domains among Kagi Search users by scarmig on Friday August 04, 2023 @08:01PM (#37007444)
Didn't Google have this feature like two decades ago (blocks, at least)? It's not quite a search innovation, more like a "caring about your users as a business strategy" innovation.
Re:Most promoted and blocked domains among Kagi Search users by jsnell on Friday August 04, 2023 @08:23PM (#37007625)
Yes, they had it for a few years a decade ago.

If you think through the feature, it's not at all obvious that it's a good idea for an established search engine targeting the general public [0]. But even then it might be a great idea for a search engine that's trying to establish an initial niche. It doesn't even matter whether the idea actually works well in practice: if 100k people think that manual curation of search result domains is a high value feature and are willing to pay for it, the feature has done its job.

[0] I wrote a more detailed comment on why a few months ago: https://news.ycombinator.com/item?id=34294800

Re:Most promoted and blocked domains among Kagi Search users by cabalamat on Friday August 04, 2023 @10:07PM (#37008270)
> that's trying to establish an initial niche

Which suggests to me that while kagi might be good now, if it gets popular it may undergo enshittification in an effort to monetise its popularity.

Re:Most promoted and blocked domains among Kagi Search users by pokeymcsnatch on Friday August 04, 2023 @10:16PM (#37008325)
It's a paid service and all their competitors are 'free'. Enshittification doesn't fit their business model, they'd go under in a heartbeat.
Re:Most promoted and blocked domains among Kagi Search users by SQueeeeeL on Friday August 04, 2023 @10:18PM (#37008328)
See also, Whatsapp
Re:Most promoted and blocked domains among Kagi Search users by rchaud on Friday August 04, 2023 @11:51PM (#37008829)
Cable TV didn't use to have ads, until somebody figured out you could charge the customer and have other streams of revenue as well.

For Kagi, it's a matter of when, not if. Capitalism guarantees it.

Re:Most promoted and blocked domains among Kagi Search users by yakubin on Saturday August 05, 2023 @02:08AM (#37009426)
An even sadder example of it: Windows.
Re:Most promoted and blocked domains among Kagi Search users by freediverx on Tuesday August 08, 2023 @09:22AM (#37048584)
I don’t think the term enshittification applies when a product is fully enshittified from its inception.
Re:Most promoted and blocked domains among Kagi Search users by esafak on Saturday August 05, 2023 @02:20AM (#37009487)
No, it does not. They are free to create adjacent products to boost revenue as long as they want without debasing existing ones.
Re:Most promoted and blocked domains among Kagi Search users by TeMPOraL on Saturday August 05, 2023 @02:56AM (#37009651)
And the oxygen in the room you're in is free to concentrate in a single corner of it, making air in the rest of the room unbreathable.

Both are technically possible, but so extremely unlikely, that you can rely on them not happening.

Re:Most promoted and blocked domains among Kagi Search users by yard2010 on Saturday August 05, 2023 @05:28AM (#37010407)
My ML prof in university used this as an example for something that could happen but is highly unlikely. Each particle of oxygen can be in either half of the room so it's like 1/2 to the power of the number of particles (avogardo?) chance that all the particles are in one half suffocating the ppl in the other half. He was such a great guy.
Re:Most promoted and blocked domains among Kagi Search users by throwaway2037 on Saturday August 05, 2023 @10:59AM (#37012665)
This is a good point. Did Kagi ever consider having a freemium tier that uses adverts to pay for the (search) content? I don't think it is a terrible idea if it helps Kagi to improve their paid search.
Re:Most promoted and blocked domains among Kagi Search users by version_five on Saturday August 05, 2023 @07:18AM (#37010923)
As long as they don't take outside investment that's not a certainly. People complain about the prices but it's charging the real cost that let's them be able to offer something good without mortgaging the future.

I concede that if they got big enough, someone would come with enough money that they couldn't refuse, and buy them to try and "unlock vale" by racing to the bottom.

Re:Most promoted and blocked domains among Kagi Search users by carlosjobim on Saturday August 05, 2023 @07:59AM (#37011162)
How nice then that you can use Kagi as it is right now, today. Then if your prediction comes true in the future you can stop using Kagi.
Re:Most promoted and blocked domains among Kagi Search users by Karunamon on Saturday August 05, 2023 @09:06AM (#37011635)
Capitalism is the only reason they exist in the first place.

Don't confuse an entire economic system with the unique problems caused by public ownership or investing (i.e. growth at all costs). Plenty of smaller organizations would be quite happy to operate with modest profits for their owners and never scale beyond that point.

Re:Most promoted and blocked domains among Kagi Search users by rchaud on Saturday August 05, 2023 @11:29AM (#37012985)
> Capitalism is the only reason they exist in the first place.

Precisely, which is why enshittification is a when, not an if. A paid search engine will never pick up enough users to survive at $10/mo. It will either be acquired or start throwing in "non-intrusive" ads to balance the books.

Re:Most promoted and blocked domains among Kagi Search users by freediver on Saturday August 05, 2023 @02:27PM (#37014987)
> start throwing in "non-intrusive" ads to balance the books

Here is a personal guarantee that this will never happen with Kagi while I am in charge.

There are too many ad-supported search engines and browsers out there. I would not waste 10 years of my life to make yet another one. If Kagi can not sustain iteself with memberships, it will be the end of it.

The initial reason I started Kagi was to provide my kids with an opportunity to grow up in an ad-free experience of the web. In this interview [1] I talk more about my motivation.

[1] https://dkb.io/post/DEPR_kagi-interview

Re:Most promoted and blocked domains among Kagi Search users by barrysteve on Saturday August 05, 2023 @08:00PM (#37017498)
You have broken your privacy policy to share user block lists as advertising on HackerNews.

Call us back in 6 months when you arbitrarily change something else and give us another motivating pep talk about your commitments. roll eyes.

Re:Most promoted and blocked domains among Kagi Search users by freediverx on Tuesday August 08, 2023 @09:27AM (#37048662)
How has this broken any privacy policy? To me this seems like general information that can’t possibly be traced back to any individual users or groups of users.
Re:Most promoted and blocked domains among Kagi Search users by freediverx on Tuesday August 08, 2023 @09:24AM (#37048616)
You’re conflating capitalism with commerce.
Re:Most promoted and blocked domains among Kagi Search users by throwaway2037 on Saturday August 05, 2023 @10:56AM (#37012631)
"Enshittification": God, I love this term. It so perfectly captures what happens to a product when revenues stall and product managers think of anything to drive new revs. See: Microsoft Windows or Microsoft Office.

I was just about to finish this post and ask if anyone knows the history. I Googled that and was surprised by the answer from Wikionary: https://en.wiktionary.org/wiki/enshittification

    ...[C]oined by Canadian-British blogger, journalist, and science fiction author Cory Doctorow in 2022.
God damn, "Dr." Doctorow again!
Re:Most promoted and blocked domains among Kagi Search users by ocdtrekkie on Friday August 04, 2023 @10:50PM (#37008489)
A key point is that Kagi raised its prices already so it was sustainable. The reason most services get worse is because they are downright unprofitable and it is impossible to get them there without either making them drastically worse, or raising prices, which free sites can't do.

Kagi has already put itself on a path where it doesn't have to make itself worse to cover its expenses, because it is already covering them.

Re:Most promoted and blocked domains among Kagi Search users by freediverx on Tuesday August 08, 2023 @09:17AM (#37048536)
No, the main reason why companies turn to shit is because they’re publicly traded and accept VC money so sooner or later, they’re beholden to shareholders demanding infinite growth and profits.
Re:Most promoted and blocked domains among Kagi Search users by carlosjobim on Saturday August 05, 2023 @07:57AM (#37011150)
This is honestly probably the most tiresome argument that constantly pops up in every HN thread.

Imagine if one of your friends come back from a holiday trip and tells you how fantastic the place they visited was. Is your response "Well, maybe that place ain't going to be so nice in a few years!"?

Re:Most promoted and blocked domains among Kagi Search users by freediverx on Tuesday August 08, 2023 @09:16AM (#37048511)
That’s exactly my fear.
Re:Most promoted and blocked domains among Kagi Search users by nine_k on Friday August 04, 2023 @10:28PM (#37008382)
I think you miss he point.

The usefulness of a per-user block list is not fighting outright spam. The statistical filters, etc, as applied by the search engine, work best here, as you correctly state.

The point is to remove certain well-known sites with information about well-known topics, which is unhelpful for the particular user, me. That information is technically not spam, but it's on a wrong level, badly presented, etc.

That is, if I search some info about a particular CSS trick, I want MDN be on top, some professional blogs be near top, and w3schools be on the third page. For someone else, priorities may be different, but I know what to expect for the search queries I issue, and I'd be glad if the search engine helped me.

Equally, certain domains are known to be more rich with information I happen to seek, like reddit.com, so I'd like to give them a boost. Some other people may prefer something else, or not give any boost at all.

So, this is personalization, not anti-spam. If Google kept it, it could even bring important insights into what ads I would skip and what would click :)

Maybe 90% of users would ignore this feature. But the 10% of power users maybe disproportionately important: with more disposable income, more clout on social networks, more decision-making power. I suppose that the shutdown of Google Reader, which affected a relatively small number of users, affected all the wrong people, and destroyed so much goodwill that the losses from it are many orders of magnitude larger than whatever savings from not supporting it any more.

Re:Most promoted and blocked domains among Kagi Search users by jjoonathan on Friday August 04, 2023 @10:45PM (#37008467)
Get back in line, citizen! You will read the blogspam, and you will like it.
Re:Most promoted and blocked domains among Kagi Search users by jsnell on Saturday August 05, 2023 @12:14AM (#37008964)
> That information is technically not spam, but it's on a wrong level, badly presented, etc.

I'd count that kind of low quality site as spam, and the problem is that there's a basically an infinite supply of them. The boost feature is more interesting in that the curation is at least not a never-ending task. New high quality sites that I know about don't pop up all that often!

It's still not an entirely robust feature since you'll need to do a lot of quality work to prevent mediocre results from a boosted site from shadowing better results from unboosted sites, especially for users with a ton of boosts. But that quality work is much easier to justify when the manual curation is one of your core selling points and used by a large proportion of the customers vs. when it's a feature in a dusty context menu that basically none of the userbase interacts with.

> Maybe 90% of users would ignore this feature. But the 10% of power users maybe disproportionately important

I'd be shocked if the number of users for this kind of feature was anywhere near 10% of all search engine users. Something like 0.1% seems much more likely. But again, if those 0.1% really want that feature it's a great fit for a power user search engine.

It still doesn't mean that it's a feature every search engine should obviously have.

Re:Most promoted and blocked domains among Kagi Search users by catach on Saturday August 05, 2023 @01:55AM (#37009374)
> you'll need to do a lot of quality work to prevent mediocre results from a boosted site from shadowing better results from unboosted sites

That strikes me as a non-goal. As the search engine, you can't know what attributes a user is valuing when they boost, and so you can't know when it's appropriate to override that boost. "Better" is subjective, contextual, and comes in thousands of different flavors.

Re:Most promoted and blocked domains among Kagi Search users by viraptor on Saturday August 05, 2023 @03:42AM (#37009890)
> New high quality sites that I know about don't pop up all that often!

But when they do, how are you going to know if all you see is the mediocre spam instead? No, I want to block the domains which are never going to be a good result. This may actually surface things I will want to boost.

Re:Most promoted and blocked domains among Kagi Search users by dcow on Saturday August 05, 2023 @10:59AM (#37012661)
Pintrest is among the top blocked. It clearly doesn't have spam, but it commonly shows up because of it’s vast array of user content. For people not interested in Pinterest content, this is a very useful feature.

NYTimes is another good example, great content for subscribers, essentially useless spam in a search result for non-subscribers. The only person who can configure this is the user.

Re:Most promoted and blocked domains among Kagi Search users by IG_Semmelweiss on Saturday August 05, 2023 @11:32AM (#37013011)
Can you shine light as to why w3schools.com is blocked and lowered so much, while most other sources of CS information are raised ?

Is their information of such low quality ?

Re:Most promoted and blocked domains among Kagi Search users by LordShredda on Saturday August 05, 2023 @12:13PM (#37013460)
They used to have outright incorrect information a long time ago. They fixed the site and are much better, but it's aimed at a non technical audience in the end.
Re:Most promoted and blocked domains among Kagi Search users by dcow on Saturday August 05, 2023 @08:15PM (#37017602)
https://www.w3fools.com/

They’re better now but this is timeless.

Re:Most promoted and blocked domains among Kagi Search users by lelanthran on Saturday August 05, 2023 @03:09AM (#37009721)
> I think you miss he point.

I don't think he did. He did say " it's not at all obvious that it's a good idea for an established search engine targeting the general public"

And looking at the data from the link, other than wikipedia and reddit, all the pinned domains are for developers or technical folk.

So it looks to me that kagi is not popular to the general public. If it was, programming-related sites wouldn't so heavily top the popular list.

Re:Most promoted and blocked domains among Kagi Search users by PhilipRoman on Saturday August 05, 2023 @03:43AM (#37009894)
Is w3schools still that bad? I know that it used to be awful in the past, but IIRC they managed to do a complete 180 in this regard. I'm not into webdev but I occasionally check how to use a particular feature on there and it always delivers a pretty good reference.
Re:Most promoted and blocked domains among Kagi Search users by mattmanser on Saturday August 05, 2023 @04:01AM (#37009995)
It is better than it was, but I'd still much prefer to see the mdn, it's much better.
Re:Most promoted and blocked domains among Kagi Search users by zarzavat on Saturday August 05, 2023 @05:51AM (#37010519)
I can see a certain kind of absolute beginner enjoying w3schools more than MDN, it’s a little less intimidating.

When you’re first learning a subject you often want simple lies more than complicated truths.

Re:Most promoted and blocked domains among Kagi Search users by throwaway2037 on Saturday August 05, 2023 @10:48AM (#37012543)
This is a well written post. I describes me perfectly and my knowledge of HTML/CSS/JS. I usually start with w3schools, then if I need deeper info, I repeat the search with "mdn". That does the trick!
Re:Most promoted and blocked domains among Kagi Search users by lolinder on Saturday August 05, 2023 @11:37AM (#37013068)
And this is exactly why the custom domain block list is so useful. Blocking w3schools entirely would be unhelpful to beginners, but a lot of experts find their content to be less helpful than that on other websites and would rather not see them at all.
Re:Most promoted and blocked domains among Kagi Search users by hobofan on Saturday August 05, 2023 @03:59AM (#37009981)
w3schools garnered a reputation for stating outright wrong facts. I think they rectified that part, but I think the way they break down information is still far inferior to MDN on basically every topic.
Re:Most promoted and blocked domains among Kagi Search users by ajsnigrutin on Saturday August 05, 2023 @04:36AM (#37010145)
> The point is to remove certain well-known sites

Like pinterest.

Goddamn pinterest.

Just the amount of times i've used "-pinterest" in search is staggering.

Re:Most promoted and blocked domains among Kagi Search users by jquery on Saturday August 05, 2023 @09:00AM (#37011595)
Totally get where you're coming from about removing certain domains from Google search. But let's take a step back for a sec and consider what this could look like in a different light. Imagine if Reddit got the axe - a site that, despite its redesign snafus and sometimes annoying mobile login walls, a lot of us here on HN still find pretty useful.

Now, I'm not blind to the fact that Reddit's user demographic has a lot in common with us HN folks, while Pinterest... well, not so much. It leans towards a non-techy crowd, with more women users. But the way I see it, if Google keeps popping Pinterest up in search results, someone out there must be finding it helpful.

Perhaps what this all boils down to is a bit of a demographic reality check, rather than a definitive statement on any one platform. And just to be clear, I'm not standing on a soapbox championing for Pinterest, but I reckon we could probably nudge Google to get a bit smarter with its algorithms.

So, what if instead of giving domains the chop, we pushed for Google to up its game on the personalization front? Like, if I'm consistently booting Pinterest from my searches with "-pinterest", Google could take the hint and drop it down the ranks for me. Wouldn't that make more sense than completely blacklisting sites that some folks might still want to use? In the end, we all win if Google gets better at tuning into our search habits, right?

Re:Most promoted and blocked domains among Kagi Search users by ajsnigrutin on Saturday August 05, 2023 @09:17AM (#37011722)
I'm not saying we need a global chop/removal, I'd be happy if i had personalized filters for me (using my logged-in account + removal settings) to remove pinterest just for me. Same for Quora and ExpertSexChange or whatever that other technical site was.

Same for youtube, a simple blacklist would make my search results much nicer, but youtube seems to push a few large media companies as hard as possible.

Re:Most promoted and blocked domains among Kagi Search users by dcow on Saturday August 05, 2023 @11:01AM (#37012682)
Kagi’s filters are local per-user, not global across users.
Re:Most promoted and blocked domains among Kagi Search users by bambax on Friday August 04, 2023 @11:22PM (#37008679)
From your original comment:

> Third, some people will probably block domains they shouldn't have blocked, and then have a bad user experience in future searches as the sites with genuinely best results is blocked. And then you're only left with only bad options: ignoring the users' stated preferences which they'll hate, or serving bad results that they'll also hate.

That's a real possibility, but it can be addressed by presenting a block that would say, for example "results from blocked domains" or some such.

Re:Most promoted and blocked domains among Kagi Search users by davidmurdoch on Friday August 04, 2023 @08:08PM (#37007501)
They did. And w3schools was in my list back then.
Re:Most promoted and blocked domains among Kagi Search users by scarmig on Friday August 04, 2023 @08:11PM (#37007519)
And can't forget about expertsexchange.
Re:Most promoted and blocked domains among Kagi Search users by delfinom on Friday August 04, 2023 @08:36PM (#37007706)
Even 2 decades later, you can never unsee it
Re:Most promoted and blocked domains among Kagi Search users by p1mrx on Friday August 04, 2023 @10:07PM (#37008267)
It's only obvious when you format it that way.

They primarily used "Experts Exchange" and http://www.experts-exchange.com/

Re:Most promoted and blocked domains among Kagi Search users by mmh0000 on Friday August 04, 2023 @10:57PM (#37008530)
Yeah, now they use that, but back in the good old days of the internet, they did not.
Re:Most promoted and blocked domains among Kagi Search users by scarmig on Friday August 04, 2023 @10:59PM (#37008550)
Nowadays that's the domain, but only after they did a migration from expertsexchange.com awhile back.
Re:Most promoted and blocked domains among Kagi Search users by stock_toaster on Friday August 04, 2023 @10:18PM (#37008331)
and penisland
Re:Most promoted and blocked domains among Kagi Search users by JKCalhoun on Friday August 04, 2023 @10:39PM (#37008443)
therapist.com
Re:Most promoted and blocked domains among Kagi Search users by kortilla on Saturday August 05, 2023 @07:35AM (#37011014)
This one is probably the worst because it can’t be fixed by a hyphen
Re:Most promoted and blocked domains among Kagi Search users by rgoulter on Saturday August 05, 2023 @08:44AM (#37011464)
Artisanal
Re:Most promoted and blocked domains among Kagi Search users by r00fus on Friday August 04, 2023 @08:53PM (#37007812)
Ah, but then they acquired Doubleclick (or was it the other way around?) and a monopoly was formed.
Re:Most promoted and blocked domains among Kagi Search users by captn3m0 on Friday August 04, 2023 @11:04PM (#37008570)
The feature definitely existed after the DC acquisition.
Re:Most promoted and blocked domains among Kagi Search users by r00fus on Saturday August 05, 2023 @12:47PM (#37013884)
It takes a while for mergers to result in solid directional change.
Re:Most promoted and blocked domains among Kagi Search users by Nextgrid on Friday August 04, 2023 @10:58PM (#37008543)
People would use it to block all the spam sites that host copious amounts of (potentially Google's) Ads/Analytics, and since they might actually start finding what they're looking for this will reduce engagement on the search results page and with the sponsored links.

This is bad for Google's bottom-line thus why such a feature was removed and will never be coming back.

Re:Most promoted and blocked domains among Kagi Search users by toyg on Sunday August 06, 2023 @07:05AM (#37020770)
Enshittification classic.
Re:Most promoted and blocked domains among Kagi Search users by codezero on Saturday August 05, 2023 @12:17AM (#37008976)
when google first came out it had nothing to do with that, it was that they offered as strong algorithmic ranking in the feed. Before that the search providers ran in a few ways (by my memory):

1. Sell the first few results but make it look organic (this all happened behind closed doors and I knew a few people who paid for such results)

2. Hierarchical/topic based collections of links (This is what Yahoo was famous for in the 90s if I remember correctly, I'll keep saying that because it was a long time ago!)

The whole "google cares about you" was an outcropping of the organic flocking to google because of their reliable and algorithmic results that just seemed trustworthy, they capitalized on that and it honestly lasted a lot longer than I expected before they really started being evil.

Re:Most promoted and blocked domains among Kagi Search users by tmpX7dMeXU on Saturday August 05, 2023 @12:47AM (#37009106)
Yeah. Engineers hate when something isn’t a technical feat. The best innovations are usually software people working with the right people from other disciplines to make a thought out CRUD app.
Re:Most promoted and blocked domains among Kagi Search users by 7839284023 on Saturday August 05, 2023 @02:26AM (#37009511)
Use this: " uBlacklist is a Google Search filter for Chrome, Firefox and Safari. "

https://iorate.github.io/ublacklist/docs

Re:Most promoted and blocked domains among Kagi Search users by nomat on Saturday August 05, 2023 @03:17AM (#37009770)
it works for duckduckgo as well.
Re:Most promoted and blocked domains among Kagi Search users by alternatex on Saturday August 05, 2023 @05:43AM (#37010479)
Interestingly not supported on Firefox Android. It's the first time I come across an add-on that doesn't work on both.
Re:Most promoted and blocked domains among Kagi Search users by deadbunny on Saturday August 05, 2023 @06:00AM (#37010555)
Firefox on Android only supports a handful of curated add-ons. You can apparently create your own collections or install anything with Firefox Nightly but I've not done this.
Re:Most promoted and blocked domains among Kagi Search users by code-blooded on Saturday August 05, 2023 @07:04AM (#37010866)
You can do that with Firefox Beta too, which likely will give you better experience / stability. It's a shame you have to jump through so many hoops to get it working.
Re:Most promoted and blocked domains among Kagi Search users by sam1r on Saturday August 05, 2023 @03:03AM (#37009693)
Yes, but 99.9 percent of its users do not know these filters/features exist. Still don't.

Google didn't prioritize it's visibility [intentioally] over the past 2 decades as well. Maybe it's time to do so.

I can't imagine how tedious the process may be to make very small changes on the main google home page.

Re:Most promoted and blocked domains among Kagi Search users by andyjohnson0 on Saturday August 05, 2023 @06:40AM (#37010748)
> Yes, but 99.9 percent of its users do not know these filters/features exist. Still don't.

The features you were referring to were removed a few years after they were launched.