Pretty much every company in an established space that Google has entered, is losing traffic and thus revenue due to this practice: Yelp, any flight/hotel/tourism based company, video hosting sites, weather data sites, the list goes on and on.
Google is staking it's claim to content and data. It's legal, and provides short term benefits to users. But in the long term decreases competition and entrenches Google further, which is bad for users.
The search experience is genuinely bad now. Nothing organic shows up anymore. It's either heavily optimized cookie cutter content, or some big brand name cutting through the clutter on the strength of its domain authority alone.
I've taken to appending "reddit" to my queries just to know what actual people think about an issue
I can't echo this loud enough - I made great profit by out-ranking heavily established retail outlets for years with super spammy and terrible sites purely with correct on-page SEO and garbage 'keyword optimized' content.
I, as well, now have to append things to searches in order to get real answers. (Or start with a twitter search, depending on the topic)
Woah, thought I might be one of the few that did this. You articulated my reasoning behind it perfectly.
Five to ten years ago, the Wikipedia article for the molecule was always in the top three.
I do the same thing. I want real people's experiences and honest opinions.
Example: in the midst of my house renovation my Hisense TV remote has gone walkabout. After several months of having no idea where it is (I figured it would just turn up - I mean, it has to be in here somewhere, right?), I decided to order a replacement. Amazon is full of knock-offs, but turns out Hisense sell remotes directly.
So I type "Hisense" into DDG and it's the top result, but it's the Chinese site, and I can't figure out how to get to the UK site. The UK site isn't even on the first page of results either. I rerun the search with Google and the Hisense UK site is the top result, and I'm able to quickly find replacement remotes.
That's a shame because, as bad as Google has become, it's still better than other options. As an example of how bad Google really is, last night I tried searching for info on how to mount twin slot shelving uprights on an uneven wall - specifically a wall where the otherwise smooth plaster is less than perfectly vertical (there's an undulation reflecting imperfections in the underlying brickwork). The result? Just pages and pages of SEO spam/"content marketing" on the very basics of fitting twin slot shelving, all of which assumes that your walls are perfectly vertical across their entire surface, and none of which has any kind of troubleshooting hints and tips. I probably tried 10 different search query variants before giving up in disgust.
Google is outright terrible, and its much touted AI is laughably poor[1]. But DuckDuckGo is worse. I'm simply choosing the least bad option, which unfortunately isn't saying much.
[1] Or enragingly poor depending on your mood and perspective.
I also append forum (or site:forumname.com) if I'm looking for more in-depth review than reddit gives.
or appending "site:news.ycombinator.com"
Stratechery had a good analysis of the situation not long ago. https://stratechery.com/2019/the-google-squeeze/
It also provides the advantage of being able to curate the sources to provide higher quality for niche search topics. [0]
I have been working on a search engine that works this exact way. The challenge is identifying and integrating the data sources for all the potential search intents.
A better approach would be to still extract data from websites like Google does (this works), but automatically attribute share (50%?) of search engine's profits proportional to the website's share of appearances in these results. This money would await the webmaster when they eventually verify domain ownership. This is fair for everyone and creates positive feedback loops.
The point of breaking up monopolies is not to make a moral statement about the company, but because we've found that monopolies are generally bad for society.
Honestly at this point it doesn't even matter how good Bing is - we've been unconsciously trained to work with Google's algorithm in particular and they just have a de facto monopoly on the mental process a person goes through to formulate a search. Everyone's workflow everywhere will be worse and take more time if they voluntarily stop using Google, that's not what I consider a fair competitive landscape.
Seems like a recipe to have a worse product.
The argument that they're so good at what they do, they've created a monopoly, I think is very fragile.
Wikipedia is CC BY-SA licensed.
On the other hand, arguably incorporation of the snippet (as the incorporation of context for other pages) is permitted in some way other than licensing (fair use?), in which case the terms of the license wouldn't apply.
I would have to think harder to have a well-formed personal opinion.
Just depends if the snippit is over the fair-use threshold I guess.
If the share-alike license allows segregating content into frames within one page then it is ok too.
Fair Use is not a concept in most jurisdictions btw.
I’m pretty sympathetic to the plights of Weather.com, Genius.com, Zagats (oops, Google bought them and then resold them), Yelp, and whomever else Google is appropriating non-public domain and non-Creative Commons content from. But that’s a story that’s already been told, so the site decided to find a heart-string tugging yet intellectually-dishonest angle.
In long term, there won't be free content for Google to scrape and display in search results knowledge graphs as ad supported / free content businesses shut down. Of course, google can create its own content and does so to feed the knowledge graphs, but it's way more expensive to do so. And the math might not be worth it for google manufacture from scratch all this content.
So then folks won't use google, but will they go direct to Yelp 2030? Will there be Yelp 2030?
Our local govt has traffic sensors for the highways - huge bucks to install / maintain etc. I can get more granular traffic that is more current from google for free. If you are going to compete with google in a data management / collection business, you are going to be playing with firm with pretty deep ability to ingest and process data.
You had me feeling bad until I came across this.
You either want this information in the search engine or you don't.
Don't like one of the indexers? Tell it not to index you.
Edit: thanks. I see Google makes it really hard to opt out of featured snippet while retaining regular search result snippet support.
It's not as though web design like knowledge of meta tags and robots.txt is the sum total of everything to know about computers. Maybe they've built their own 8-bitter, or are a motherboard PCB designer? I'd argue that'd put them firmly in the 'computer guru' class. But we don't know, so it's probably better to say nothing at all.
I messaged the HN mods many years ago (either pg or dang, can't remember) when things had changed and I had decided to just use my real name online but was told that it would not be possible to change it for posterity purposes.
Google takes the excerpt which is relevant to your query, displays it to you, along with a link to the resource.
Are we upset that the excerpt is too good? That the link isn't prominent enough? Something else?
Sure, it's convenient but it's also a bit frightening for one company to have that much power and I think that's what people are a little hesitant about.
This would be comparable to write a scientific paper and only reading the headlines of each source you're using
Even if they weren't, the ~$154m they have free for investments, would only gross ~$1.2m in 10 year Treasuries, or at most $5-6m in relatively higher-yield investment grade corporate bonds.
Looking at their expenses in 2019, even if you cut donation processing expenses to $0, cut awards and grants to $0, cut travel and conferences to $0, strip out depreciation and amortization, and cut their $46m payroll in half to $23m (which at a fully loaded cost of $200k/employee, is only 115 employees for one of the most widely used websites in the world), you would still be looking at annual operating expenses of ~$45m.
There is absolutely no way that Wikipedia/the Wikimedia Foundation could survive without any donations - they have $154m between cash and investments, and would need to support $45m in annual operating expenses, even with these fantastically high budget cuts. That means they'd need to net, after taxes, almost 30% return on their assets every year, just to tread water, and only after cutting their budget essentially in half.
Wikipedia has 51.1 million articles in 291 languages, is something like the 5th most visited website in the US, 10th in the world, and they manage to do this without running any ads. Can't we be thankful for the incredible human library of knowledge they've built, and chip in a few dollars if we are able, instead of complaining and telling them they should not accept donations?
[0] https://upload.wikimedia.org/wikipedia/foundation/3/31/Wikim...
Hosting costs for Wikipedia are "only" $2.3m, but imagine the legal expense they have, fighting likely millions of takedown requests, malicious lawsuits, complying with local laws and regulations in China, Russia, etc, paying a team of top software engineers to handle running a top-visited site (that by the way, has almost no downtime), a security threat model that includes nation-state actors, and the responsibility that if they fail (by being hacked, or sued, or DDOSd, or whatever), they will have let humanity's library be harmed.
I just can't understand how any casual bystander can complain about Wikipedia or their funding/organizational model. If you don't like it, just don't donate money.
Wikimedia Foundation is not fighting any takedown requests. Wikimedia Foundation had exactly ten DMCA requests last year[1]. That’s a bit short of “millions” you believe it does. It does not comply with any local regulations in China or Russia, or elsewhere, because it does not operate in China or Russia (or really anywhere outside US, except caching servers in NL and Singapore). Wikipedia is actually completely blocked in China, and the fact that you did not know that signals your utter unfamiliarity with the realities of Wikipedia and Wikimedia Foundation.
> paying a team of top software engineers to handle running a top-visited site (that by the way, has almost no downtime),
It was already a top visited site when its development team consisted of a single person, Brion Vibber. There have been very little significant development since then, and if there had been zero development since then, you’d probably not even notice.
Now, to be sure, at this scale, it needs some full time round the clock reliability engineers, but you can easily see that their headcount keeps growing, but their site and infrastructure is mostly unchanged.
[1] - https://foundation.wikimedia.org/wiki/Category:DMCA_2019
The second member of the development team was hired in 2006 [0].
In these ~14 years, quite a few things happened.
Three projects joined the Wikimedia galaxy: Wikiversity in 2006, Wikivoyage adopted in 2012, and frickin’ Wikidata [1] in 2012 − which has deeply reshaped many aspects of the other projects, particularly Wikipedias and Commons.
On the multimedia side of things, we got InstantCommons in 2008 [3], thumbnailing infrastructure changes in 2013, various file format support (TIFF in 2010, FLAC and WAV in 2013, WebM, 3D formats in 2018 [4]) new upload wizard in 2011 [5]. The Graph extension [6] and Wikimedia Maps [7] in 2015. Structured Data on Commons in 2019 [8]. New default skin (Vector) in 2010 [9]. Unified login in 2008 [10]. 2013 brought OAuth [11], Echo notifications [12], Lua scripting [13], VisualEditor [14]. iOS and Android apps [15]. The Wikimedia Cloud Services starting 2012 [2].
(And in terms of size: article count went from ~5M to ~50M [16] ; Commons went from 1M files to 50M files [17])
And that’s just what I’m putting together in a few minutes (Besides my own memory, I’m indebted to [18], a curated timeline up until 2013).
Of course, these may or may not justify the staff size in your book ; but I’d say discounting all of that (and the rest) as “very little significant development” is a bit pushing it. :-)
(And fairly sure that “you’d probably notice” if Wikipedia was still using good’old Monobook skin ;-þ).
[0] https://foundation.wikimedia.org/wiki/Resolution:Additional_... [1] https://www.wikidata.org/ [2] https://wikitech.wikimedia.org/ [3] https://www.mediawiki.org/wiki/InstantCommons [4] https://wikimediafoundation.org/news/2018/02/20/three-dimens... [5] https://commons.wikimedia.org/wiki/Commons:Upload_Wizard [6] https://www.mediawiki.org/wiki/Extension:Graph [7] https://www.mediawiki.org/wiki/Maps [8] https://commons.wikimedia.org/wiki/Commons:Structured_data [9] https://meta.wikimedia.org/wiki/Vector [10] https://meta.wikimedia.org/wiki/Help:Unified_login [11] https://www.mediawiki.org/wiki/Help:OAuth [12] https://meta.wikimedia.org/wiki/Echo_(Notifications) [13] https://meta.wikimedia.org/wiki/Lua [14] https://www.mediawiki.org/wiki/VisualEditor [15] https://www.mediawiki.org/wiki/Wikimedia_Apps [16] https://meta.wikimedia.org/wiki/List_of_Wikipedias/Table [17] https://commons.wikimedia.org/wiki/Commons:Milestones [18] https://raw.githubusercontent.com/gpaumier/wikipedia-infogra...
But the donations don't go to the people who wrote those articles!
1. https://news.ycombinator.com/item?id=21699011
2. https://upload.wikimedia.org/wikipedia/foundation/3/31/Wikim...
"Volunteers also contribute in several ways to the Foundation’s wiki software: volunteer software developers add new functionality to the code base, and volunteer language specialists add to the code base by translating the wiki interface into different languages. During the year ended June30, 2019, there were 48,361 commits merged, through the efforts of approximately 447 authors/contributors, of which 9,158 commits were through the efforts of approximately 258 volunteers."
If I was one of those volunteers I'd stop.
I almost always want more information, and Google tries to make the Wikipedia link as unintuitive as possible in order to keep the user on Google property.
What's more, showing the info box means that the real article link is removed from the results list.
Edit: to clarify, I do find the blue Wikipedia link decidedly small and I often have to actively look for it instead of it being an intuitive click and clear on first sight, especially on mobile.
WRT to the results, they do indeed seem to appear now, but often not in the first or second position. (I do remember that not being the case previously, but I admittedly might be mistaken)
Huh?
If I search for "who founded the new york times", then immediately below the three-line snippet answer, is a big (not small) blue link to "The New York Times - Wikipedia". In fact, it's literally the easiest, most prominent thing on the page for me to click on. Google is helping to guide me on to visit Wikipedia for more info.
I think you're confusing the short excerpts (with have a clear, obvious Wikipedia link) with Google's Knowledge Graph results, which is a different thing and is based on many different sources.
__________________________
|who founded the new york times|
__________________________
> Search Results
> The New York Times/Founder
> Henry Jarvis Raymond [link to google query |Henry Jarvis Raymond|]
> The New York Times was founded as the New-York Daily Times on September 18, 1851. Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones, the Times was initially published by Raymond, Jones & Company.
> The New York Times - Wikipedia [https://en.wikipedia.org/wiki/The_New_York_Times]
> People also searched for...
___________________________
|"who founded the new york times"|
___________________________
> Henry Jarvis Raymond [link to google query |Henry Jarvis Raymond|]
> People also searched for...
Quotes look for exact results on Google.
I have exactly the same problem, so I hate those Wikipedia boxes. Half of the time I go to a Wiki page for some term then switch to another language (either because I searched an unknown word or because I’m searching for a translation) so the box don’t solve my need. The other half I want more info than what is displayed anyway. And I also find super confusing the position of the link, I have to search for it each and every time.
This is one of the things I love about google as a user. Googling "what is my ip" or "how many inches in a meter" used to require you to visit some random website filled to the brim with ads.
This was the social contract of the web. You give google free content , they give you back money through adsense. Google broke it, and went overly greedy.
If enough websites band together (incl. wikipedia), they could boycott google and force it to pay them per search click or sth. It's only fair . Google is exploiting a system in their own advantage and to the detriment of others. This is no longer win-win.
alias my-ip='dig +short myip.opendns.com @resolver1.opendns.com' $ curl icanhazip.comYou let yourself see ads on the web?
Since you seem to be someone who doesn't see ads on the web, I am curious to know how you pay for the content you consume? I have come across very few non-ads options which work well. For me, subscription fatigue sets in across various video-on-demand sites and various high-quality newspapers. But for a lot of my family / friends across the globe, subscription charges are high enough that they would rather see ads.
That being said, I live with the fact that certain content creators get nothing from me, I don't feel great about it but I would never consume their content if I had to go through ads, either.
Google is a search monopoly. Republishing search results to keep users on Google (rather than the publisher) is literally stealing content and the pageviews the content generated.
As a user, blocking programmatic ads (such as those served by ad marketplaces) is the only way to browse the web safely.
Websites are free to use affiliate links, subscriptions, donations, non-marketplace ads, or any other safe monetization strategy. I will not apologize for blocking the unsafe monetization strategies.
<a href="..."><img src="..."/></a>
Anything which uses javascript to display ads is by definition malware, and should be treated accordingly.What does worry me is that less page views may mean less engagement in the form of checking sources, flagging problems, and making edits.
But the number of new registered users and the number of user edits are both decreasing: https://stats.wikimedia.org/#/all-projects
At some point in an encyclopedia's lifetime, it's "complete enough" that you'll see an excess of authors. "Compiling the world's information" and, past that, "compiling current events as they happen" (with a side of "occasionally improving/updating old articles") need very different numbers of authors.
No.
tl;dr
The monetary cost does not really matter
1. It does contribute money, which Wikimedia does not need.
This is based off the fact that I frequently see:
- "why does X not have a Wikipedia article?"
- "this Wikipedia article is so poorly written"
And very rarely actually see someone edit it. On occasion thousands of people have agreed and hundreds of people have written comments agreeing and only two people edited.
So maybe it does some damage at the margin but overall probably doesn't hurt that much.
Up until now, an edit was one click away. Now, it's not only one more click away but wikipedia has no way to communicate that editing the result is possible at all.
And it doesn't change the fact that if you have open content then you have open content.
If you compare Wikimedias spending 5 years ago to what it is now, it has ballooned in such an excessive way if you put it in context. Wikipedia isn't providing double the value of what it was 5 years ago.
Surely it's "worth it" if you want the site to be usable by novice users. This is about optimizing for reach and intellectual diversity, not just "people who are currently adding value".
> Wikipedia isn't providing double the value of what it was 5 years ago.
Wikimedia supports other projects besides Wikipedia itself, and the value it provides has not just doubled but plausibly grown by an order of magnitude compared to its early days. Wikimedia Commons and Wikidata are hugely beneficial to the Internet community, and Wikivoyage is not far behind.
Maybe this wouldn't be the case if pages were less complicated to edit?
Except for the very frequent times when Google’s summarization engine conveys the opposite point than the text was making.
I’ve had lots of cases where google reassures me that something is possible (like an iOS feature) because it takes a Yes from paragraph 2 and then procedure from paragraph 10. Click the text and it starts with “You can’t do this but there is this other thing you can do”
Both google’s fault and the seospam answer stuffing fault where they put multiple answers on 1 page.
Very frustrating
According to Google that seemed possible.
While I don't use Google much more (except the last few days to figure out if the improved quality I've seen and heard about is true) I have enough experience from the last decade to not immediately believe them.
That said, their attempts at artificial intelligence can be funny sometimes: https://erik.itland.no/more-fun-with-google-mixing-images-fr...
So much for the filter bubble were you only get interesting and relevant but not thought provoking results ;-)
In reality, Roku uses a similar and half-compatible implementation of the Chromecast standard, but it isn't supported in all the same places you can Chromecast, and you'll frequently experience hiccups like the Roku only streaming in SD or 720p instead of 1080p or 4k.
This is partially the fault of the site sharing this information, as they're not presenting this in the most clear way either. However, when Google chooses to try to automatically answer my question, they become responsible for that answer, and when that answer is misleading, it annoys me.
e.g. 1: You are a restaurant or retailer and your potential customers search Google for your hours of operation or phone number. Google shows them the answer so they never come to your site. So they don't see that you have a free delivery offer during the Covid crisis. And you can't market to them via any campaign that retargets visitors to your site.
e.g. 2: You are a publisher that makes money from ads, like say CelebrityNetWorth [1]. Google steals your content and you never get the traffic you'd like to monetize. This is HN so there will be scorn for the ad-fueled business model. But they serve a need. It's one thing for the market to punish ad-monetized sites, it's quite another for Google to steal from them.
e.g. 3: You are Wikipedia. While your content is free, you rely on community contributions to grow. If someone never visits your site, they don't learn about your mission, don't learn that they can contribute. Your corpus stagnates.
The only reason Google gets away with this is because they are stealing pennies from millions of people rather than millions from a single entity. Indie content creators do not have the resources to fight Google on this, because G offers them an all-or-nothing option[2]: you can either be in Google search results or not. And no one can afford not to be.
Google has been so emboldened that they now change the content and user experience _on the website_.[3] Consumers click through to your site and Google will scroll them to a specific section, and highlight that in yellow. Not only does Google control who gets to your site via the search monopoly, but they steal your content, and control how people experience _your_ site.
[1] https://theoutline.com/post/1399/how-google-ate-celebritynet... [2] https://support.google.com/webmasters/answer/6229325?hl=en [3] https://www.theverge.com/2020/6/4/21280115/google-search-eng...
What Google is doing is terrible, especially for smaller sites. Those sites depend on traffic to survive.
AMP makes things even worse, because now the visitors never actually go to the website's own independent servers, even if "the content" loads, and Google dictates how the sites have to be built. Web publishers are in the process of losing control of their websites and independence.
it would be nice if this was a two-party agreement. Google is forcible changing or dictating any potential business model changes Wikipedia might want to make.
this is bad
It was actually kind of cool
You're either free for all, or not.
There isn't a correct query result. Any addition necessitates removal of something else.
> ...Google was able to steal over 550 million clicks from Wikipedia in six months...
"Cost"? "Steal"?!
This would make sense if Wikipedia were ad-supported. But Google saves Wikipedia money by requiring less servers to support traffic. And Wikipedia is open content, you literally can't steal from it -- being open content was part of its original mission statement!
I personally love it when my search results just give me the answer I'm looking for, so I don't have to click through to Wikipedia (or any site) and wade through a page to try to find it, and maybe it's there or maybe it's not.
The idea that Wikipedia's success ought to be measured in pageviews is deeply misguided. The more its content spreads and is reused across the world, online and offline, the better it is for humanity.
And to be clear, this certainly isn't any kind of "embrace, extend, extinguish" strategy on Google's part. Wikipedia isn't declining or going away. Every time you need to read an actual whole article, you still go there. This is solely about convenience in getting quick facts.
This is good -- not bad, folks.