News for hackers. Stuff that matters.
Re:Google search takes 7 seconds on certain queries by Hedja on Sunday August 04, 2019 @08:36AM (#20606114)
It's worth mentioning that indiehackers.com is a JavaScript-only website and doesn't work with JS turned off. Google's spider can execute JS, while others do not. This is why indiehackers.com doesn't show up, not because of the search engines themselves.

I have a similar issue with a side project of mine. JS-only websites solve this with server-side rendering or static generation.

Re:Google search takes 7 seconds on certain queries by taf2 on Sunday August 04, 2019 @09:21AM (#20606366)
When I think of a search engine I think of it as two things.

1. A web crawler 2. A search index

Or as a good boss used to say garbage in garbage out... the quality of the engine is as much a function of the index’s ability to rank as the quality of the input from the crawler... the fact that none of the other engines crawl with JS enabled is a huge competitive advantage for google

Re:Google search takes 7 seconds on certain queries by missblit on Sunday August 04, 2019 @10:16AM (#20606649)
Bing also renders JavaScript [1][2]. Though there's not a lot of information out there about the details like what browser engine they use.

[1] https://blogs.bing.com/webmaster/october-2018/bingbot-Series... [2] https://searchengineland.com/bing-crawling-indexing-and-rend...

Re:Google search takes 7 seconds on certain queries by hobs on Sunday August 04, 2019 @10:08AM (#20606601)
Well sure, but you could also just make a website with a modicum of thought and then all search engines will have no problem.

Anything that loads no resources unless I have javascript enabled (and is a general purpose website, not some 3d toy or whatever) is trash.

Re:Google search takes 7 seconds on certain queries by damnyou on Sunday August 04, 2019 @12:48PM (#20607628)
I mean, clearly this site has value to the OP so it is obviously not trash.

What value a service provides is what matters in the end. Implementation details are secondary.

Re:Google search takes 7 seconds on certain queries by yjftsjthsd-h on Sunday August 04, 2019 @12:58PM (#20607699)
Pulling gems out of trash does not make it not trash.
Re:Google search takes 7 seconds on certain queries by hedora on Sunday August 04, 2019 @11:28AM (#20607078)
> Google's spider can execute JS, while others do not.

I’m honestly having a hard time seeing how this isn’t a bug in Google search.

Re:Google search takes 7 seconds on certain queries by jefftk on Sunday August 04, 2019 @12:16PM (#20607388)
1 point by jefftk 0 minutes ago | edit | delete [-]

A search engine is trying to predict which pages will be helpful to you in response to your query. This means it should take "how does the page look to users" as input, which today means executing JavaScript.

(Disclosure: I work for Google, not on search)

Re:Google search takes 7 seconds on certain queries by dredmorbius on Monday August 05, 2019 @11:14AM (#20614810)
Contrapoint: if you keep enabling hostile behaviour, you'll get more of it.

Non-JS web indexing as a default would vastly dimnish the utility of JS-only pages.

Re:Google search takes 7 seconds on certain queries by damnyou on Sunday August 04, 2019 @12:50PM (#20607641)
It is a feature, not a bug, because it provides value to customers.

I separately think sites that only work with JS enabled are not great, but that's a problem with the system and not with individual actors.

Re:Google search takes 7 seconds on certain queries by toast0 on Monday August 05, 2019 @02:11AM (#20611673)
On the other hand, in the same way that Google is (claiming to be) trying to make the web fast with AMP, they could make the web fast by refusing to index pages that don't provide a non-javascript experience. (Yes, you can make a slow page without Javascript, but it sure is easier with it)
Re:Google search takes 7 seconds on certain queries by phkahler on Sunday August 04, 2019 @10:59AM (#20606898)
>> Google's spider can execute JS, while others do not.

So Google is enabling the excess of JS we see today? Sites wouldn't do that if it couldn't be indexed by Google.

Re:Google search takes 7 seconds on certain queries by eropple on Sunday August 04, 2019 @11:06AM (#20606956)
Yes, they would. They'd just use NextJS or similar to push down a static skeleton that minimally covers the crawler. (My current company has to provide data to the Facebook crawler and that's what we do.)

Nothing prevents a site from doing that and just loading JS afterwards. Or from still being basically read-only without JS. Which might be an improvement...except within epsilon of zero people care in the first place and Google is building software for a rather larger proportion of the market than that, so it's an improvement for what's barely an audience.

Nobody is really "enabling" it except for a browser. And that's not changing. The shirt-rending is becoming tiresome.

Re:Google search takes 7 seconds on certain queries by stonogo on Sunday August 04, 2019 @05:01PM (#20609202)
I'd be curious to know why your company specifically targets large-market crawlers like that, instead of just making things crawlable. It feels like leaving money on the table when you overfit your stack to one market.

It's a shame you find it "tiresome" when people insist on retaining their own opinions, but your exhaustion is not particularly relevant.

Re:Google search takes 7 seconds on certain queries by eropple on Sunday August 04, 2019 @06:47PM (#20609735)
We need to build shareable landing pages. We share via Instagram and Facebook (for now). We use NextJS because they do provide static rendering that covers what we care about and are likely to care about anytime soon.

And you can have whatever opinion you want; nobody’s saying otherwise. But the constant whining about nothing — and it is nothing — is exhausting.

Re:Google search takes 7 seconds on certain queries by beatgammit on Sunday August 04, 2019 @11:07AM (#20606962)
Yet another reason to support other search engines. I haven't used Google in years, and I haven't had any real problems.