News for hackers. Stuff that matters.
Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by ssgodderidge on Monday January 01, 2024 @10:44AM (#38832585)
Curious, how would caching the pages and serving over NGINX help with SEO? Is there any benefits over serving a static site?
Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by jotto on Monday January 01, 2024 @10:56AM (#38832707)
A "static site" implies HTML rather than a JavaScript app.

With respect to JavaScript apps (React, Angular, etc.):

It's not clear these days because the major search engines don't explicitly clarify whether they parse JavaScript apps (or if they only parse high-ranking JS apps/sites. But 10 years ago it was a must-have to be indexed.

One theory on pre-rendering is it reduces cost for the crawlers since they don't need to spend 1-3s of CPU time pre-rendering your site. And by reducing costs, it may increase chances of being indexed or higher rank.

My hunch is that long-term, pre-rendering is not necessary for getting indexed. But it is typically still necessary for URL unfurls (link previews) for various social media and chat apps.

disclosure: I operate https://headless-render-api.com

Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by nirvanist on Monday January 01, 2024 @11:27AM (#38832983)
absolutly , bots still need to access content as faster as possible
Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by nodja on Monday January 01, 2024 @10:55AM (#38832687)
If your web app serves dynamic routes (i.e. client only) this helps with SEO because those routes are now directly visible through most crawlers.
Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by nirvanist on Monday January 01, 2024 @11:29AM (#38833003)
routes yes but maybe not content, most of the time google search console will show that you have no content , also google ads boot need to access to content this useful to get your adsense account quickly validated
Re:Show HN: Page Replica – Tool for Web Scraping, Prerenderi... by nirvanist on Wednesday January 03, 2024 @09:37AM (#38854532)
Yes, Google can render your content handled by JavaScript, but Googlebot allows only a few milliseconds for rendering. If your page isn't rendered within that time frame, it may be penalized.

For this reason, many news and broadcasting media outlets still use prerendering services. I speak from experience as I worked in a large Canadian media company.

Another important factor to consider is that the SEO world isn't limited to Google. Various bots, including those from other search engines and platforms like Facebook, require correctly rendered pages for optimal sharing and visibility.

Lastly, the choice between client-side rendering (CSR) and server-side rendering (SSR) depends on your specific needs. Google Search Console provides valuable metrics and information about your app, so it might be worth considering SSR if that better aligns with your requirements.