It’s literally just headless evergreen chromium handling the rendering these days and has been for a while. It handles JS fine on the condition that you as a developer continue to think about accessibility.
It requires tremendous resources compared to html parser. It's possible, but very costly if you want to crawl the entire Internet.
Re:The balance has shifted away from SPAs
by Mordisquitos on Saturday May 21, 2022 @04:56PM
(#31461713)
Yes, sure. If you don't want Google to index your online service, one way to do it is to design the whole thing as an SPA, with all the added complexity and reinvention of the wheel that it involves.
The other way is to add a few lines to your `robots.txt`.
I'm aware that Google can run JS, but its support is limited compared to server rendering and there are other crawlers behind Google which probably will never be as sophisticated.