Re:Web scraping via JavaScript runtime heap snapshots
by dymk on Friday April 29, 2022 @02:29PM
(#31208974)
Would this method work if the website obfuscated its HTML as per the usual techniques, but also rendered everything server side?
[ Parent
| on HN ]
Re:Web scraping via JavaScript runtime heap snapshots
by adriancooney on Friday April 29, 2022 @03:10PM
(#31209448)
If it’s rendered server-side - no. The data likely won’t be loaded into the JS heap (the DOM isn’t included in the heap snapshots) when you visit the page. You might be in luck if the website executes JavaScript to augment the server-side rendered page however. If it does, your data may be loaded into memory in a way you can extract it.