News for hackers. Stuff that matters.

A comment on Show HN: flyscrape – An expressive and elegant web scraper.

Re:Show HN: flyscrape – An expressive and elegant web scraper by peyloride on Monday October 16, 2023 @06:43AM (#37897928)
Hey, quick question: Is there a way to handle async behavior? Like in puppeteer we had something like waitFor helper to wait while loading the page. I couldn't find a similar thing in your readme. Or is this framework for only static pages?
[ Parent | on HN ]
Re:Show HN: flyscrape – An expressive and elegant web scraper by philippta on Monday October 16, 2023 @12:59PM (#37902794)
At this time it works with server-side rendered / static pages only and does not execute any JavaScript of the website.

The data extraction function of your script also runs aside the crawler, not inside the page.

[ Parent | on HN ]