Re:New Elixir 1.12 – The developer’s point of view
by vereis on Wednesday June 23, 2021 @03:43PM
(#27609118)
Might fall into the same category as Hound but Wallaby exists and works.
Otherwise have you heard of Crawley?
Re:New Elixir 1.12 – The developer’s point of view
by prophesi on Friday June 25, 2021 @10:18AM
(#27631058)
I heard of Crawley and thought it only did HTTP-based crawling, but now I see it has a browser rendering option via Splash[0] that looks like it'd fit the bill. Thanks!
(Also had issues configuring Wallaby to be used outside of testing)
What do they use for headless browser scraping? I tried Hound a few months ago, but it seems too geared towards testing to be used more generically. We ended up just using Oclif and Puppeteer for scraping via NodeJS.