News for hackers. Stuff that matters.

A comment on Show HN: PyDoll – Async Python scraping engine with native CAPTCHA bypass. Parent comment

Re:Show HN: PyDoll – Async Python scraping engine with nativ... by thalissonvs on Tuesday June 10, 2025 @11:16AM (#44237875)
I don't think it's similar. The library has many other features that Selenium doesn't have. It has few dependencies, which makes installation faster, allows scraping multiple tabs simultaneously because it’s async, and has a much simpler syntax and element searching, without all the verbosity of Selenium. Even for cases that don’t involve captchas, I still believe it’s definitely worth using.
[ Parent | on HN ]
Re:Show HN: PyDoll – Async Python scraping engine with nativ... by hk1337 on Tuesday June 10, 2025 @12:22PM (#44238636)
Similar to MechanicalSoup is what I meant, which uses BeautifulSoup as well.

> without all the verbosity of Selenium

It's definitely verbose but from my experience a lot of the verbosity is developers always looking for elements from the root every time instead of looking for an element, selenium returns that WebElement, and searching within that element.

[ Parent | on HN ]