Re:Meta's Muse is fantastic for web scraping
by dvt on Friday October 02, 2026 @02:14AM
(#49930337)
Are you saying they're blocking the `User-Agent`? Because that's trivial to bypass. I'm not exactly sure what you mean by "Chromium" because that's a whole class of browsers (Edge, Brave, Chrome, etc. are all forked "Chromium" browsers).
[ Parent
| on HN ]
Re:Meta's Muse is fantastic for web scraping
by kees99 on Friday October 02, 2026 @02:19AM
(#49930368)
Aliexpress specifically uses a javascript blob to do detection, and quite a sophisticated one. There was a recent story about that blob messing with bluetooth headphones.
> not sure what you mean by "Chromium"
I meant that literally. This thing: https://www.chromium.org/getting-involved/download-chromium/...
Here's my agentic Chromium browser browsing Aliexpress[1]. Usually I'd run it in headless mode, but wanted to test and make sure I'm getting the website proper.
It searched for "Aliexpress" on Google and clicked the link, hence the Google UTM params.