News for hackers. Stuff that matters.
Re:Meta's Muse is fantastic for web scraping by kurisufag on Friday October 02, 2026 @01:52AM (#49930201)
the 4get dev did the same thing a little while ago for his metasearch engine: https://git.lolcat.ca/lolcat/4play
Re:Meta's Muse is fantastic for web scraping by dvt on Friday October 02, 2026 @02:00AM (#49930248)
Yep, it's super similar to this! I think his is a bit overengineered, but tbh I haven't built Firefox plugins in forever so that might be the way you have to do stuff on FF. All you need is the websocket plugin to have "full access" to all visited webpages, and then your driver just hooks into the DOM like normal (with the extra ws layer—and even the websocket layer can be simplified away I think).