Re:Experimental library for scraping websites using OpenAI's...
by tomberin on Saturday March 25, 2023 @04:23PM
(#35306910)
:) Agree, but the scraping arms race is way beyond that, if someone doesn't want their page scraped this isn't a threat to them.
[ Parent
| on HN ]
Re:Experimental library for scraping websites using OpenAI's...
by sebzim4500 on Saturday March 25, 2023 @04:43PM
(#35307115)
Has it? Can you give me an example of a site that is hard to scrape by a motivated attacker?
I'm curious, because I've seen stuff like the above but of course it only fools a few off the shelf tools, it does nothing if the attacker is willing to write a few lines of node.js
Re:Experimental library for scraping websites using OpenAI's...
by tappio on Saturday March 25, 2023 @04:47PM
(#35307165)
Try Facebook, I've spent some time trying to make it work but figured out I can do what I need by using Bing API instead and get structured data...
Re:Experimental library for scraping websites using OpenAI's...
by asddubs on Saturday March 25, 2023 @05:00PM
(#35307300)
i guess the lazy way to prevent this in a foolproof way is to add an ocr somewhere in the pipeline, and use actual images generated from websites. although maybe then you'll get #010101 text on a #000000 background