News for hackers. Stuff that matters.
Re:Experimental library for scraping websites using OpenAI's... by cphoover on Saturday March 25, 2023 @11:23PM (#35310489)
You could probably use gpt to build a deterministic parser based off the markup of a page though... Like ask it to "create the script/selectors needed to scrape X page"

Then you just run that script whenever you want to get data.

Re:Experimental library for scraping websites using OpenAI's... by sagarpatil on Sunday March 26, 2023 @12:30AM (#35310949)
Yes. This is the most cost effective way and what I’m been doing personally.