News for hackers. Stuff that matters.

A comment on Show HN: LLM Scraper – turn any webpage into structured data.

Re:Show HN: LLM Scraper – turn any webpage into structured data by andrew_zhong on Sunday April 21, 2024 @02:29PM (#40108005)
Great work! I’ve worked on the same problem and used LLM to extract feed into structured data (in my case have to use a more affordable model like GPT3.5 for a Saas app, looking at llama3 now)

Have you thought about automatically extract schema?

[ Parent | on HN ]
Re:Show HN: LLM Scraper – turn any webpage into structured data by ushakov on Monday April 22, 2024 @07:10AM (#40113188)
Awesome! The problem with extracting schema automatically is that you won't know what comes out of it upfront and it could be changing on every run. What I'm trying to do is enable scraping webpages in a structured (and type-safe!) manner.
[ Parent | on HN ]