News for hackers. Stuff that matters.
Re:Web scraping with GPT-4o: powerful but expensive by purple-leafy on Monday September 02, 2024 @09:55PM (#41430481)
I wrote one for a project that captures a portion of the DOM and sends it to an LLM.

It’s strips all JS/event handlers, most attributes and most CSS, and only keeps important text nodes

I needed this because I was using LLM to reimplement portions of a page using just tailwind, so needed to minimise input tokens

There are no comments on this comment yet.