News for hackers. Stuff that matters.
Re:Show HN: Llms.txt Generator – Turn websites into a text f... by IndieCoder on Friday November 22, 2024 @11:16AM (#42215031)
I like the idea but Firecrawl and GPT4o is quite heavy. I use https://github.com/unclecode/crawl4ai in some projects, it works very well without these dependencies and is modular so you can use LLMs but do not have to :)

There are no comments on this comment yet.