catskindleyou
Re:My experience trying to scrape Google Maps with no code
on Thursday December 26, 2024 @12:10PM (#42516333)
The spider-rs GitHub project has concurrent chunking of AI while trimming the context of unwanted things html elements, css, and etc. You should check out the project. https://github.com/spider-rs
Re:Web Crawler and Scraper for AI
on Thursday December 19, 2024 @07:01PM (#42467051)
AI tools need to get the data in the proper formats while not letting the data layer being a bottleneck.
Re:Web Crawler and Scraper for AI
on Thursday December 19, 2024 @06:57PM (#42467022)
The chrome speed is also holding the bar high processing thousands of pages per second.