nghota

Building (toy) non-trivial software with Rust

Posted by nghota on Tuesday January 23, 2024 @04:01PM
from the buildingwithrust.substack.com dept.

Re:Trafilatura: Python tool to gather text on the Web on Monday August 14, 2023 @04:31PM (#37126427)

check out nghota.com api. It is able to pull out the main text from most non-ecommerce web pages and return that to you in json.

Re:Experimental library for scraping websites using OpenAI's GPT API on Saturday March 25, 2023 @04:05PM (#35306710)

Only articles are supported atm. I am working on algorithms for other page types.

Re:Experimental library for scraping websites using OpenAI's GPT API on Saturday March 25, 2023 @03:27PM (#35306209)

Do you really need GPT for this? - see https://nghota.com for an api that provides something similar but for articles (I am the developer there!).