News for hackers. Stuff that matters.

FineTuner42

Show HN: I built a small tool that lets you edit your RAG data efficiently

https://github.com/Oqura-ai/optim-rag

So, during my internship I worked on a few RAG setups and one thing that always slowed us down was to them. Every small change in the documents made us reprocessing and reindexing everything from the start.Recently, I have started working on optim-rag on a goal to reduce this overhead. Basically, It lets you open your data, edit or delete chunks, add new ones, and only reprocesses what actually...

( Read More... | no comments | on HN )

Show HN: I built a deep research tool for local file system

https://github.com/Datalore-ai/deepdoc

I was experimenting with building a local dataset generator with deep research workflow a while back and that got me thinking. what if the same workflow could run on my own files instead of the internet. being able to query pdfs, docs or notes and get back a structured report sounded useful.so I made a small terminal tool that does exactly that. I point it to local files like pdf, docx, txt or...

( Read More... | 2 comments | 3 points | on HN )

Show HN: Wrote a small tool that turns PDFs and docs into fine-tuning datasets

https://github.com/Datalore-ai/datalore-localgen-cli

I previously posted a terminal tool that could generate fine-tuning datasets from real-world data using deep research. One of the most common requests was: “Can it work with local resources instead of only going online?”Over the weekend, I built a separate version that does exactly that:Point it to a local file (PDF, DOCX, JPG, TXT)Describe the dataset you wantIt extracts text → finds relevant...

( Read More... | 1 comment | on HN )

Show HN: Generate Fine-tunning dataset using deep research in terminal

https://github.com/Datalore-ai/datalore-deep-research-cli

Just open-sourced a small terminal tool I’ve been working on. The idea came from wondering how useful it’d be if you could just describe the kind of dataset you need, and it would go out, do the deep research, and return something structured and usable.You give it a description, and it pulls relevant info from across the web, suggests a schema based on what it finds, and generates a clean...

( Read More... | no comments | 5 points | on HN )