Re:Show HN: Outrecta – A simple LLM-based test generator
by cosmicproc on Thursday September 05, 2024 @02:31PM
(#41459258)
Yes, a more specialized approach may end up more reliable. That RAG idea is pretty interesting actually. Thanks for mentioning it.
My vision with this project was to just create a simple tool that can allow one to generate practice tests with high quality text formatting in the PDF format using LLMs. I myself experienced a lack of practice material sometimes so the idea came out from there.
TLDR: > 0.0% hallucination = mistrust from people
We're in the same boat, I can give a quick relay of the feedback i was getting.
Generally about test/education generation with model is that they're unreliable because of hallucinations. people hate that very much as you may be aware, in my case I was asking for payment on top so it made the feedback even harsher.
One way I see that you can strike gold and maybe even successfully monetise this is if you allow the user to provide urls that you scrape, then adjust your prompts for a successful (Retrieval augmented generation) RAG. This way people will trust the tool and may consider paying if the features solve a headache for them (this is the direction im considering for my APP).