News for hackers. Stuff that matters.

Show HN: Outrecta – A simple LLM-based test generator

https://www.outrecta.com

Hello everyone! I recently developed a simple LLM-based test generator. It can generate tests about any topic. If you are interested, you can check a few examples that were generated by it here: https://github.com/cosmicproc/outrecta/tree/main/examples.

It can make mistakes time to time but overall it's still usable. To try it out, just visit the website: outrecta.com. You will need an API key from an LLM provider however.

You may wonder why not just use the LLM directly. That could work fine too actually but this tool puts it neatly on a webpage with formatting like LaTeX, answer choices if requested, etc. You can convert the page into PDF too (by printing to PDF).

( 2 comments | 2 points | on HN )
Re:Show HN: Outrecta – A simple LLM-based test generator by MO-379 on Thursday September 05, 2024 @02:15PM (#41459130)
Hello fellow Edtech programmer,

TLDR: > 0.0% hallucination = mistrust from people

We're in the same boat, I can give a quick relay of the feedback i was getting.

Generally about test/education generation with model is that they're unreliable because of hallucinations. people hate that very much as you may be aware, in my case I was asking for payment on top so it made the feedback even harsher.

One way I see that you can strike gold and maybe even successfully monetise this is if you allow the user to provide urls that you scrape, then adjust your prompts for a successful (Retrieval augmented generation) RAG. This way people will trust the tool and may consider paying if the features solve a headache for them (this is the direction im considering for my APP).

Re:Show HN: Outrecta – A simple LLM-based test generator by cosmicproc on Thursday September 05, 2024 @02:31PM (#41459258)
Yes, a more specialized approach may end up more reliable. That RAG idea is pretty interesting actually. Thanks for mentioning it.

My vision with this project was to just create a simple tool that can allow one to generate practice tests with high quality text formatting in the PDF format using LLMs. I myself experienced a lack of practice material sometimes so the idea came out from there.