News for hackers. Stuff that matters.

Show HN: I built an open-source answer engine that runs local LLMs

https://github.com/rashadphz/farfalle

hey hn,

I built an open-source Perplexity clone that can run local LLMs and cloud LLMs.

It's fully self-hostable through Docker and uses ollama to support local LLMs.

The demo video in the repository shows me running it locally with llama3 on my M1 Macbook Pro.

I'm open to any suggestions or feedback, thanks!

( 2 comments | 3 points | on HN )
Re:Show HN: I built an open-source answer engine that runs l... by rashadphil on Friday May 17, 2024 @06:13PM (#40394638)
Try out the hosted version here: https://www.farfalle.dev/ (Cloud models only)
Re:Show HN: I built an open-source answer engine that runs l... by throwaway888abc on Sunday May 19, 2024 @01:39PM (#40408430)
Really nice, very polished. Bookmarked. Thanks