Re:Show HN: Danswer – Open-source question answering across ...
by XCSme on Monday July 10, 2023 @01:19PM
(#36669530)
Wait, this is not local? Why use OpenAI third-party requests instead of a local model?
[ Parent
| on HN ]
Re:Show HN: Danswer – Open-source question answering across ...
by Weves on Monday July 10, 2023 @03:26PM
(#36671658)
Adding local/open source model support is at the top of our TODO list! When we started building, open source models were quite a bit more behind of GPT-4 then they are now. At that time the performance gap was at a point where locally hosted models would provide a significantly hampered experience, but we think that gap has (and will continue) to close rapidly.