Dot: Standalone app for local RAG with Mistral 7B

Re:Dot: Standalone app for local RAG with Mistral 7B by nico on Sunday March 17, 2024 @12:15PM (#39735475)

This is really cool!

What kind of hardware does it require?

Does it run without a GPU?

[ Parent | on HN ]

Re:Dot: Standalone app for local RAG with Mistral 7B by alexpinel on Sunday March 17, 2024 @12:17PM (#39735490)

thanks! right now it runs on Apple Silicon and Windows, it works far better with a GPU on PC but should also work with CPU if there is enough RAM. Although some people have mentioned there are some issues with the Windows app so I am looking into that right now.

[ Parent | on HN ]

Re:Dot: Standalone app for local RAG with Mistral 7B by nico on Sunday March 17, 2024 @12:53PM (#39735821)

Thank you!

How much is enough ram?

[ Parent | on HN ]