Forget ChatGPT: why researchers now run small AIs on their laptops

Re:Forget ChatGPT: why researchers now run small AIs on thei... by privacyis1mp on Saturday September 21, 2024 @02:00PM (#41611570)

I built Fluid app exactly with that in mind. You can run local AI on mac without really knowing what an LLM/ollama is. Plug&Play.

Sorry for the blatant ad, though I do hope it's useful for some ppl reading this thread: https://getfluid.app

[ Parent | on HN ]

Re:Forget ChatGPT: why researchers now run small AIs on thei... by twh270 on Saturday September 21, 2024 @02:54PM (#41611889)

I'm interested, but I can't find any documentation for it. Can I give it local content (documents, spreadsheets, code, etc.) and ask questions?

[ Parent | on HN ]

Re:Forget ChatGPT: why researchers now run small AIs on thei... by privacyis1mp on Saturday September 21, 2024 @03:05PM (#41611943)

> Can I give it local content (documents, spreadsheets, code, etc.) It's coming roughly in December (may be sooner).

Roadmap is following:

- October - private remote AI (when you need smarter AI than your machine can handle, but don't want your data to be logged or stored anywhere)

- November - Web search capabilities (so the AI will be capable of doing websearch out of the box)

- December - PDF, docs, code embedding. 2025 - tighter MacOS integration with context awareness.

[ Parent | on HN ]

Re:Forget ChatGPT: why researchers now run small AIs on thei... by twh270 on Saturday September 21, 2024 @03:56PM (#41612275)

Oh awesome, thank you! I will check back in December.

[ Parent | on HN ]

Re:Forget ChatGPT: why researchers now run small AIs on thei... by halostatue on Monday September 30, 2024 @03:41PM (#41701213)

Probably not the best choice of names: https://fluidapp.com. I don't know that it's been updated in a while, but it still works nicely.

[ Parent | on HN ]