News for hackers. Stuff that matters.
Re:After court order, OpenAI is now preserving all ChatGPT u... by JKCalhoun on Wednesday June 04, 2025 @07:04PM (#44186529)
Better still, local LLM. It's too bad they're not "subscription grade".
Re:After court order, OpenAI is now preserving all ChatGPT u... by mmasu on Wednesday June 04, 2025 @07:32PM (#44186726)
yet - likely subscription grade will stay ahead of the curve, but we will soon have very decent models running locally for very cheap - like when you play great videogames that are 2/3 years old on now “cheap”machines
Re:After court order, OpenAI is now preserving all ChatGPT u... by SchemaLoad on Wednesday June 04, 2025 @08:10PM (#44186977)
I tried running the DeepSeek models that would run on my 32GB macbook and they were interesting. They could still produce good conversation but didn't seem to have the entirety of the internet in it's knowledge pool. Asking it complex questions lead to it only offering high level descriptions and best guess answers.

Feel like they would still be great for a lot of applications like "Search my local hard drive for the file that matches this description"

Re:After court order, OpenAI is now preserving all ChatGPT u... by JKCalhoun on Wednesday June 04, 2025 @08:23PM (#44187064)
Yeah, Internet search as a fallback, our chat history and "saved info" in the context ... there's a lot OpenAI, et. al. give you that Ollama does not.
Re:After court order, OpenAI is now preserving all ChatGPT u... by GrayShade on Thursday June 05, 2025 @03:06AM (#44189123)
You can get those in ollama using tools (MCP).
Re:After court order, OpenAI is now preserving all ChatGPT u... by JKCalhoun on Thursday June 05, 2025 @07:43AM (#44190648)
Had to ask ChatGPT what MCP (Model Context Protocol) referred to.

When I followed up with how to save chat information for future use in the LLM's context window, I was given a rather lengthy process involving setting up an SQL database, writing some Python tp create a "pre-prompt injection wrapper"....

That's cool and all, but wishing there was something a little more "out of the box" that did this sort of thing for the "rest of us". GPT did mention Tome, LM Studio, a few others....

Re:After court order, OpenAI is now preserving all ChatGPT u... by GrayShade on Friday June 06, 2025 @08:08AM (#44200024)
Not sure if you're aware of it, but Open Web UI is a nice (looks like ChatGPT) Web client for ollama and anything else. It also seems to support MCP.

I did play with MCP and ollama a little, but that was scripted, not interactive.

Re:After court order, OpenAI is now preserving all ChatGPT u... by JKCalhoun on Wednesday June 04, 2025 @07:45PM (#44186816)
Definitely what I am hoping.