News for hackers. Stuff that matters.
Re:Localllm lets you develop gen AI apps on local CPUs by simonw on Wednesday February 07, 2024 @08:08PM (#39296567)
I'm not thrilled about https://github.com/GoogleCloudPlatform/localllm/blob/main/ll... calling their Python package "llm" and installing "llm" as a CLI command, when my similar https://llm.datasette.io/ project has that namespace reserved on PyPI already: https://pypi.org/project/llm/
Re:Localllm lets you develop gen AI apps on local CPUs by triyambakam on Wednesday February 07, 2024 @08:24PM (#39296688)
I actually wish that no one took the llm namespace. It's annoyingly vague.
Re:Localllm lets you develop gen AI apps on local CPUs by simonw on Wednesday February 07, 2024 @08:31PM (#39296735)
I think it's a pretty great name for my tool, given that it lets you interact with dozens of different LLMs via plugins.

Plus I like that it's three letters, since it's designed for CLI usage.

Re:Localllm lets you develop gen AI apps on local CPUs by triyambakam on Thursday February 08, 2024 @02:00AM (#39299113)
But your tool isn't an llm. llmt for e.g. llm tool could be better
Re:Localllm lets you develop gen AI apps on local CPUs by thih9 on Thursday February 08, 2024 @03:43AM (#39299729)
Yes - at the same time it would similarly fit other tools where some form of working with LLMs is the main feature. And with time we might get more of these.

At least it’s not called “ai”, we have that already, e.g. https://github.com/yufeikang/ai-cli

Re:Localllm lets you develop gen AI apps on local CPUs by wokwokwok on Thursday February 08, 2024 @04:05AM (#39299871)
Sure, but it’s not like you own the name LLM.

I mean, let’s say you picked say, “ghost pony”; ok, sure, it’s obviously a name.

But LLM? I mean, it’s not like you can get a lot more generic than that. If your tools name is “tool” and some else makes a tool called “tool”, you can’t really complain that much…

Re:Localllm lets you develop gen AI apps on local CPUs by arcanemachiner on Wednesday February 07, 2024 @10:15PM (#39297569)
This is kinda how I feel about HTTPie taking using 'http' in the CLI.
Re:Localllm lets you develop gen AI apps on local CPUs by coding123 on Thursday February 08, 2024 @03:18AM (#39299567)
Almost every package is vague if you're just going off names of packages. Is 'pandas' some kind of screensaver showcasing the cute animals?
Re:Localllm lets you develop gen AI apps on local CPUs by rollcat on Thursday February 08, 2024 @03:28AM (#39299633)
I like what Go does (I know, the irony). Buy a domain name, that's your namespace.
Re:Localllm lets you develop gen AI apps on local CPUs by rmorey on Thursday February 08, 2024 @11:36AM (#39304046)
If the name is available, someone will take it, and I can think of no better steward of it than Simon
Re:Localllm lets you develop gen AI apps on local CPUs by rmorey on Wednesday February 07, 2024 @08:15PM (#39296613)
I thought exactly the same - it actually drives me nuts that Python packages have this confusing dual-name nature. You were there first!
Re:Localllm lets you develop gen AI apps on local CPUs by behnamoh on Wednesday February 07, 2024 @11:31PM (#39298169)
I'm really pissed off at Google for doing this:

- First, they "steal" @simonw's 'llm' keyword for their own CLI tool (https://news.ycombinator.com/item?id=39296567)

- Then they create a wrapper around llama-cpp-python which is a wrapper around llama-cpp, a project they don't even credit nor support.

- Then they steal @mcapodici's article title to publish it on their blog (https://news.ycombinator.com/item?id=39297563).

- And the ironic part is that their Gemini models are closed-source, so no gguf for those.

Re:Localllm lets you develop gen AI apps on local CPUs by pests on Thursday February 08, 2024 @01:46AM (#39299020)
May I ask why you linked to your parents comment as a source? Just seems.. odd
Re:Localllm lets you develop gen AI apps on local CPUs by vasco on Thursday February 08, 2024 @02:38AM (#39299363)
"No GPU? No Problem." Isn't exactly a complex phrase they'd have to steal, seems much more likely they came up with it independently.
Re:Localllm lets you develop gen AI apps on local CPUs by 3abiton on Thursday February 08, 2024 @03:49AM (#39299773)
Google trying to ride the open source hype that Meta is blessed by, except google is a mean girl who regrets opening up the transformer without taxing it, so they're really sour about it and doing these tricks now to pretend to still support open-source.
Re:Localllm lets you develop gen AI apps on local CPUs by nicolezhu on Thursday February 08, 2024 @12:06AM (#39298442)
Yeah, this feels super reactive. Like someone pitched an idea for how to convert AI enthusiasts to paid google AI suite...

I want to know: are they contributing back to llamacpp? Are they paying GG?

Re:Localllm lets you develop gen AI apps on local CPUs by sitkack on Thursday February 08, 2024 @12:21AM (#39298542)
You should rename your project.
Re:Localllm lets you develop gen AI apps on local CPUs by sitkack on Thursday February 08, 2024 @07:19AM (#39301080)
Missed /s
Re:Localllm lets you develop gen AI apps on local CPUs by dmezzetti on Thursday February 08, 2024 @06:11AM (#39300628)
LLM is now an ubiquitous term, not sure anyone can claim ownership of the keyword. It also looks like the package is a local install only, not pushed to PyPI. So unless you want to use this project, you'd never know.
Re:Localllm lets you develop gen AI apps on local CPUs by gsuuon on Friday February 09, 2024 @04:11PM (#39320607)
This happened with one of my neovim plugins (also named llm!). In my case I was already thinking of renaming the project so I just went through with that. The other project's maintainer was nice enough to apologize and I ended up with a name I liked better.

https://github.com/gsuuon/model.nvim/discussions/37