News for hackers. Stuff that matters.
Re:GitHub cuts AI deals with Google, Anthropic by pseudosavant on Tuesday October 29, 2024 @01:24PM (#41987016)
I use both Claude and ChatGPT/GPT-4o a lot. Claude, the model, definitely is 'better' than GPT-4o. But OpenAI provides a much more capable app in ChatGPT and an easier development platform.

I would absolutely choose to use Claude as my model with ChatGPT if that happened (yes, I know it won't). ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image generation, and memory. It isn't close. But Claude absolutely produces better code, only being beaten by ChatGPT because it can fetch data from the web to RAG enhance its knowledge of things like APIs.

Claude's implementation of artifacts is very good though, and I'm sure that is what lead OpenAI to push out their buggy canvas feature.

Re:GitHub cuts AI deals with Google, Anthropic by tanelpoder on Tuesday October 29, 2024 @02:44PM (#41987972)
Are there any good 3rd-party native frontend apps for Claude (on MacOS)? I mean something like ChatGPTs app, not an editor. I guess one option would be to just run Claude iPad app on MacOS.
Re:GitHub cuts AI deals with Google, Anthropic by Liquix on Tuesday October 29, 2024 @03:58PM (#41988647)
Jan [0] is MacOS native, open source, similar feel to the ChatGPT frontend, very polished, and offers Anthropic integration (all Claude models).

It also features one-click installation, OpenAI integration, a hub for downloading and running local models, a spec-compatible API server, global "quick answer" shortcut, and more. Really can't recommend it enough!

[0] https://github.com/janhq/jan

Re:GitHub cuts AI deals with Google, Anthropic by jawon on Tuesday October 29, 2024 @04:10PM (#41988795)
I like msty.app. Parallel prompting across multiple commercial and local models plus branching dialogs. Doesn’t do artifacts, etc, though.
Re:GitHub cuts AI deals with Google, Anthropic by TeMPOraL on Tuesday October 29, 2024 @03:27PM (#41988393)
If you're willing to settle for a client-side only web frontend (i.e. talks directly with APIs of the models you use), TypingMind would work. It's paid, but it's good (see [0]), and I guess you could always go for the self-hosted version and wrap it in an Electron app - it's what most "native" apps are these days anyway (and LLM frontends in particular).

--

[0] - https://news.ycombinator.com/item?id=41988306

Re:GitHub cuts AI deals with Google, Anthropic by mike_hearn on Tuesday October 29, 2024 @02:50PM (#41988036)
You can use https://recurse.chat/ if you have an Apple silicon Mac.
Re:GitHub cuts AI deals with Google, Anthropic by greenavocado on Tuesday October 29, 2024 @03:21PM (#41988342)
Open-WebUI doesn't support Claude natively (only through a series of hacks) but it is absolutely "THE" go-to for a ChatGPT Pro like experience (it is slightly better).

https://github.com/open-webui/open-webui

Re:GitHub cuts AI deals with Google, Anthropic by octohub on Tuesday October 29, 2024 @04:34PM (#41989058)
Msty [0] is a really good app - you can use both local or online models and has web search, attachments, RAG, split chats, etc., built-in.

[0] https://msty.app

Re:GitHub cuts AI deals with Google, Anthropic by KingMob on Thursday October 31, 2024 @01:31AM (#42003772)
It's not native, but I've been pretty happy with big-AGI. It's just an `npm run` away. I don't use it for coding tasks, though.

Its most unique feature is its "beam" facility, which allows you to send a query to multiple APIs simultaneously (if you want to cross-check) and even combine the answer.

Re:GitHub cuts AI deals with Google, Anthropic by coryfklein on Tuesday October 29, 2024 @03:33PM (#41988444)
> But OpenAI provides a much more capable app in ChatGPT and an easier development platform

Which app are you talking about here?

Re:GitHub cuts AI deals with Google, Anthropic by ben_w on Tuesday October 29, 2024 @03:04PM (#41988177)
FWIW, I was able to get a decent way into making my own client for ChatGPT by asking the free 3.5 version to do JS for me* before it was made redundant by the real app, so this shouldn't be too hard if you want a specific experience/workflow?

* I'm iOS by experience; my main professional JS experience was something like a year before jQuery came out, so I kinda need an LLM to catch me up for anything HTML

Also, I wanted HTML rather than native for this.

Re:GitHub cuts AI deals with Google, Anthropic by benreesman on Tuesday October 29, 2024 @02:49PM (#41988029)
It’s all a dice game with these things, you have to watch them closely or they start running you (with bad outcomes). Disclaimers aside:

Sonnet is better in the small, by a lot. It’s sharply up from idk, three months ago or something when it was still an attractive nuisance. It still tops out at “Best SO Answer”, but it hits that like 90%+. If it involves more than copy paste, sorry folks, it’s still just really fucking good copy paste.

But for sheer “doesn’t stutter every interaction at the worst moment”? You’ve got to hand it to the ops people: 4o can give you second best in industrial quantity on demand. I’m finding that if AI is good enough, then OpenAI is good enough.

Re:GitHub cuts AI deals with Google, Anthropic by logicchains on Tuesday October 29, 2024 @03:09PM (#41988230)
>If it involves more than copy paste, sorry folks, it’s still just really fucking good copy paste.

Are you sure you're using Claude 3.5 Sonnet? In my experience it's absolutely capable of writing entire small applications based off a detailed spec I give it, which don't exist on GitHub or Stack Overflow. It makes some mistakes, especially for underspecified things, but generally it can fix them with further prompting.

Re:GitHub cuts AI deals with Google, Anthropic by benreesman on Tuesday October 29, 2024 @05:54PM (#41989809)
I’m quite sure what model revision their API quotes, though serious users rapidly discover that like any distributed system, it has a rhythm to it.

And I’m not sure we disagree.

Vercel demo but Pets is copy paste.

Re:GitHub cuts AI deals with Google, Anthropic by benreesman on Tuesday October 29, 2024 @05:55PM (#41989817)
We have entered the era of generic fashionable CRUD framework demo Too Cheap To Hawk.
Re:GitHub cuts AI deals with Google, Anthropic by mattwad on Tuesday October 29, 2024 @03:07PM (#41988211)
Have you tried using Cursor with Claude embedded? I can't go back to anything else, it's very nice having the AI embedded in the IDE and it just knows all the files i am working with. Cursor can use GPT-4o too if you want
Re:GitHub cuts AI deals with Google, Anthropic by TeMPOraL on Tuesday October 29, 2024 @03:18PM (#41988306)
> ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image generation, and memory. It isn't close.

Funny thing, TypingMind was ahead of them for over a year, implementing those features on top of the API, without trying to mix business model with engineering[0]. It's only recently that ChatGPT webapp got more polished and streamlined, but TypingMind's been giving you all those features for every LLM that can handle it. So, if you're looking for ChatGPT-level frontend to Anthropic models, this is it.

ChatGPT shines on mobile[1] and I still keep my subscription for that reason. On desktop, I stick to TypingMind and being able to run the same plugins on GPT-4o and Claude 3.5 Sonnet, and if I need a new tool, I can make myself one in five minutes with passing knowledge of JavaScript[2]; no need to subscribe to some Gee Pee Tee.

Now, I know I sound like a shill, I'm not. I'm just a satisfied user with no affiliation to the app or the guy that made it. It's just that TypingMind did the bloodingly stupid obvious thing to do with the API and tool support (even before the latter was released), and continues to do the obvious things with it, and I'm completely confused as to why others don't, or why people find "GPTs" novel. They're not. They're a simple idea, wrapped in tons of marketing bullshit that makes it less useful and delayed its release by half a year.

--

[0] - "GPTs", seriously. That's not a feature, that's just system prompt and model config, put in an opaque box and distributed on a marketplace for no good reason.

[1] - Voice story has been better for a while, but that's a matter of integration - OpenAI putting together their own LLM and (unreleased) voice model in a mobile app, in a manner hardly possible with the API their offered, vs. TypingMind being a webapp that uses third party TTS and STT models via "bring your own API key" approach.

[2] - I made https://docs.typingmind.com/plugins/plugins-examples#db32cc6... long before you could do that stuff with ChatGPT app. It's literally as easy as it can possibly be: https://git.sr.ht/~temporal/typingmind-plugins/tree. In particular, this one is more representative - https://git.sr.ht/~temporal/typingmind-plugins/tree/master/i... - PlantUML one is also less than 10 lines of code, but on top of 1.5k lines of DEFLATE implementation in JS I plain copy-pasted from the interwebz because I cannot into JS modules.