News for hackers. Stuff that matters.
Re:iTerm2 3.5.0 by thih9 on Tuesday May 21, 2024 @04:19AM (#40425498)
> A new AI feature in the Toolbelt, "Codecierge", lets you set a goal and then walks you step-by-step to completing it by watching the terminal contents

What exactly is “watching the terminal contents”? Does this happen locally or is data sent to a third party?

If a third party is involved, what data is shared exactly?

Re:iTerm2 3.5.0 by hombre_fatal on Tuesday May 21, 2024 @04:21AM (#40425516)
Well, the very next sentence after your quote is "It requires you to supply an OpenAI API key" which should answer your question.

Here's the default prompt:

> Return commands suitable for copy/pasting into \(shell) on \(uname). Do NOT include commentary NOR Markdown triple-backtick code blocks as your whole response will be copied into my terminal automatically.

> The script should do this: \(ai.prompt)

Re:iTerm2 3.5.0 by thih9 on Tuesday May 21, 2024 @04:27AM (#40425563)
This doesn’t answer my question about watching the terminal contents. If I ‘cat’ a file, is the file’s contents sent to openai?
Re:iTerm2 3.5.0 by hombre_fatal on Tuesday May 21, 2024 @04:30AM (#40425579)
When you open Codecierge in the toolbar sidebar, it warns you with this:

> Everything that happens in your terminal while Codecierge is running will be sent to OpenAI. Don't send them confidential information!

And when you check the box "Run commands automatically" it shows you this popup:

> This lets an AI completely control your computer. It could delete your files, do something stupid or dangerous, or lead to the downfall of humanity. Proceed with caution.

Though that's the Codecierge feature "Toolbelt -> Show Toolbelt" + Toggle "Codecierge" toolbelt window. "Run commands automatically" is hilarious.

The simpler Edit -> Engage AI (Cmd+Y) feature seems much more useful for day to day stuff and it doesn't send terminal contents to OpenAI. e.g. Cmd+Y -> "Extract foo.tar in verbose mode".

That renders the LLM's response command in a small pane and you have to Shift+Enter to go ahead and paste it into the terminal. That's really nice.

Re:iTerm2 3.5.0 by baq on Tuesday May 21, 2024 @04:44AM (#40425658)
> "Run commands automatically" is hilarious.

Yeah they should make it so it mocks the user for attempting to set it to true and explain in select, direct, simple to understand words why that's a dumb idea and that obviously the user didn't read the disclaimer.

Re:iTerm2 3.5.0 by hombre_fatal on Tuesday May 21, 2024 @04:48AM (#40425696)
Yeah, it kinda seems like a feature a developer would implement for fun but I don't see much practical use for it off the top of my head.

In the sidebar Codecierge convo they do give you a "Copy code" button whenever it detects code blocks. I think it'd be more practical to also add a "Paste and run" shortcut to each code block. i.e. A little "Play" button.

Aside, Codecierge doesn't seem to read the terminal contents like it says it should. If you ask it any questions or reference anything in your terminal, like an error in response to a command it gave you, it doesn't seem to have that context.

Re:iTerm2 3.5.0 by thih9 on Tuesday May 21, 2024 @10:50AM (#40429227)
> Don't send them confidential information!

Most of what I do in a terminal is confidential. I find it scary and also funny that in the age of data laws, privacy policies, data leaks, etc, someone thought this is an acceptable workflow.

Re:iTerm2 3.5.0 by raydev on Tuesday May 21, 2024 @03:12PM (#40432559)
For someone working on their personal projects for which they can make decisions about visibility, why wouldn't it be an acceptable workflow?
Re:iTerm2 3.5.0 by thih9 on Tuesday May 21, 2024 @06:16PM (#40434727)
Absolutely fine for that workflow.

Make sure to add a note to the project’s privacy policy that user data is sent to openai.

Re:iTerm2 3.5.0 by terhechte on Tuesday May 21, 2024 @04:44AM (#40425664)
You can set a custom URL to use Ollama which is OpenAI API compatible. Llama3 8b runs quite fast for me on a M1 Max. I'll be making use of this feature I think (haven't tried it yet).
Re:iTerm2 3.5.0 by jchoelt on Tuesday May 21, 2024 @05:27AM (#40426062)
No, unfortunately it's not possible to set a custom URL... OpenAI is either hard coded or using a configuration option that isn't exposed.
Re:iTerm2 3.5.0 by jarpineh on Tuesday May 21, 2024 @06:16AM (#40426443)
It is exposed from Advanced tab under "URL for AI API". You do have to change the model name from the preselected and offered OpenAI GPT model names. Otherwise this AI API URL isn't used. Haven't yet tested with local OAI compatible model yet, though, but did manage to break it using bad address :)
Re:iTerm2 3.5.0 by tinio on Tuesday May 21, 2024 @12:16PM (#40430429)
How do you change the model name from the preselected and offered OpenAI GPT model names? I don't see the option to do so.
Re:iTerm2 3.5.0 by weikju on Wednesday May 22, 2024 @01:49AM (#40437724)
click the name instead of the dropdown arrow

Note that to make use of ollama, you'll have to wait for the next release or upgrade to a beta release --- while you can change the API right now it's using a newer format for the payload, that's fixed in the beta/next release.

Re:iTerm2 3.5.0 by klaustopher on Tuesday May 21, 2024 @06:14AM (#40426430)
Advanced settings -> "URL for AI API"
Re:iTerm2 3.5.0 by bdamm on Tuesday May 21, 2024 @04:21AM (#40425514)
If this is a local pattern matcher trained on some text pool it could be really useful.