News for hackers. Stuff that matters.
Re:Fig Has Joined AWS by pbbakkum on Monday August 28, 2023 @02:51PM (#37298791)
Plugging a project of mine: I've been working on a similar idea for the era of LLMs: https://butterfi.sh.

It's much more bare-bones than Fig but perhaps useful if you're looking for an alternative! Send me feedback!

Re:Fig Has Joined AWS by xcdzvyn on Monday August 28, 2023 @03:03PM (#37298925)
Just curious, do you have any intent on adding local model support?
Re:Fig Has Joined AWS by pbbakkum on Monday August 28, 2023 @03:11PM (#37299045)
I've experimented with it, the reason I haven't yet added it is that I want deployment to be seamless, and it's not trivial to ship a binary that would (without extra fuss or configuration) efficiently support Metal and CUDA, plus download the models in a graceful way. This is of course possible, but still hard, and not clear if it's the right place to spend energy. I'm curious how you think about it - is your primary desire to work offline or avoid sending data to OpenAI? Or both?
Re:Fig Has Joined AWS by xcdzvyn on Monday August 28, 2023 @11:18PM (#37303169)
The latter mostly. It's also free, uncensored, and can never disappear from under me.

FWIW, from my understanding llama.cpp is pretty easy to integrate and is reasonably fast for being API agnostic. Ollama embeds it, for example. No pressure, just pointing it out :)

Re:Fig Has Joined AWS by Hamuko on Monday August 28, 2023 @03:45PM (#37299477)
Is this in any way related to the fish shell or is this just a very unfortunate name?
Re:Fig Has Joined AWS by politelemon on Monday August 28, 2023 @04:52PM (#37300256)
> Within Butterfish Shell you can send a ChatGPT prompt by just starting a command with a capital letter, for example:

This is a dangerous assumption. Not all commands are lowercase. Interaction with an external service should be a deliberate, discrete action on the user's part.

Re:Fig Has Joined AWS by jozzas on Tuesday August 29, 2023 @03:02AM (#37304310)
agree, nothing wrong with something like an `llm` prefix
Re:Fig Has Joined AWS by subw00f on Monday August 28, 2023 @05:05PM (#37300384)
I like that a lot! It would be awesome if the client running on goal mode had capabilities to request some search engine API + do some crawling. Imagine getting the info out of up to date github issues or directly from AWS docs.