happygoose
happygoose on Hacker News
Fireworks "datasets" are used for batch inference as well as training models. Notion mentioned that the leak was due to some feature they have to classify previous ai conversations. They probably uploaded these conversations as a 'dataset' to fireworks in order to take advantage of their large batch processing discount.
https://docs.fireworks.ai/guides/batch-inference
pretty sure the codex cli itself is open source (and written in rust!) and can be used with any model.
just because there's a chance of something bad happening doesn't mean its worth it to abandon all convenience and workflow improvements, though. if no one ever used workflow tools that could access the contents of their emails because of the risk of a leak, its possible the productivity loss across society from that would be much worse than from the security incidents (like this one). there are pros and cons to things. it's not wrong to choose something just because it has a small risk associated with it.
the whole reason chatgpt got so popular in the first place is because humans found it easier to intuitively interact with a system that acts and seems more like a human, though.
technically, it does all that by outputting text, like `run_shell_command("cargo build")` as part of its response. But you could easily say similar things about humans.
To me, "autocomplete" seems like it describes the purpose of a system more than how it functions, and these agents clearly aren't designed to autocomplete text to make typing on a phone keyboard a bit faster.
I feel like people compare it to "autocomplete" because autocomplete seems like a trivial, small, mundane thing, and they're trying to make the LLMs feel less impressive. It's a rhetorical trick that is very overused at this point.
unfortunately, there doesn't seem to be a clear way to fine-tune these models yet. excited for when that happens though.
if you use nixos you end up feeling like you need to spend more time developing your personal computer's configuration than developing your actual projects, ime.
it kind of 'just works' if someone already wrote the nix code to do what you want it to do and put it in nixpkgs and you manage to find it and figure out how to use it. but if that isn't the case, good luck. i once spent almost a week trying to get a program to build and run properly under nix that could probably be installed in around 20 seconds on a osx/windows machine.
What's co-pilot? do you mean the Microsoft 365 Copilot App?
looks like more might be down than just openai. reddit isnt loading for me and downdetector is reporting spikes for a lot of things. wonder what happened.
not activedirectory as well?