mwarkentin
mwarkentin on Hacker News
Is it? If the spec is as detailed as the code would be? If you make a change to one part of the spec do you now have inconsistencies that the LLM is going to have to resolve in some way? Are we going to have a compiler, or type checker type tools for the spec to catch these errors sooner?
Ah yes, all of the precedents and lawful authority that this president cares so much about adhering to.
If you’re on iOS, and don’t use swipe keyboard, disable that functionality. I found it made a big improvement for me.
“I can stop any time I want!”
Uv solves this (with some new standards). ./script.py will now install the python version, create a venv, and install dependencies (very quickly) if they don’t exist already.
#!/usr/bin/env -S uv run --script
# /// script
# requires-python = ">=3.12"
# dependencies = [
# "ffmpeg-normalize",
# ]
# ///
> Specifically, the paper estimates that Llama 3.1 70B has memorized 42 percent of the first Harry Potter book well enough to reproduce 50-token excerpts at least half the time. (I’ll unpack how this was measured in the next section.)
> Interestingly, Llama 1 65B, a similar-sized model released in February 2023, had memorized only 4.4 percent of Harry Potter and the Sorcerer's Stone. This suggests that despite the potential legal liability, Meta did not do much to prevent memorization as it trained Llama 3. At least for this book, the problem got much worse between Llama 1 and Llama 3.
> Harry Potter and the Sorcerer's Stone was one of dozens of books tested by the researchers. They found that Llama 3.1 70B was far more likely to reproduce popular books—such as The Hobbit and George Orwell’s 1984—than obscure ones. And for most books, Llama 3.1 70B memorized more than any of the other models.
Posted by
mwarkentin on Tuesday February 13, 2024 @04:48PM
from the cra.mr dept.
Yes.
Although it’s also hollowed out the group of people using StackOverflow (and perhaps stack overflow has restricted open access to its data for further scraping), so future iterations of LLMs will have less up to date training data to use.
Back when we first tried out DMS there was a fun bug where booleans were interpreted as strings, so all false records were interpreted as “false” and translated to true on the target DB. It was fixed shortly after but was a good reminder to validate your data during a migration.
I leave my laptop plugged in 95% of the time so in practice this caps it at 80% (helpful).
I suspect quite a few people do that so it probably is net-good overall, but agree it doesn’t work well if you’re moving around a lot.
Posted by
mwarkentin on Thursday November 16, 2023 @06:19PM
from the sentry.engineering dept.
Yes, I think that's about right (SRE at Sentry).
Pretty sure we had people spin up a Slack instance at our company while we were still on Hipchat officially. Slack was a big improvement over what we had before that IMO.
The Functional Source License (FSL) is a source-available non-compete license that converts to Apache 2.0 or MIT after one year.
Posted by
mwarkentin on Wednesday October 18, 2023 @07:02PM
from the fsl.software dept.
Uh, reference for s3 prices going up? I’ve only ever seen them heading down over time.
Posted by
mwarkentin on Friday September 22, 2023 @10:51PM
from the sentry.engineering dept.