Cool work though, really excited for the potential of slimming down models.
https://github.com/camdenclark/gcrunner
GitHub Actions is notoriously expensive, especially for larger runners.This tool deploys into your Google Cloud instance and runs ephemeral VMs for GitHub Actions jobs. That way you can take advantage of much better pricing on Google Cloud (and use any credits you may have instead of paying GitHub out of pocket).You control the infrastructure completely, you set up a GitHub App + deploy the...
That metric is the key piece. I don't know the right way to build an automated metric for a lot of the systems I want to build that will stand the test of time.
This takes a ton of upfront work and careful thinking. As soon as you move the goalposts of what you're trying to achieve you also have to update the training and evaluation dataset to cover that new use case.
This can actually get in the way of moving fast. Often teams are not trying to optimize their prompts but even trying to figure out what the set of questions and right answers should be!
It feels like it has a lot of the same downsides of hosted databases so I'm not sure what the specific value is.
From their site they really emphasize local first syncing (so mobile apps and electron/tauri apps) and multi tenancy (hard database boundaries)
Each DO is globally unique (there's one DO with a given id running anywhere) and runs sqlite on its own local storage in that datacenter.
Maybe just ask the cousin not to send any more money?
The article does mention that OpenAI has huge revenue.
> While The Information reported that OpenAI's revenue is $3.5 to $4.5 billion a year in July, The New York Times reported last week that OpenAI's annual revenues have "now topped $2 billion," which would mean that the end-of-year numbers will likely trend toward the lower end of the estimate.
But then the author claims that the business value is questionable.
> And even if they did, it isn't clear whether generative AI actually provides much business value at all. The Information reported last week that customers of Microsoft's 365 suite [snip]
I would have appreciated a deeper discussion of why OpenAI's revenue isn't a data point toward generative AI having some business value. Presumably if nobody was using generative AI in a way that gives them value, OpenAI wouldn't be using all those GPU hours. That's what I was missing from the article personally.
It takes time for new advancements to get proliferated through the economy.
If you zoom out on the first graphic from December 2023 back to 2020, the capabilities of models released at that time on these benchmarks would be much much lower. The best lens for future performance of large models is uncertainty.
He was using Tupac's voice on the TaylorMade freestyle in a really disrespectful way that would borderline on hateful of his artistic legacy. Just read these lyrics...
> Verse 1: 2Pac (AI)] Kendrick, we need ya, the West Coast savior Engraving your name in some hip-hop history If you deal with this viciously You seem a little nervous about all the publicity Fuck this Canadian lightskin, Dot We need a no-debated West Coast victory, man Call him a bitch for me Talk about him likin' young girls, that's a gift from me
First let's consider CD -> streaming as a media change. Streaming didn't really exist when Tupac was around. But nobody would say putting Tupac's catalog on streaming is inherently disrespectful to his artistic legacy because it's preserving (more or less) the same artistic product.
Here are a couple other examples that I do think are more analogous than improvements in recording technologies:
Posthumous releases with material not created by the artist. Sometimes record labels will try to capitalize on the brand of an artist and release material that really only has snippets of random recordings that an artist made. In my view, this is disrespectful to the artist because it's not a piece of artistic material they wanted to release.
Another example is colorizing black and white movies. Similarly, this action changes the actual artistic product in a way that's disrespectful to the creators of those films.
Creating AI holograms of artists is similar to these examples because it's changing the artistic output of an artist and disrespecting their artistic legacy. It's creating content under their name without the ability for them to say no or have any input into the output.
The focus in the AI tutor world is basically a chatbot to ask questions of. But if you're trying to learn something, it's really helpful to have targeted questions asked of you!