jrflo
jrflo on Hacker News
Human understanding is important, but I don’t think it’s the end all be all. There’s no reason to expect humans to be the best mathematical reasoners in the universe. And if math is important, beyond being a human art form, I think we should explore that math beyond our understanding.
I was hoping the writer would follow the interesting framing of the quality of an LLM's confidence score with some data on how good it is, rather than just proclaiming it's bad because of sycophancy tendencies. If someone collected the data on something measurable, I would be willing to bet the LLM's confidence number isn't too far off.
Why not? If mathematicians in the field cannot understand the papers, but tools at our disposal can, why not use them? What is "unhealthy" about that? Just seems like it's the reality of the world now.
Very cool demo! Although I feel that incorrect answers should be penalized more. For instance- I got 100% in about 45 seconds on the sprint. Then, I clicked through as fast as I can (only limited by finding the right targets) and got a score of 42s, technically better than my first score but I only got 20% right.
*for drug trials. I imagine animal testing will remain required for implants, surgical instruments, and imaging for quite a long time.
I went to check and Opus 5.5 wasn't benchmarked on DeepSWE1.1, I can't keep track of which are in vogue at the moment but maybe it's thought to be saturated at this point, as they only have older GPT models as well
I'm assuming they are just going off published benchmarks and not re-benchmarking other people's models
I feel like a lot of robotics companies are trying to ride the AI hype train right now, but the tech is soooooo far behind what we're seeing with knowledge work. The bridge from raw vision input to high level task definition to low level actuator movement with force feedback is super difficult. Unless we can get superintelligence to solve it for us, I don't see this happening for many decades.
There’s no point in tracking them. Cops won’t help since the dollar amount is too small and there’s no documentation the bike is yours. You could try to steal it back or intimidate the thieves I suppose, but I personally would not take that approach.
Best solution is to buy a high quality bike lock or two, and don’t store it long term where people can’t see it.
I don’t think it would be street legal, hence the invite only thing. More of a status symbol / car collector curiosity than an actual car
Although Asimov writes great fiction, he’d be a terrible alignment engineer
I think it’s real, the “invite only” version could probably do the kickflip over the semis, but would probably completely exhaust the tanks and require special equipment to refill or take hours with an onboard pump. And the flip is certainly a scripted stunt, not something you’d actually be able to do live. The math doesn’t seem to be completely unreasonable as a one off demo
Since when have we expected companies scaling that fast to make a profit? The fact that they've had profitable quarters already is pretty insane.
There are definitely risks to their business long term from commoditization and a lack of a moat, but I don't think that detracts from my original point that they are building something highly desirable with this new version control system today. They are probably the fastest growing company of all time in terms of revenue and valuation? They're not just slopping out more and more LOC for no reason, which was the original point being discussed in this thread.
You need to disclose that more clearly, at first glance I thought your actual prototype was pictured in the video until I noticed the snow just magically disappeared. I didn't even notice the watermark, and even if I had I wouldn't know that the random 4-pointed star meant "AI Generated Video".
I'd much rather see videos of a prototype than a fictional video that has no bearing on how the thing actually works. Especially since you list pricing on your website, making visitors think it's a currently-operating business.
The broader question is definitely relevant, I was thinking more in context of the original post justifying their need to re-invent source control.
I definitely think that's an interesting question though. I know that in the physical product development world I'm seeing really odd asymmetric speed ups. Creating simulations is essentially automated at this point, stuff that would take days to code by hand can be done in an hour. Firmware debugging feels 3x faster than before. But the big slow stuff like manufacturing, assembly, and testing are completely unchanged. All of that little stuff probably adds up to maybe a 5% faster product development cycle than before if you're really leaning into AI. It's the type of thing that will compound over time especially if it's happening all over the economy, but won't blow your socks off.
Holy shit, this is incredible. As a guitar player this actually feels like playing a guitar. So cool.
Only suggestion I would have would be to make all 6 strings strummable independently in the chord instead of just the 4, so you can do finger picking on it.
> All that busy work and for what exactly?
All that busy work was for going from zero revenue to $50B in revenue in about 3 years, and releasing AI systems that are getting better and better at a ridiculous rate. AI isn't solving all the world's problems but you can't deny that they are extremely successful with this method of operating.
Is that an AI generated product demo video? Because I personally would not sign up for a $1000/mo service if the main demo video isn't even real...
Copyright is meant to protect against reproducing a work, and something that is transformative should be fair use. If it was free on the internet, they don’t need permission anyway
There would not be the same incentive, closed models wouldn’t want to steal from / Trojan agent swarm their paying customers
They did not steal, they used free information on the internet. And, they invested billions to turn that raw information into something useful, it did not have the same inherent value before being transformed into a language model.
A better analogy would be if I read an open scientific paper and used the result to design some device. I put up the money and effort to turn that work into something useful, but someone did the ground work and it was released for everyone to see.
Idk, as an engineer who makes physical products it sucks having an overseas company take the design you spent months on, copy it, and resell at a cheaper price. All that money and effort into R&D and someone steals the answer at the end. I understand their incentives but it’s a shitty practice.
Who were these hundreds of organizations with powerful AIs?
Yes, it is reductive. HN is unreasonable when it comes to defending distillation, the billions labs pour into transforming raw information into a model is transformative work that they should reasonably try to protect. Folks just want to have free stuff and jump through hoops to defend that view.
1) It probably scales with model capability, distilled models are inherently less capable and therefore less able to commit a crime
2) If the open providers are truly just distilling bigger models, the distillers have no reason to do the crazy levels of training and evaluation that would result in a crime being committed
They are definitely spinning this for PR and their own self interest but open models are genuinely more unsafe since it’s a Pandora’s box situation- if you have a very capable hacking model there are plenty of bad actors with access to <$100k in compute resources that could raise hell with a jailbroken model. At least with Anthropic they can restrict access to bad actors.
But you're still trusting the company to actually follow those practices, which is what I'm getting at. The author assumes that OpenAI and Anthropic won't follow their stated practices, then assumes Tinfoil will follow theirs.
If you don't trust OpenAI and Anthropic to follow their own policies, how do you decide what companies to trust? Vibes?
People keep talking about the risk of open source models, but if you're outside the HN/SV bubble, no one is using them. Anthropic's revenue is ~$60B supposedly, OpenRouter's revenue is $140M. I know they're not the only place to get open source models from, but they're the most popular and Anthropic is bringing in 400x more revenue than them.
While they may be a buggy mess, I think it's really interesting that we're starting to see this unfold in real time. People have been forecasting these kind of changes for the last few years, and it seems like it's actually happening now. Really curious to see where this goes, if everyone has their own custom fork of some common codebase for specific features/needs they have across these base applications.