Re:The most underreported story in AI is that scaling has fa...
by hansmayer on Sunday February 23, 2025 @10:34AM
(#43149969)
Right so... they are still not able to spell the single letters because the algorithm we use to train it to do so is far too expensive? Wake me up when it "happens" (and it gets out of it's current, three-year long 'about to happen' phase), e.g. when it stopps costing 200B USD to do character-level tokenisation in a string, a problem we once first solved some 50-60 years ago, with higher-order programming languages. Funnily enough, those algorithms can run on an 8bit computer in negligible time and require nowhere near the resources these Frankesteins need in order to sometimes get the count of Rs in strawberries right. Provided we train them with petabytes of data, and provide gigawatts of power.
[ Parent
| on HN ]
Re:The most underreported story in AI is that scaling has fa...
by CamperBob2 on Thursday February 27, 2025 @06:22PM
(#43199715)
It's happened, you can wake up now.
But you'll just move the goalposts again, I imagine.
Re:The most underreported story in AI is that scaling has fa...
by hansmayer on Friday February 28, 2025 @04:51AM
(#43203738)
What goalposts? I am sorry, but as someone who has been using GitHub Copilot for quite some time now, I can tell you that unfortunately, no, it has not happened, and the evidence is there with every single prompt.