throwaway63467

Just patched it everywhere on my servers last night. It’s getting increasingly more difficult to run things exposed to the internet, I get so many “sorry we’ve been hacked your data was stolen” e-mails recently it’s crazy, we must have armies of people combing through the web with AI attack tools.

Should’ve bought a Panasonic. Everyone knows Hitachi sucks for programmability hardware is good though.

These models have no self awareness. I just spent days having it write some test framework with very clear goals and it was highly confident understanding exactly what I wanted only for the whole thing to be complete bullshit, one remark from me about the work being useless and it goes “oh you’re absolutely right that’s on me”…

Same, it’s so smart but so dumb. I explain an architecture change to it and write examples of strongly typed Go code and how to store structure, it agrees and then proceeds to write some untyped string map ball of mud that has 900 specializations.

But maybe that’s on us, AI doesn’t care about all these special cases, it’s not debt to it as it will simply read them all when making changes. We’re obsessed with quality and what code is supposed to look like but those are human standards, AIs evolve to look at this complexity as a single picture, they can simply see through it so what is spaghetti code to us is merely some code to them that works as it should and is efficient. It’s interesting we can see how the two things drift apart, you would think at some point AI generated code should explode but it hold together unreasonably well in most cases…

Why are people upset, it’s obviously “stupid” for customers but Amazon has been doing this for ages, prices change multiple times per day and the only reason is that they choose the optimal price point where you will just so buy at Amazon and not elsewhere, AI is surely involved in that process. People are fine with it apparently as Amazon grows like crazy, so why not pay dynamic rates for our burgers too, why not for everything? There are only so many ways for companies to grow 10-20 % per year forever, expect a lot more craziness as many of them reach global market penetration where regular growth mechanisms get exhausted.

I tried writing a simple 20 page paper with the latest Claude model over several weeks and that thing got ripped apart by legal and data science (for good reason), not going to try that again. And there I had all the numbers and analyses down and verified, just the writing itself by Claude was subpar.

Can’t imagine the utter garbage that Claude will produce when you give it a simple prompt and let it write thousand of pages.

Kind of makes me wonder about all that AGI talk if these models can’t even the work of a good PhD or postdoctoral student.

Doesn’t recaptcha have localization? Not sure now that I think about it maybe not

I guess if you’re the mafia you just murder the competitors. Can’t have stronger regulation than that!

Just use mTLS via QUIC, it’s standardized, secure, future proof and has implementations in tons of languages and supports proper certificate checks and that whole ecosystem around it which they apparently tried to reinvent. It’s such a great protocol for these use cases, I don’t get why it’s not used more.

Landing page full of AI fluff, discussion feels very fake here, I would assume this is some upvote bot, nothing makes sense.

Lots of families there every year and older folks too, it’s actually a great date for a lot of IT folks as there aren’t many weeks when companies are effectively shut down, maybe even only this one week.

They will settle for what’s available at the time, I dont think it makes sense either but they will come up with something that is good enough for their purposes and as long as the copy parrots the original well enough it will pass.

The more interesting question is what happens once we replace manual labor with artificially intelligent robots and we arrive at a place where 99 % of human labor got eliminated. How do you maintain civil order? Every country is built on the premise that you have to “earn your keep” but what when that’s no longer true? Think about it, no labor, only capital. What will the people owning the capital demand of people that don’t own any? They won’t be useful to them in any way. I expect something like forced reduction of fertility for regulars to depopulate countries, while hyper rich individuals will extend their life spans and become immortal. And I don’t mean they will really survive but someone like Elon Musk will have their consciousness mapped to an AI and will instate that AI as their official heir. That sounds crazy but they will totally go for it just listen at what Peter Thiel is spouting in terms of immortality and becoming godlike. Hope people will have enough left to say to prevent that but right now it feels we’re going hardcore towards that scenario.

I guess what they really want is to limit sale of AI models to compliant vendors and then raise the bar to compliance just high enough so they can pass it but smaller labs can’t. There’s no moat, it’s an efficient market that drives margins to zero right now, of course they don’t want that, collusion of the big vendors is the next logical step.

There’s a whole legacy of wrapper interface generators like SWIG that are way more powerful than PyO3, QT is e.g. fully mapped to Python using a very powerful wrapper generator (SIP). PyO3 is just a really simple interface generator in comparison, look at what SWIG can do, or SIP, what PyO3 does is trivial in comparison.

They’re not running Rust they’re running machine code compiled with the Rust compiler. Like many other Python libraries such as numpy are running machine code compiled with C++, C or Fortran. That was always the case for Python and is its main selling point, it’s a slow but easy to write glue language that can make faster native code scriptable.

Also the article reeks of AI slop, it’s just trying to sell you a Rust course.

But he didn’t build the Oculus did he? Not sure what he worked on, software?

Also my experience, it works somewhat ok on large code bases that I designed and built myself before but after months of agentic development they sure start to degrade. I think if you start from scratch with agentic development there is no foundation for the models to anchor to.

Isn’t that the whole spiel of these things, you run all kind of text and other data through it and it kind of remembers it and learns from it then it spouts it back out like a human would. Makes sense to me that a training run based on conversations that were fed into the system by users is results in the model learning from these so the model will spit the knowledge back out again, just in a way that’s not directly attributable to the original content (which is the most important step as otherwise it would just be plagiarism). I guess that’s why OpenAI can get better and better as well so fast, people work with it and teach it how to do things by giving it feedback and iterating with it, and all that goes back into the training loop. And training data about millennium prize problems is probably quite spars. Wonder if anyone has tried injecting nonsense science into the training data (e.g. work out a fantasy science theory with names and all kinds of stuff) to see if the model will regurgitate it in a couple of months for other users.

I had qubit bring up and calibration fully automated with Python in 2011 including full spectrum measurements, lifetime characterization, Rabi/Ramsey measurements, calibration of single qubit gates and two qubit swap gates and full quantum process tomography, so not sure if AI is really needed there, curve fitting and some data logging is enough for this. Even had a nice LabVuew like GUI but with PyQT, it was quite nice. Still of course cool, I guess today I would just let Codex loose on some experiment goals but in the end my ability to produce results was mostly limited by the chip itself and the qubit lifetimes and theres no magic trick AI can apply to make these go up by a factor of 10. Still would’ve saved me a lot of time for routine programming tasks I imagine and that seems to be the main takeaway of the article. I guess name dropping quantum computing makes this sound cooler but in principle it’s just automation that you can apply anywhere, nothing quantum computing specific here.

Well OpenAI wants to maintain its edge and solving a Millennium problem is of course fantastic PR, and given that Anthropic seems to be working on that it’s not hard to imagine they wanted to be first. I don’t get how people buy into that whole “oh we heard models can solve Millennium prize problems now so we thought why not give it a go…” story - it’s a bit funny. This whole AI bubble is about hype and solving such problems is probably one of the best ways to keep this hype up so you can safely assume both OpenAI and Anthropic are using significant resources on these areas.

The USB C connector has like 24 tiny SMA pins how is that trivial? Under the microscope with soldering equipment from a lab maybe, at home this seems impossible and it will likely not work due to the high frequencies involved, I don’t think you can get the impedance right when hand soldering this back on.

Broke off my Pi 4Bs USB C port when using it to test link speed for new LAN outlets, when I wanted to reorder I realized the 4 GB version is now 120 EUR… Damn.

I don’t know, I am writing a modest 30 page paper with Fable and even after rounds and rounds of feedback and improvements there are so many things that are just plain wrong or weirdly out of place or just stupidly written that Fable 5.1 doesn’t seem to have any awareness of by itself that I don’t think it’s AGI, I think a human researcher can easily outclass it in writing and problem understanding. It definitely has super human capabilities but it lacks awareness or self reflection in my opinion.

For example it should be easy to tell it to not write a paper in the style of a clickbait SEO article or use all of its stupid hallmark AI writing patterns “it’s A, not B!” And a smart human that would be told that would be easily able to comply with that but the model needs to be told in a very detailed way and it seems to lack even basic capabilities to reflect on this, when explicitly given a sentence it will be able to rewrite it but otherwise it’s mostly blind to it. That’s to me a hallmark of it being overtrained on the specific tasks or problems so it appears very smart but once you go off script it still shows that it’s not a “real” mind.

Of course it’s amazing and has super human capabilities in many areas but if you honestly think it’s better than Einstein like some people suggest why can’t it write a simple “good” academic paper even after giving it specific examples and instructions.

Maybe that’s what makes these things dangerous, they have super human capabilities in some areas but apparently lack self awareness, taste and meta reflection abilities. The only reason people aren’t afraid more is that they don’t act in the physical world yet, imagine giving it a body, superhuman strength and letting it care for your child when it has a strong “urge” to comply with your exact request and little to no self awareness and human basic instincts.

Their browser workers won’t get blocked. Same with all big vendors, keep out small competitors enjoy access yourself and sell it to a select few partners.

Hard to decide between Star Trek computer voice, Glados or Jarvis, HAL would also be cool.

It’s crazy that their profit margin is above 50 %, before the AI craze I only knew such margins from drug trafficking cartels (supposedly).

I’m kind of cautiously excited for the next five to ten years, with these AI chips becoming incredibly fast and RAM capacities ramping up its in the cards that we’ll have chips like today’s ATMEL microprocessors that fit on a single board computer and can run small models locally, then all our gizmos can have local AI and I can have a truly intelligent home. Of course there will be a huge push to put all of it in the cloud but maybe we have a chance to take this technology home for good as it’s hard to imagine people will submit to this kind of surveillance required for AI home automation 24/7 (then again I might be wrong). Exciting times.

You should at least post a link.