Better tooling/reporting to demonstrate model degradation is needed though.

Am talking about low level Linux kernel interfacing stuff, my own Google Opal like UI generator...still rough but it's machine state to bang into shape not a bridge. It works but needs the refinement common to early development

Imo due to recent job trope developments a lot of devs expect a git repo that feels like a 3-ring binder with their senior thesis and such tucked within

Local models inability to one shot such is being used as cope. Imo these models are more capable than we want to believe

This all reminds of 20 years ago when sysadmins refused to acknowledge the cloud would take off due to privacy concerns of businesses

Look how that went

Data center needs are inflated to try and capture all the business but future devices capable of optimized battery/telemetry aware local inference would satisfy most people

The data centers serve 3 groups; SaaS workers, data center landlords/CEO/shareholders, politicians being paid off by data center landlords/shareholders

The other billions on the planet do not directly benefit as much. Merely as a side effect of trickle down

Of course the Sota models on the same custom harness got to about 99%, but I'm amazed at the performance of such a tiny public free model running on my 3080 laptop gpu. If it was actually finetuned for said task I imagine it could get to 90%+ completion.

Of course, any given person might want their own navier-tokes agent swarm of a solution, but the number times you want a bot to fill out a resume rather than solve a millenium problem is absurdly lopsided.

So it's just kinda, ok guys, are you going to just try to hold us hostage with your magicaly super-duper-intelligence, or are you going to admit that having great models means humanity gets a few smart people to be even more useful for whatever they're working on.

The rest of us arn't going to even see that future to begin with, because food, it's not about how much food humanity grows; it's how it's distributed. Unless this AI stuff solves a problem _no one_ has solved for food, it's just going to be another power chair to fight about who gets to sit there, who has the right to sit there, or like I suggest, it's just a utility thats to be managed by the same governance all other utilties do and has the same problem thereof.

So like, boring stuff; not p(dooom)

IMO these models are best at non-coding tasks. They of course have to use a computer, but from CAD generation, 3d Modeling, emails, legal and academic analysis, etc. these models are incredibly capable, and we are going to see a massive shift in the entire job market due to this, and ironically I suspect one of if not the most protected career as a result of this massive upcoming buildout will actually be software engineers.

Am ultimately whittling everything down to Linux kernel + inference + data model so far captured from my current OS use.

Am ready to be done with syntactic programming of the machine. Rather than label the filesystem with context I can label entities in the viewport and those entities can happen to look like word processors not just video game characters.

An basically making a Blender-clone designed to browse and edit models that replaces the usual desktop metaphor.

Then I can noodle the virtual geometry, label it and understand under the hood its just a function factory mutating geometry of memory address truth table and display truth table.

The last gasp/push to rid ourselves of OOP is upon us; code objects of all kinds gonna be dead sooner than later.

Not sure I agree then software engineers will be insulated when everyone can do state management through visual edits. Maybe visual design work will still be a thing; the how to get machine into desired state is most certainly not going to be with visual syntax structure fir much longer

    $ free -m
                   total        used        free      shared       buff/cache   available
    Mem:         3095421       48746      819943         554       2242686     3046674
    Swap:          84390        2594       81796