wild_egg
> Will we converge on a bug free state?
I have never witnessed this state in my two decades of software work. Why would we think AI will magically achieve this?
Weird. I distinctly remember Commodore 64, DOS, and Windows 3.1 at school. Kind of hard to use Windows 95 before 1995, but I am pretty sure I had a Windows 98 SE machine at home when my school finally got Windows 95.
LLMs work on tokens. They literally cannot see individual letters. Yet, unlike humans, they can instantly create a tool to solve this task for them and never be stumped by it again.
I'm so tired of this brain-dead gotcha comment.
For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.
Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.
I was very excited last year for their coding plan but seeing a burst of requests pulse and then sitting there watching the cooldown reset is really not a great time.
Even though each individual request was fast, the sessions were only maybe 10% faster on wall clock time since there was so much waiting time.
Again, we are not talking about agents or your Python API script but instead talking about exploitable flaws within the inference engine itself. It wouldn't output `rm -rf`. It would output literal CPU instructions that llama.cpp would start executing directly. The payload would never get back to your Python script.
Even having emacs just there in their environment, most people would avoid it because they don't know what it is, and will open Notepad or TextEdit or whatever familiar program is at hand.
Are there seriously any emacs users who are completely unaware of elisp? Isn't elisp the entire point of picking emacs?
If you give that to an LLM, it is then also able to iterate and develop faster.
The niche language thing is really not a problem at all any more. If you're working in some esolang it doesn't take more than a 1-2k token primer in the context to get great results, and lisp is popular enough to not even need that.
The benefit of having the agent directly in the image like with Autolith here is that it can directly inspect all defined symbols and explore and orient itself automatically. Really doesn't need much guidance to get great results.
For me, it's a law of diminishing returns thing. I would (and have) hand roll assembly if I want actual speed.
But we are talking about personal software. Write once, run everywhere browser's exist with essentially no tooling or complexity or deployment concerns.
What does writing everything in rust get me instead that is worth the significant increase in effort and dev time and deployment?
I run all my apps on my desktop and access them over tailscale. All web apps and I install on phones as PWAs. Super ergonomic.
As for this:
> Local software runs faster
What? Why? Is this some assumption about network requests?
None of my personal software ever has a loading spinner or lag. If it's designed well, each interaction should fit in a single TCP packet so network round trip is imperceptible.
If your web software is slow, that's a choice you've made. Plenty of slow local software around to balance the scales too.
EDIT: Using local files with a web stack is also easy these days. The only con of web software is lacking that native aspect. But native appearance is rare anyway these days with every company just shipping electron bloatware.
It's really easy to do this with server rendered HTML. Put a link with the sort param in the column headers and be done.
It's very rare that I reach for local software these days.