News for hackers. Stuff that matters.

nharziro

Re:Concerning behavior from a popular open-weight AI model on Monday October 26, 2026 @04:11PM (#50250193)
This is why all the big companies are building custom harnesses.
can you be more specific. If the code is not a mess, how is the resulting product a mess?
100%. Thinking tasks cost money now. Some colleagues and I were having this very conversation this morning. Universities don't have the resources to access unlimited compute to do this kind of work. There are a lot of very cool projects being done but it's always like I'm spending 50k in tokens for X project.
Algeria-goals.com
this is getting ridiculous.
this is so cool! i love it.
Most humans can't and don't ask these questions.
Re:Building a RAG pipeline for semantic code search on Sunday October 04, 2026 @05:24PM (#49958037)
You should be reviewing code generated by llms for this kind of shit. Also scope your changes. All of this stuff is preventable if you're reviewing your code and having your llm review your code. You can setup skills for the review agent to use to look for these things.
Re:Cf: The Agentic CLI for the Cloudflare API on Monday September 28, 2026 @09:54PM (#49887095)
I couldn't figure out why Microsoft wrote Github copilot CLI in typescript either.
Re:What AI-Native Looks Like on Wednesday September 23, 2026 @09:56AM (#49816267)
I didn't find her article hard to understand. Maybe you have a reading comprehension issue?
Not OP, but I ported a legacy .NET WebForms application to Blazor. The actual code migration was completed over roughly a 48-hour period, followed by fairly extensive testing.

We were fortunate to already have a strong end-to-end test suite written in Python, so we could run the new application against the same tests and verify that the existing functionality was preserved. QA found around 20 bugs, which we fixed pretty quickly before launching.

After the migration, we also moved the application's authentication from Shibboleth to Entra OAuth and deployed it to our OpenShift infrastructure. We couldn't do that with the old WebForms application because our cluster doesn't have Windows worker nodes, so the legacy app had been stuck running on VMs. Getting it onto OpenShift gave us another operational and cost-saving benefit beyond simply modernizing the codebase.

I did this back in January, when the models finally became capable enough for this kind of work. I believe I used GPT-5.2 through Codex. Successfully completing this project is what finally got me fully on the AI bandwagon. I had used AI before, but mostly for smaller tasks like writing code, refactoring individual methods, or making isolated changes.

The application is now modernized, more stable, faster, and more functional than it was before.

I think the project worked as well as it did for two important reasons. First, I had deep domain expertise in both the application and its surrounding systems because I was the original developer. Second, our QA team's test suite was comprehensive enough to validate the functionality that actually mattered. AI dramatically accelerated the work, but there still needed to be someone who understood what the application was supposed to do and a reliable way to verify that the new implementation behaved correctly.

None of this means we couldn't have done the migration without AI. We absolutely could have. The difference is that AI made it possible to do it at practically zero cost in terms of engineering time and money compared with the alternatives.

We had wanted to move away from WebForms for years, but with the size of our team and the constant stream of new feature requests, there was never a realistic opportunity to stop development for months and focus on a rewrite. I estimate that doing the migration myself without AI would have taken at least six months to do properly. The other option would have been hiring a contractor, which I would estimate at $80,000 or more over six to nine months.

Based on my token usage, those roughly 48 hours of working with Codex to port the application cost about $150. Those were January prices, so I don't know what the equivalent cost would be today.

For me, that was the project that changed AI from something useful for assisting with individual coding tasks into something I saw as capable of fundamentally changing the economics of software engineering work.

Re:My Thoughts on AI and LLMs on Friday September 18, 2026 @08:15PM (#49761975)
I don't think ai can annihilate us from a misalignment issue but I think there exists a real risk of real world disaster caused by one of these poorly executed benchmarks. They don't seem to be too aware of what they're up to when they let them run for days and days and I could see a scenario like huggingface but for something that matters. Dumb ai is more dangerous than anything right now.
Re:My Thoughts on AI and LLMs on Friday September 18, 2026 @08:12PM (#49761959)
What issues specifically did mRNA shots cause?
Re:My Thoughts on AI and LLMs on Friday September 18, 2026 @08:11PM (#49761952)
It's closer to 10 million and likely far more.
It's extremely hard to parse what you're trying to say.
They are not justified in the least bit.
We're probably not as special as you think.
Re:We Are Still Living in the Broken World Sept. 11 Created on Thursday September 10, 2026 @02:39PM (#49648400)
lol, me too. I still have the paper i wrote from 20+ years ago on this subject.
Re:Tell HN: OpenAI keeps re-enabling the 'allow training' setting on Thursday September 10, 2026 @11:49AM (#49645788)
they are doing this with auto-recharge of credits as well causing people to rack up thousands of dollars unintentionally.

https://github.com/openai/codex/issues/31987

Re:The Navier–Stokes Millennium Prize Problem on Thursday September 10, 2026 @12:16AM (#49638338)
This is like the mile record. Everytime someone breaks the existing one a bunch of people surpass the old record shortly after.
Well that's news to me because my model 3 in autopilot definitely does not stop for traffic lights or stop signs.
What exactly do you mean when you say llm generated code? Are people prompting llms for changes and features without reviewing the code or iterating on it and then comparing that to what human writes? Because if so it's not surprising that you're getting worse results. Humans also write code through iteration. You can definitely get llms to write good code by enforcing guardrails and constraints through tooling and agent.md, and iterative reviews to nudge towards what you want. The first pass will look nothing like the committed code. I don't expect the llm to one shot anything.
Re:GPT-6 Astra on Friday September 04, 2026 @08:36PM (#49571860)
I don't understand what you mean by novel intelligence or what people actually expect from these kinds of "Ai" but what novel intelligence can humans claim? Everything we know or learn is based on what someone else figured out. How are llms any different in that respect?
Re:Encoding Myself into the System on Thursday August 27, 2026 @02:09PM (#49468918)
I am interested, so please link it. I agree that our judgment is important, but I think these skills are themselves a form of judgment. The agent uses them to make decisions. It will never be perfect, but it is already pretty good.

My issue with this observation is that encoding ourselves into a codebase in the way I described is something our employers did not really get in the past. When you built something for an employer, they got the code and the end product. Sometimes that was a lot, but when an engineer left, they still took their skill set, experience, and judgment with them. Replacing that person was never guaranteed to work out.

Now, though, we are starting to leave behind much more of what made us capable of doing that job or building that product in a particular way. The code is no longer the only artifact. We are also encoding parts of our decision-making process, standards, patterns, and judgment into the systems surrounding it.

Re:Encoding Myself into the System on Wednesday August 26, 2026 @10:53PM (#49459000)
That’s determined automatically by the agent and the harness. Certain skills trigger on their own depending on the context and what the agent is doing.

For example, I have a '$rest-api-design' skill that acts as a guardrail whenever work involves the REST API. That same skill gets used at multiple stages of the process: when writing the ticket, when designing the feature, during implementation, and again as part of the final review.

A typical workflow might start with a meeting with a stakeholder. The meeting transcript becomes part of the context, and I have a skill that can pull that meeting directly into the harness. I may also provide some additional context about the feature that was not captured in the meeting and ask the agent to write the feature request.

From there, the agent may trigger other skills automatically. One of those gives it access to the project's .NET library. This is a full compiled .NET library, not just a collection of scripts. Since PowerShell itself runs on .NET, the harness can load the library DLLs directly into the shell and invoke their types and methods interactively. In practice, that lets the agent use the library almost like a CLI without me having to build a separate command-line interface for every operation.

That is useful because the agent can call into the same underlying code and abstractions that the application uses. It can use that capability to verify claims made in the meeting transcript or in my prompt, inspect existing behavior, query underlying systems, validate assumptions, retrieve data, or even put together a small proof of concept before it writes the ticket.

Once it has enough confidence in what is being requested and how the system currently behaves, it produces a Jira ticket for me to review. If I am satisfied with it, it can submit the ticket to Jira.

At a later point, I can pull that same Jira ticket back into the harness and ask the agent to implement it. All of the context captured in the ticket comes with it. At that point, the '$rest-api-design' skill triggers again and acts as a guardrail during implementation.

While it is writing the code, it also knows to call another skill I wrote called '$simplify'. That skill encodes a lot of my preferences around code structure, simplicity, readability, and style, so it further constrains how the implementation is produced.

Once the agent believes the work is complete, I can deploy it to test and go through the normal testing process. If everything looks good there, I run the implementation through a review process. That review invokes many of those same skills again to verify that the code follows the architectural, API design, and implementation constraints I have defined. By the end of that process, I usually have something I am pretty comfortable with.

Getting to this point took a lot of time and iteration. I have spent a significant amount of effort refining the skills, the 'AGENTS.md' instructions, the tooling available to the agent, and the context it can access. It also helps considerably that I have deep domain knowledge of the codebase because I built it from the ground up.

The system is not perfect, and I do not expect it to be. When I notice that the agent did something strange or violated one of the constraints, I usually go back and ask it something like, "Why did you do X, and why didn’t skill Y prevent it?"

It can usually give me a useful explanation of how it arrived at that decision and why the existing guardrail did not catch it. If I agree with that reasoning, I update the skill, the instructions, or the guardrail to cover that edge case.

So the process is iterative. When something gets through that I do not like I try to understand why the system allowed it to happen and then improve the harness so that the same class of problem is less likely to happen again. Over time, those failures effectively become new constraints and additional institutional knowledge encoded into the system.

P.S. I apologize for the wall of text.

Encoding Myself into the System

Lately, I’ve been thinking more seriously about what AI and automation may mean for my role as a software engineer.I’m a principal engineer at a large organization, and for more than a decade I’ve led a project that has always felt particularly close to me. I wrote nearly every line of code, aside from a handful of features built by interns over the years.What started as a single application...

( Read More... | 4 comments | 3 points | on HN )
why do people find comments like these necessary? What did you gain by making this comment?
Re:Show HN: Huzzah – a novel approach to coding with AI on Friday August 21, 2026 @03:55PM (#49393091)
I never said it was easy but it's clear that you're not coping well with new world order. Unfortunately for a lot people, it's here to stay do get used to it.
Re:Show HN: Huzzah – a novel approach to coding with AI on Friday August 21, 2026 @11:22AM (#49389513)
When I read stuff like this people I feel like people haven't yet accepted reality. I think knowing how to write code made a lot of people feel very special. Like the could do something magical, and now feel like that's being taken a way from them. I've been writing code since I was a child and spent my entire career as a software engineer, so I understand where these people are coming from, but the reality is AI has changed this profession and this skill set forever. People need to deal with this and move. You can still do very special things with AI that a "normal" person cannot do, so focus your energy there.
Re:Bun 1.4 Rust rewrite is not looking good on Friday August 21, 2026 @01:21AM (#49384114)
This comment aged poorly

Older »