News for hackers. Stuff that matters.

hrpnk

Re:Strands Decider 2B: a small, open-source, decision model on Wednesday October 07, 2026 @02:21AM (#49989024)
clef from cloudflare runs on llama.cpp - being locked-in to strands cli would be a bummer and will slow down adoption.

Since it's a LoRa on Qwen, I assume this is runnable via llama.cpp. Pity that the PEFT/LoRa->GGUF translation is left to the user. Anyone got past:

    $ uv run --with transformers==5.19.0 convert_lora_to_gguf.py ~/Downloads/lora --dry-run --verbose
    [...]
      File "/Users/user/repos/llama.cpp/conversion/base.py", line 630, in map_tensor_name
    raise ValueError(f"Can not map tensor {name!r}")
    ValueError: Can not map tensor 'layers.0.linear_attn.in_proj_a.weight'
Re:GLM-5.3 and the spread of advanced cyber capabilities on Tuesday September 29, 2026 @04:36PM (#49900075)
Needing to have a full article with a comparison against an open-weight model just shows how much of a headache it has been internally.
If you are forced to ID check with the bank via a 3rd party, the only way is to ask for removal of data after the ID check. Do you see other ways?
I wished OpenAI and Anthropic IPOd already. They just try to outcompete each other by finding the most splashy headlines undercutting prices in unhealthy and unsustainable means long-term.
Even if the trigger was spoofed, how come there is no secure channel that the govt provides to receive the data? Was this one also compromised?
Re:An ongoing 3D-printer AGPL violation on Wednesday August 26, 2026 @03:34PM (#49454592)
What would the company need to do to comply with licensing? Release the studio, shared library, and server-side components as AGPL?
Re:Everyone is building LLM routers, we deprecated ours on Friday July 31, 2026 @04:38PM (#49128269)
Even the simplest router that differentiates models between plan & execute will ensure that this is consistently followed. Folks have too high FOMO to choose themselves.
Re:Claude Is Down on Wednesday July 29, 2026 @04:35PM (#49102714)
- write/update tickets & collect prompt queues for when it's back up

- read & respond to customer feedback

Re:Claude Opus 5 on Friday July 24, 2026 @03:23PM (#49040499)
The breaking changes vs. Opus 4.8 are interesting [1]

1. Thinking on by default: On Claude Opus 4.8, requests without a thinking field run without thinking; on Claude Opus 5, the same requests run with adaptive thinking.

2. Disabling thinking is capped at high effort: You can still turn thinking off with thinking: {type: "disabled"}, but only at an effort level of high or below.

[1] https://platform.claude.com/docs/en/about-claude/models/migr...

Re:Don't discontinue Gemini 2.5 Flash on Friday July 10, 2026 @07:18PM (#48866602)
The smell is about folks being attached to the same model because they're used to it. Just like any UI change in an app that one uses everyday is annoying.

What's often missing is the actual engineering. If you have evals for your use case, you use these to adjust to the new model. DSPy has great prompt engineering constructs it ships with.

The smell is all about vibing, where a model feels better because the structure of the answers is more familiar to a person, instead of engineering where given constraints and input/outputs one is using/bending the system to fulfil the requirements.

Re:Don't discontinue Gemini 2.5 Flash on Friday July 10, 2026 @05:07PM (#48865277)
I love how there is a "Please do not discontinue gemini-2.0-flash[-lite], 2.5 is NOT an equivalent" from Feb 20th. Getting too attached to models is a smell.
Re:GPT-5.6 on Thursday July 09, 2026 @03:27PM (#48851195)
They highlight the cache write price now much more in the guide. Did it increase vs. prior generations?
Re:Kimi K2.7 Code is generally available in GitHub Copilot on Thursday July 02, 2026 @03:42PM (#48766381)
There is literally no more reason to use their service. I don't need a monthly expiring token pool drained at API pricing which I can get from any provider.
Re:Kimi K2.7 Code is generally available in GitHub Copilot on Thursday July 02, 2026 @03:40PM (#48766355)
Wonder if this is a product decision or rather a limitation on GPUs. Their Inf2 instances require AWS Neuron [1]. Maybe porting models to run on their hardware takes too much time.

[1] https://aws.amazon.com/ai/machine-learning/neuron/

Re:Alibaba/Open-Code-Review on Friday June 05, 2026 @03:36AM (#48409276)
If budgeted at $1,500/month per user, power users still can get 5-10x of that allocation if the user pool is large enough.
$1500/mth is token pricing.

Your other plans are fixed price with rate limits where you get more tokens than the dollar equivalent you pay monthly. These plans are economical only if majority of users spend less tokens in $ than the plan's costs. This subsidizes the gap vs. power users who spend multiple k$ monthly in API tokens.

Wonder if folks will flock to competitors that still over fixed-price review packages only for those companies to switch to usage-based pricing. They're next to be overrun with new customers and sit on the increasing bills.
Re:GitHub Copilot is moving to usage-based billing on Monday April 27, 2026 @03:53PM (#47926483)
What's the residual value of Copilot after the changes? For Enterprise plans, even copilot code reviews will be charged at token price + github action minutes for the execution of the review. One can roll one's own reviewer and have it spend the API tokens as well. At least one will be able to select the subset of files for the change set, if needed.

The background agents will also depreciate in value because of their harness that's a black box that's not optimized for token usage at all. Rolling one's own will be a better choice here.

Re:GitHub Copilot is moving to usage-based billing on Monday April 27, 2026 @03:41PM (#47926343)
Why the multipliers then at all?
"Paperasse is a collection of skills for AI agents (Claude Code, Claude Cowork, Codex, Mistral Vibe, Cursor, Windsurf, Cline, Aider) specializing in accounting, taxation, notary services and auditing of French companies."
Re:OpenCode โ€“ The open source AI coding agent on Saturday March 21, 2026 @01:10PM (#47468933)
I wish the team would be more responsive to popular issues - like inability to provide a dynamic api key helper like claude has. This one even has a PR open: https://github.com/anomalyco/opencode/issues/1302
Are there any videos or screenshots of readout? The webpage is very minimalistic.

https://github.com/dlupiak/claude-session-dashboard - I found this one today, it shows me nicely basic statistics. Do you know the similar tool that would be showing also the interactions of sub-agents? I want to see the user prompts and also statistics by file which tools have touched or read them.

Re:OpenAI Symphony on Wednesday March 04, 2026 @04:20PM (#47254048)
The sample code is written in Elixir, however, they also release the full specs using which one can generate the application in the language of one's choice. I'm curious if this is really so straightforward.

Older ยป