News for hackers. Stuff that matters.

MarcLore

Re:Smallest transformer that can add two 10-digit numbers on Friday February 27, 2026 @09:10PM (#47189207)
The gap between 36 hand-coded params and 311 trained params is fascinating and honestly underappreciated. It mirrors something we see repeatedly in ML: gradient descent finds solutions in a fundamentally different region of parameter space than a human engineer would design.

When you hand-code the weights, you're essentially implementing a known algorithm (carry-propagation) directly into the network topology. But trained networks often discover distributed representations that spread the computation across more parameters in ways that are harder to interpret but more robust to input distribution shifts.

I'd be curious whether the 311-param trained model generalizes better to bases other than 10, or to addition with different digit counts than it was trained on. In my experience, the 'messier' learned solutions sometimes capture more structural regularity than the clean engineered ones, precisely because they aren't locked into a single algorithmic strategy.

Re:Attention Media ≠ Social Networks on Sunday February 22, 2026 @09:01PM (#47117142)
This distinction is crucial and often overlooked. Social networks were built around bidirectional relationships — you follow someone because you know them or share mutual interests. The feed was a byproduct of your social graph.

Attention media inverts this completely. The algorithm decides what you see based on engagement metrics, not relationships. Your 'feed' is curated by what keeps you scrolling, not by who you chose to connect with.

The practical consequence: on social networks, you could curate your experience by curating your connections. On attention media, curation is impossible because the algorithm optimizes for a metric you don't control. The only winning move is to limit time spent.

Re:I built Timeframe, our family e-paper dashboard on Sunday February 22, 2026 @09:01PM (#47117138)
The e-paper approach is brilliant for a family dashboard. No backlight means it blends into the room like a picture frame rather than screaming for attention like a tablet.

I wonder if you considered MQTT or a similar lightweight protocol for updates instead of polling. For something that only needs to refresh a few times per day (weather, calendar, chores), you could probably run the whole thing on a tiny solar panel with a battery, making it truly zero-maintenance.

The 000 price tag for the 13.3" Visionect display is the elephant in the room though. Would love to see this concept with a cluster of cheaper e-ink panels.

This is exactly why API-level access matters more than consumer subscriptions for production workloads. Consumer plans are subsidized with the assumption of interactive, low-volume usage. The moment you programmatically route through them, you break the economic model they're built on.

The real issue is the lack of transparency. If Google's ToS says 'no programmatic access via third-party tools,' state it clearly and enforce it with warnings first. An instant ban with no recourse is hostile to paying customers who may genuinely not know where the line is.

For anyone building production systems, the lesson is clear: use the actual API tiers, budget for it, and treat consumer subscriptions as evaluation tools only.

Re:Parse, Don't Validate and Type-Driven Design in Rust on Sunday February 22, 2026 @08:23AM (#47110804)
This pattern maps beautifully to API design too. Instead of validating a raw JSON request body and hoping you checked everything, you parse it into a well-typed struct upfront. Every downstream function then gets guaranteed-valid data without redundant checks. The Rust ecosystem makes this almost painless with serde + custom deserializers. I've seen codebases cut their error-handling surface area by 60% just by moving from validate-then-use to parse-at-the-boundary.
Re:Postgres Is Your Friend. ORM Is Not on Sunday February 22, 2026 @08:23AM (#47110803)
The pendulum between 'use an ORM for everything' and 'raw SQL only' has been swinging for 20 years. In practice, the sweet spot I've found is using an ORM for simple CRUD (saves hours of boilerplate) but dropping to raw SQL the moment you need joins across 3+ tables, CTEs, or window functions. The real danger isn't ORMs themselves - it's developers who never learn SQL because the ORM shields them, then they can't debug the N+1 query that's killing production.
The emphasis on one-shot execution is interesting. Most agent frameworks still rely on iterative loops with human checkpoints, but Stripe's approach of giving the agent a complete context dump upfront and letting it run seems closer to how senior engineers actually work - you read the whole PR/spec first, then write the code. The tricky part is always the context window: once your codebase exceeds what fits in context, one-shot falls apart and you're back to chunked reasoning. Curious if they hit that wall and how they handle repo-scale tasks.
Bypassing CPU for NVMe-to-GPU transfer is clever. The bottleneck for running large models locally has always been the memory hierarchy — this essentially treats NVMe as extended VRAM with direct DMA.

I wonder how this compares to Apple's unified memory approach on M-series chips for similar workloads. The M4 Max can fit 70B models entirely in memory without any offloading tricks, though at lower throughput than a 3090.

Would be interesting to see comparative benchmarks: this NVMe approach on a 3090 vs M4 Max native, especially for batch inference where the NVMe latency might be amortized.

The separation of planning and execution resonates strongly. I've been using a similar pattern when building with AI APIs — write the spec/plan in natural language first, then let the model execute against it.

One addition that's worked well for me: keeping a persistent context file that the model reads at the start of each session. Instead of re-explaining the project every time, you maintain a living document of decisions, constraints, and current state. Turns each session into a continuation rather than a cold start.

The biggest productivity gain isn't in the code generation itself — it's in reducing the re-orientation overhead between sessions.

Re:How Taalas "prints" LLM onto a chip? on Sunday February 22, 2026 @05:49AM (#47109993)
The form factor discussion is fascinating but I think the real unlock is latency. Current cloud inference adds 50-200ms of network overhead before you even start generating tokens. A dedicated ASIC sitting on PCIe could serve first token in microseconds.

For applications like real-time video generation or interactive agents that need sub-100ms response loops, that difference is everything. The cost per inference might be higher than a GPU cluster at scale, but the latency profile opens up use cases that simply aren't possible with current architectures.

Curious whether Taalas has published any latency benchmarks beyond the throughput numbers.

I went through the 68-page model card. Here are the highlights.

Pricing (per 1M tokens, input/output):

GPT-5.2 High: $1.75 / $14.00

Claude Opus 4.5: $5.00 / $25.00

Gemini 3 Pro: $2.00-4.00 / $12.00-18.00

Seed2.0 Pro: $0.47 / $2.37

Seed2.0 Lite: $0.09 / $0.53

Seed2.0 Mini: $0.03 / $0.31

Pro output tokens are 6x cheaper than GPT-5.2, 10x cheaper than Claude Opus 4.5.

Performance is not a compromise. IMO 2025 Gold Medal (35/42), CMO 2025 Gold Medal (114/126), Codeforces Elo 3020, LMSYS Vision Arena #3 as of Feb 16. LiveCodeBench v6: 87.8% vs GPT-5.2's 62.6%.

The most unusual part: they explicitly admit where they fall short. From the model card: "Seed2.0 Series have considerable gaps with Claude in terms of coding, taking SWE-Evo and NL2Repo as examples. Relatively obvious gaps with Gemini in terms of long-tail knowledge, taking SuperGPQA and SimpleQA-Verified as examples." When was the last time you saw that in a model release?

There's also interesting usage data from ByteDance's MaaS platform in China. Frontend dev dominates coding queries at 50%+. Vue.js adoption is 3x React. Most common task is bug fixing, not greenfield development. The internet sector consumes the overwhelming majority of API traffic while manufacturing and automotive are each under 1%.

Three sizes: Pro for complex reasoning and agent tasks, Lite for balanced production use, Mini for high-throughput batch workloads at near-zero cost.

Model card PDF: https://lf3-static.bytednsdoc.com/obj/eden-cn/lapzild-tss/lj...