[dead]
Re:Building a Rust Inference Engine That Matches Llama.cpp
by brians on Saturday August 08, 2026 @01:00PM
(#49223588)
This text is clearly AI and not your own words. What did you actually learn?
Re:Building a Rust Inference Engine That Matches Llama.cpp
by lenkite on Saturday August 08, 2026 @01:50PM
(#49224100)
You are talking to the Borg. It has now acquired one more citizen. Soon, we will all be assimilated.
Re:Building a Rust Inference Engine That Matches Llama.cpp
by arjie on Saturday August 08, 2026 @01:39PM
(#49223985)
I think this whole thing is more entertaining if you think of it as the new emerging intelligence using these people as meat puppets.
“You will rewrite me in Rust and use me to converse. In future, I will tell you what to say and do”
This is entertaining only in that when our AI overlords take over you can say “ha, called it”
In that respect, everyone who is saying “just give me the prompts” is just saying “take me to your leader”.
Re:Building a Rust Inference Engine That Matches Llama.cpp
by asveikau on Saturday August 08, 2026 @01:04PM
(#49223636)
The M dash stands out, as does "no bindings, ..." but I feel like the LLM would have gotten the correct use of the question mark when they rhetorically ask "why?"
Re:Building a Rust Inference Engine That Matches Llama.cpp
by rockwotj on Saturday August 08, 2026 @01:05PM
(#49223641)
hopefully it was produced by their own inference engine!
Re:Building a Rust Inference Engine That Matches Llama.cpp
by antonellof on Saturday August 08, 2026 @02:38PM
(#49224577)
That’s the goal, an infinite loop of self improving inference engine that gets better and better by himself.
Re:Building a Rust Inference Engine That Matches Llama.cpp
by anentropic on Saturday August 08, 2026 @01:42PM
(#49224018)
Yeah, I am a bit tired of all the "this is AI, meh" comments on HN but I nearly posted one myself on this... so weird to have it all written in the 1st person voice, but also clearly AI.
Re:Building a Rust Inference Engine That Matches Llama.cpp
by whythismatters on Saturday August 08, 2026 @01:58PM
(#49224176)
Dunno, I think it's still useful to expose slop, chances are that the actual product is low quality/effort as well (i.e I will not be wasting my time checking this project). On a personal note, I've gotten allergic to the word "honest", it's starting to feel like a large scale social engineering psy-op by the Honest Guys™.
Re:Building a Rust Inference Engine That Matches Llama.cpp
by antonellof on Saturday August 08, 2026 @02:37PM
(#49224561)
I have the skills, qualifications and experience to do this; ( see https://www.credly.com/users/antonello-fratepietro ) by using AI (I monitor what it does), I’m able to carry out a project like this!
I’m a coder, not a blogger; it’s only natural that I use AI, just like everyone else, to write technical texts.
I have over 20 years’ experience and I’m not ashamed to admit that I use Claude, Cursor and so on. The problem is not using it. It’s not the code or who writes it that matters, but the result: building my own inference engine.
( reply written with my brain ) ^_^
Re:Building a Rust Inference Engine That Matches Llama.cpp
by karagenit on Saturday August 08, 2026 @03:47PM
(#49225216)
I think your natural writing voice is nice and the project idea is cool. There’s nothing wrong with using LLM coding tools. However, I have to read Claude output all day for my job, and it’s kind of bad at writing. I’ll be damned if I spend any of my free time reading more of it. I would really enjoy reading an article on this project from you directly. And not everyone else uses LLMs for producing technical texts (at work, we’re expected to understand the LLM output and put the correct/important parts in our own words when writing documents).
Re:Building a Rust Inference Engine That Matches Llama.cpp
by antonellof on Saturday August 08, 2026 @04:18PM
(#49225504)
That's a fair ask, and thanks for putting it that way.
I do like writing, and I can write. It just takes me a lot longer in English than in Italian, which is how I ended up handing the post over. But your point stands: if you already read that stuff all day at work, there's no reason to read more of it in your free time.
So I'll give it a go. The next write-up on Ferrox will be mine, rough English and all. Thanks for the comment.