He basically said, "I know, there's nothing I can do."
This is a sparse matrix library, IIRC. Numerical linear algebra and applications using it are black art at this point. I have written a Boundary Element Method evaluator for my Ph.D., and know what it entails to work with these things.
Doing fast operations on sparse matrices is a cutthroat race and when you can shave your hot path by seconds, your solution can save hours in some cases. So, it's an interesting niche. i.e.: It's no ordinary boilerplate.
While I worked with dense matrices; the effect, difficulty, blood sweat and tears are still there.
When a model can give back your hard work back to you with a "completion" without attribution, that's bad.
These algorithms' design starts on paper, as pure maths. You get the analytic form, and convert this to numerical/discrete form and start to design from there.
You need to add normalization, subnormal number prevention, maybe some architecture specific optimization if you are targeting a specific CPU generation, etc. Then it gets optimized further as you run tests, profile the code and run your test cases.
So, no BLAS package looks the same, because they make different trade-offs, have different programming models, and handle things differently, at different points. Even more so, a newer generation processor with much higher FPU performance can have lower performance than previous generation, so you implement another copy of that function or add to detect that processor and have different paths just for that one.
IOW, when doing numerical maths on processors, esp. if you're doing this on many machines with MPI or multiple cores with hand rolled code or OpenMP, there's no single way. Maybe a best way for the specific CPU you have, but it still depends on the trade-offs and design choices you made in the very beginning.
The design of those macros is more art than science.
You’re disqualifying any example that people may provide preemptively. No wonder you’ve missed them.
By “forced continuation” I mean the type of example that was popular for a while where someone would feed a lot of text into LLMs and then ask it to continue the text, then be surprised when it some times predicted the next tokens identical to the original example.
Do this enough times and you can find “examples” that prove your point, but it’s highly automatable so people were using it like a million monkeys at a million typewriters.
Do you have some specific, actual examples you can share?
I’ve been hearing this exact claim for years, but every time I ask for a specific example, any example at all, I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.