thomasahle
It supports chat via 3 separate mechanisms:
- CPU contention
- Cache eviction timing
- DRAM bandwidth contention
Very cool to see this kind of hypothetical working in practice
But I took OP to just worry about absolute growth in real wages.
How much, presumably, depends on their bargaining power, such as unions or low unemployment.
The question is not so much how AI affects productivity, but how it affects the economic value of human labor.
If you scale a model down, or switch out attention with linear attention, or introduce KV-compression, etc., you don't really know how it will affect model performance before you've trained the model.
And once you've spent millions training it, you might as well make it available if it's pareto optimal for some tasks. It also gives you more insight seeing how people use it in practice.
Unless you have special insight, you should assume all stocks are equally good buys.
There's not going to be an IPO at a price where everyone agree that it'll see a 30% growth over 30 years. Obviously that'd be priced in.
But now with AI I guess you could just ask it to debug the issue and it would decompile Word in 5 minutes and pull out the fix.
Not sure what the frustrations with typography were, but I recon they're a lot easier to fix now.
This skill and behaviour seems to transfer to scenarios where the agents weren't meant to work as a team.
I had one dentist tell me I needed 6 cavities filled. Let him do two and then went to another dentist who told me all my teeth were good. I've only ever had problems with the two teeth the first guy drilled.
Later a dentist wanted to drill another few teeth that were hurting. I instead got a better toothbrush and all the issues went away.
I Denmark we're talking about including dentistry in the national healthcare. I wonder if that will clean up the business or make it worse.
"Open problems are lighthouses not destinations" mean that these are currently not well explained by the theories and people should look into extending the codebase on that direction.
The current generation of math AI is not a "good citizen" in that it doesn't try to make the most elegant additions to the shared framework, but will often just rebuild everything from scratch til get to some endpoint.
Sure, we learned if the statement is true or false; but the proof can't be merged into the pure math codebase unless it's completely rebuilt. This is thankless work that humans are unlikely to want to do, and so the "solution" instead risks leaving a desolate patch of land, where existing efforts in extending the codebase lost their motivation.
As with all things AI we can't take more than a 1-3 year horizon, if even that much. Probably AI will become better at respecting and working within the existing theories as it has with large software codebases.
Where do you see signs of this happening?
Is OpenAI going to pay for the food and health of mathematicians who lost their job?
It might be alright to go into some post scarcity society and do math for fun. But it seems to be a pretty unlikely scenario unprecedented om history.
I asked GPT here: https://chatgpt.com/share/6ac5fd7d-0390-83ed-a02a-6d80fc64f6... and it says:
> the exact Barnette argument appears quite novel, but nearly every ingredient in its cancellation trick has a recognizable ancestor.
> The closest precedent is much closer than I expected: in fully packed O(n) loop models, people have been assigning complex phases to the two orientations of a loop and making them cancel for decades. At n=0, the phases are literally +I and -I. And the n->0 limit has specifically been used to extract Hamiltonian cycles/walks.
You can judge better than me. But it's definitely worth it having a research assistant AI with you when reading these papers.
Most of what the labs are pursuing with "Recursive Self Improvement" is basically improving the underlying algorithms.
Apparently, an employee at Anthropic was trying to prove a hardness result in cryptography (average-case hardness of Zero-k-Clique), but Claude instead developed this algorithm.
Anthropic then shared the result with Josh Alman and Virginia Vassilevska Williams for verification, the authors of most recent breakthroughs in fast matrix multiplication. (They are shown in this cartoon: https://www.smbc-comics.com/comic/mathematicians)
As far as I can tell, the idea is to interpret rectangular matrix algorithms like Schonhage's as a tree, and then very carefully extract only some of the entries. This way you can compute N^2/√D positions of an (N×D)×(D×N) matrix multiplication in subquadratic time, O(N^2/D^0.063)
You can't unit test your way out, but if you care about the code's correctness, today there's a way.
h(x1, x2, ...) = T[1, x1] ^ T[2, x2] ^ ...
but most fast hashes are actually algebraic, typically using polynomials in some way. I'm not sure they fit into the same pattern?We analyzed 30 popular hashes and found Key-independent collisions in nearly all of them. E.g. xxh3 has pairs that collide with probability 2^{-10}, much higher than the 2^{-64} you'd expect.
However some fast hashes are good on all inputs, and we were able to verify it in Lean.
GNATprove uses SMT solvers, meaning it's basically a brute force proof system.
Yes, brute-force proofs are easier than symbolic proofs (lean, bend, etc.) because you don't have to supply a proof. It's all automatic.
But brute-force proofs don't scale to nearly anything of interest, which is why formal verification has been a niche field for 30 years, until now where LLM can write _actual_ proofs.
P_i = x_{2i} + (x_{2i+1} + z^3)(P_{i-1} + z^2)