Re:Quadrillion-parameter transformers and how to train them
by ACCount39 on Sunday November 08, 2026 @10:37AM
(#50414179)
No room - or is there?
FractalDB proves that "synthetic data useful for training AI" can be produced by a very small program.
There is "no room" in DNA for a full dataset, or a full snapshot of model weights. But there's plenty of room for "this one little trick cuts the data required to learn a desirable thing X in half". Low Kolmogorov complexity, but high performance gains.
FractalDB proves that "synthetic data useful for training AI" can be produced by a very small program.
There is "no room" in DNA for a full dataset, or a full snapshot of model weights. But there's plenty of room for "this one little trick cuts the data required to learn a desirable thing X in half". Low Kolmogorov complexity, but high performance gains.