Re:Starting from scratch: Training a 30M Topological Transfo...
by tuned on Monday January 19, 2026 @01:39AM
(#46675678)
it most-likely will in terms of performance as it uses 50% less memory (for sure it will at inference time that is the most used operation on web services), because it can leverage longer T and D if the design is confirmed and the quality of generation is comparable to other models.
If this very basic assumption is correct, it means a lot of savings in electricity as the same GPUs can resolve more requests.
[ Parent
| on HN ]
Re:Starting from scratch: Training a 30M Topological Transfo...
by throwaway314155 on Monday January 19, 2026 @07:01PM
(#46686283)
By performance, I meant the accuracy of the model, not the runtime/memory characteristics.