News for hackers. Stuff that matters.
Re:Show HN: I made a GPU VRAM calculator for transformer-bas... by rdedev on Tuesday December 26, 2023 @08:57PM (#38778243)
Ah my bad. I am using mixed precision training in the my previous comment.

You might find this paper interesting: https://arxiv.org/pdf/2010.06192.pdf

There are no comments on this comment yet.