News for hackers. Stuff that matters.
Re:Bagel: The Open-Source Unified Multimodal Model by a_t48 on Monday May 26, 2025 @04:05AM (#44095126)
A float16 is 2 bytes. 7B * 2 bytes = 14GB. I can't say if that's an accurate number, but that's almost certainly how tonii141 calculated it.
Re:Bagel: The Open-Source Unified Multimodal Model by sfphoton on Monday May 26, 2025 @04:11AM (#44095157)
Oh, so FP16 means FloatingPoint16? I'm glad to learn something today, thanks!