News for hackers. Stuff that matters.
Re:Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipe... by ufotalent on Friday January 19, 2024 @03:31AM (#39053017)
An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...
Re:Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipe... by QPHutu on Friday January 19, 2024 @03:39AM (#39053080)
Cool!