Re:Thunder – A new compiler for PyTorch that can use many de...
by rasbt on Saturday March 23, 2024 @10:36AM
(#39800257)
Quoting from the readme, it embraces other executers, including torch.compile and also works with multiple GPUs:
> Thunder is a source-to-source compiler for PyTorch. It makes PyTorch programs faster by combining and using different hardware executors at once (ie: nvFuser, torch.compile, cuDNN, and TransformerEngine FP8).
Works on single accelerators and in multi-GPU settings. Thunder aims to be usable, understandable, and extensible.
> Thunder is a source-to-source compiler for PyTorch. It makes PyTorch programs faster by combining and using different hardware executors at once (ie: nvFuser, torch.compile, cuDNN, and TransformerEngine FP8).
Works on single accelerators and in multi-GPU settings. Thunder aims to be usable, understandable, and extensible.