torch.compile only works with python from what I understand. Many people need a native way to run GPU models, but don't want the bloat of full libtorch.