Re:Triton: Open-Source GPU Programming for Neural Networks
by king_magic on Wednesday July 28, 2021 @04:21PM
(#27989238)
The author is unfortunately wrong. NVIDIA's Triton was referenced in marketing material as far back as 2018. https://developer.nvidia.com/blog/nvidia-serves-deep-learnin...
Re:Triton: Open-Source GPU Programming for Neural Networks
by 0x008 on Thursday July 29, 2021 @05:35AM
(#27994552)
Are we sure that marketing article was not changed after the fact? The Nvidia Triton Release notes show 'Starting in release 20.03, TensorRT Inference Server is now called Triton Inference Server.' [0]
It kind of looks like the article just changed the heading later since in the article the docker images they refer to etc. are all still called 'tensorrtserver' which was the project's name before they changed naming in Release 20.03.
The OpenAI-Triton Author says on reddit: 'You can also look at the github history and you will see that there is no mention of the "Triton inference server" up until version 2.0, which wasn't out in 2019 (I ran `git reset --hard v1.9.0 ; grep -ir "triton" .`)' [1]
- [0]: https://docs.nvidia.com/deeplearning/triton-inference-server...
- [1]: https://old.reddit.com/r/MachineLearning/comments/otdpkx/n_i...
Re:Triton: Open-Source GPU Programming for Neural Networks
by king_magic on Thursday July 29, 2021 @09:45AM
(#27996453)
Eh, I suspect the author is mistaken here, but who knows, maybe that was updated after the fact? Hard to say who is right.
> PS: The name Triton was coined in mid-2019 when I released my PhD paper on the subject (http://www.eecs.harvard.edu/~htk/publication/2019-mapl-tille...). I chose not to rename the project when the Triton inference server came out a year later since it's the only thing that ties my helpful PhD advisors to the project.