News for hackers. Stuff that matters.
Re:NanoGPT by minimaxir on Wednesday January 11, 2023 @12:46PM (#34341607)
Additionally, in terms of the streamlining nanoGPT porports, HuggingFace's implementations play nice with optimization techniques such as ONNX/TensorRT, which will give you better performance than anything PyTorch-based even if minimal.

That doesn't mean an ONNX-ed nanoGPT won't be better, but the field of optimized text generation isn't as new as people claim.

There are no comments on this comment yet.