Re:Accelerating Generative AI with PyTorch II: GPT, Fast
by jasonjmcghee on Thursday November 30, 2023 @03:29PM
(#38478638)
Programmatic and multi-step use cases. If you need chain-of-thought or similar, tool use, etc. Generating data.
Most use cases outside of classic chat.
For example, I made an on-demand educational video project, and the slowest part was by far the content generation. RAG, TTS, Image generation, text rendering, and video processing were all a drop in the bucket, in comparison.
It would be an even wider gap now, and TTS is super-realtime, and image generation can be single step.
Most use cases outside of classic chat.
For example, I made an on-demand educational video project, and the slowest part was by far the content generation. RAG, TTS, Image generation, text rendering, and video processing were all a drop in the bucket, in comparison.
It would be an even wider gap now, and TTS is super-realtime, and image generation can be single step.