Bark – GPT-style realistic multilingual text-to-speech generation

Re:Bark – GPT-style realistic multilingual text-to-speech ge... by gkucsko on Thursday April 20, 2023 @03:48PM (#35645306)

thanks, the model itself is a pretty vanilla gpt model based heavily on karpathy's nanogpt, so should not need too many bells and whistles to get it running on specific architectures. that said i have very little experience with platform specific development, so would looove some help from the community :)

[ Parent | on HN ]

Re:Bark – GPT-style realistic multilingual text-to-speech ge... by ttul on Thursday April 20, 2023 @05:29PM (#35646632)

A serious nod to Karpathy here. They could have chosen any other Transformer architecture, but chose perhaps the most reachable one - in the literal sense.

[ Parent | on HN ]

Re:Bark – GPT-style realistic multilingual text-to-speech ge... by brucethemoose2 on Thursday April 20, 2023 @08:32PM (#35648407)

Could you stick a torch.compile in the inference and training code, maybe gated behind a flag? This should help AMD/Nvidia performance (and probably other vendors soon) significantly.

PyTorch themselves used nanoGPT training as demo for this: https://pytorch.org/blog/accelerating-large-language-models/

[ Parent | on HN ]