Re:GPT-J-6B: 6B JAX-Based Transformer
by homedepotdave on Wednesday June 09, 2021 @05:22PM
(#27453389)
This is awesome Kindiana! Two quick questions.
1) GPU: Any tips for converting this to run on GPUs (inference-only)?
2) Speed: Any advice for achieving faster speeds? 10-13s is a bit tough for commercial applications. And, would you expect a big performance hit as well from running on GPUs?
[ Parent
| on HN ]
There are no comments on this comment yet.