News for hackers. Stuff that matters.
Re:GPT-J-6B: 6B JAX-Based Transformer by homedepotdave on Wednesday June 09, 2021 @05:22PM (#27453389)
This is awesome Kindiana! Two quick questions. 1) GPU: Any tips for converting this to run on GPUs (inference-only)? 2) Speed: Any advice for achieving faster speeds? 10-13s is a bit tough for commercial applications. And, would you expect a big performance hit as well from running on GPUs?

There are no comments on this comment yet.