Re:Ultra Fast Bert
by sroussey on Wednesday November 22, 2023 @02:16PM
(#38383767)
You can do that today, the only advantage today though is being able to fix the model in memory. It’s sequential and slower due to communication costs, though batching might be faster?
[ Parent
| on HN ]
There are no comments on this comment yet.