Re:Alternative clouds are booming as companies seek cheaper ...
by zackangelo on Monday May 06, 2024 @08:27PM
(#40281018)
Yes we’re running our own inference server because we do nonstandard things in the decoder loop (think logit masking, other types of sampling, etc).
[ Parent
| on HN ]
There are no comments on this comment yet.