News for hackers. Stuff that matters.

A comment on How fast can one reasonably expect to get inference on a ~70B model?. Parent comment

Re:How fast can one reasonably expect to get inference on a ... by yungtriggz on Monday May 27, 2024 @02:13PM (#40493141)
thanks, tried this to some mixed results. seems like they have caps on speed/rate limits etc if you havent spoken to them so might reach out
[ Parent | on HN ]

There are no comments on this comment yet.