News for hackers. Stuff that matters.
Re:Meta AI releases Code Llama 70B by MacsHeadroom on Tuesday January 30, 2024 @06:58AM (#39189077)
Using a model 30% of the day is only maybe 100 instances of use, with each lasting for about 6 seconds.

So really you're looking at using the GPU for around 10 minutes a day.

Monthly cost is pennies.

There are no comments on this comment yet.