News for hackers. Stuff that matters.
Re:OpenAI Completes Deal That Values Company at $157B by vrighter on Thursday October 03, 2024 @06:31AM (#41729248)
70 somethings per second, is slow. So that means it does take a very significant amount of resources, considering it's running on the same or better hardware. To sustain 70 things per second for thousands of users, it gets expensive really quickly.
Re:OpenAI Completes Deal That Values Company at $157B by lukev on Thursday October 03, 2024 @01:38PM (#41732903)
My point is that at current API pricing the users are paying enough to cover inference costs.