News for hackers. Stuff that matters.
Re:OpenAI announces leadership transition by sodality2 on Friday November 17, 2023 @05:27PM (#38311378)
Batched inference makes these calculations hard - roughly takes the same amount of power and time for one inference vs 30 (as i understand it)

There are no comments on this comment yet.