News for hackers. Stuff that matters.
Re:Cost Per 1M tokens Of Self Hosting Llama-3 by choppaface on Friday June 14, 2024 @01:28PM (#40682804)
Yeah but this article is terrible. First it talks about naively copy-pasting code to get “a seeming 10x speed-up” and then “This ended up being incorrect way of calculating the tokens used.”

I would not bank on anything in this article. It might as well have been written by a tiny Llama model.

There are no comments on this comment yet.