Re:Cost Per 1M tokens Of Self Hosting Llama-3
by choppaface on Friday June 14, 2024 @01:28PM
(#40682804)
Yeah but this article is terrible. First it talks about naively copy-pasting code to get “a seeming 10x speed-up” and then “This ended up being incorrect way of calculating the tokens used.”
I would not bank on anything in this article. It might as well have been written by a tiny Llama model.
I would not bank on anything in this article. It might as well have been written by a tiny Llama model.