News for hackers. Stuff that matters.
Re:Cost Per 1M tokens Of Self Hosting Llama-3 by logicallee on Friday June 14, 2024 @03:53PM (#40684402)
Super cool, thanks for sharing. Do you mind sharing what you used the hundreds of millions (or billions) of tokens on?
Re:Cost Per 1M tokens Of Self Hosting Llama-3 by hehdhdjehehegwv on Saturday June 15, 2024 @01:04AM (#40687632)
Doing really nuanced classification of documents at very large scale. Needle in the haystack type problems.