News for hackers. Stuff that matters.
Re:Has LLM killed traditional NLP? by HarHarVeryFunny on Sunday January 19, 2025 @10:44AM (#42757993)
10M items @ 10 tokens each ("20 bottles of ferric chloride" etc) plus 10M tokens out (category) is 100M tokens in 10M tokens out.

Claude Haiku is $0.25 per 1M tokens in, $1.05 per 1M out, so cost would be ~$35.

GPT-4o mini is even cheaper at $0.15 per 1M in.

Of course if your volume justifies the hardware cost you could always run Llama locally, for the cost of the electricity used.

There are no comments on this comment yet.