How much does CoT Reasoning typically cost for frameworks like LlamaIndex?
I'm curious to know, based on your experience in production, how much does Chain-of-Though Reasoning typically cost in terms of tokens for frameworks like LlamaIndex, LangChain, CrewAI, etc.?
I understand it depends on many different factors including the complexity of the product and the architecture of the agents involved, but I'd love to hear about your experiences in creating real-world-class application.
(
4 comments
| 2 points
| on HN
)
but you could get a simple estimate by running a CoT prompt, copying the output tokens, and then using an online token counter to count the length & tokens of the CoT part of the completion
Anyway thanks for the response.
The issue is that this notion is nonsense. There are just problems nothing about them makes them “world class” whatever that means.