Re:Anthropic - Introducing 100K Token Context Windows, Aroun...
by dragonwriter on Friday May 12, 2023 @12:13AM
(#35911815)
> It's the throughput compared to humans that is the true differentiator. If hooking up the API in a loop up ends up costing more than a human, then it's not worth it.
If its better in another dimension (e.g., calendar elapsed time), it may well be worth being more expensive.
If its better in another dimension (e.g., calendar elapsed time), it may well be worth being more expensive.