Re:I think Anthropic and OpenAI have found product-market fit
by zozbot234 on Thursday May 28, 2026 @05:23AM
(#48306593)
Have you tried it? It would be slow for sure, but the main limitation AIUI would actually be storing the context in RAM - models like Kimi and GLM have high demands there which limit your ability to get meaningful aggregate throughput via large batches.
[ Parent
| on HN ]