Re:Grok: Searching X for "From:Elonmusk (Israel or Palestine...
by diggan on Friday July 11, 2025 @04:53AM
(#44529823)
> despite clear demand for that from developers
Theorizing about why that is: Could it be possible they can't do deterministic inference and batching at the same time, so the reason we see them avoiding that is because that'd require them to stop batching which would shoot up costs?
Theorizing about why that is: Could it be possible they can't do deterministic inference and batching at the same time, so the reason we see them avoiding that is because that'd require them to stop batching which would shoot up costs?