Re:Copilot Internals
by varunkmohan on Sunday December 18, 2022 @05:45PM
(#34044802)
Most likely latency and cost reasons. A model that's 10x as big requires 10x the hardware to serve at the same latency. Since most generations are not too long, a smaller finetuned model should work well enough.
[ Parent
| on HN ]
There are no comments on this comment yet.