Re:Smol Developer
by verdverm on Wednesday May 17, 2023 @12:19AM
(#35971203)
Ah ok, I'm primarily using the API already. One interesting thing is that the GPT-3.5 "product" is much faster, but looks to be using a different model in the request, their encoding model iirc. I wonder if they are now using embeddings to cache results to reduce load on the real models when they can?
[ Parent
| on HN ]
There are no comments on this comment yet.