News for hackers. Stuff that matters.
Re:Ask HN: Why should I learn BERT/transformers/etc. when LL... by smoldesu on Monday May 15, 2023 @12:07AM (#35943791)
It's easier. Setting up a docker container[0] that replicates OpenAI's endpoints is faster than making an account from scratch with payment processing included.

Plus, I don't really trust OpenAI's data policies. Running the model locally gives me the option to airgap my inferencing machine if-needed, something OpenAI won't have until they offer on-prem.

[0] https://github.com/go-skynet/LocalAI

There are no comments on this comment yet.