News for hackers. Stuff that matters.
Re:I Run LLMs Locally by bubaumba on Sunday December 29, 2024 @09:00PM (#42545662)
it may be even cheaper to use big models through API. Claude, GPT, whatever. Rental is efficient only for big butches, while API is priced per call/size and is cheap for small models.

There are no comments on this comment yet.