News for hackers. Stuff that matters.

How can I use the new Llama models through an API?

I'm seeing a lot of options to use the new llama models through an API endpoint but which is the best way? For my use case I would want to first test the different models to see which is best and then ideally be able to use one of them at a large scale for cheap.

I may also need to fine tune some of the models so something that also provides an easy way to fine-tune one of the llama models and then serve that fine-tuned model would be nice. Looking for the most cost-effective options for now but would be interested in understanding features that more costly options would offer.

( 1 comment | 2 points | on HN )
Re:How can I use the new Llama models through an API? by cranberryturkey on Sunday August 18, 2024 @02:17AM (#41280490)