News for hackers. Stuff that matters.
Re:Ask HN: How does deploying a fine-tuned model work by Oras on Wednesday April 24, 2024 @02:56AM (#40141459)
For the inference part, you can dockerise your model and use https://banana.dev for serverless GPU.

They have examples on github on how to deploy and I’ve done it last year and was pretty straightforward.

Re:Ask HN: How does deploying a fine-tuned model work by JayeshSidhwani on Wednesday April 24, 2024 @03:10AM (#40141536)
Followed this link to banana.dev. It appears that the company has sunset the product: https://www.banana.dev/blog/sunset