Learnings from fine-tuning LLM on my Telegram messages

Re:Learnings from fine-tuning LLM on my Telegram messages by jsight on Monday November 27, 2023 @04:19PM (#38438476)

I think Tensordock and vast.ai are cheaper than AWS. Lambda labs can be as well, but they seem to only have reserved instances now.

[ Parent | on HN ]

Re:Learnings from fine-tuning LLM on my Telegram messages by cosmojg on Monday November 27, 2023 @05:13PM (#38439171)

runpod.io is another good-and-cheap option

[ Parent | on HN ]

Re:Learnings from fine-tuning LLM on my Telegram messages by cheptsov on Tuesday November 28, 2023 @12:57AM (#38442830)

We are building dstack.ai, an open-source tool that helps run anything on vast.ai and TensorDock. Happy to hear your feedback.

[ Parent | on HN ]

Re:Learnings from fine-tuning LLM on my Telegram messages by oliverx0 on Tuesday November 28, 2023 @05:59AM (#38444526)

Happy user of dstack.ai. The simplicity of just spinning up a machine with my required set of GPUs and memory, from my vendor of choice, and have an endpoint to easily access it via ssh and VSCode has been game changing for me.

I once had some trouble setting it up and the founder literally went on a zoom chat with me to help navigate through things. Couldnt recommend them enough!!

[ Parent | on HN ]