Ask HN: What is the cheapest ($/hour) H100 renting service with quick spin-up?

Posted by dtquad on Sunday October 27, 2024 @04:34AM
from the ask-hn dept.

Something that can be programmatically spun up and turned off in seconds would be ideal.

( 4 comments | 2 points | on HN )

Re:Ask HN: What is the cheapest ($/hour) H100 renting servic... by Gooblebrai on Sunday October 27, 2024 @06:02AM (#41961231)

I don't know about cheapest but Modal is quite convenient code-wise

[ Parent | on HN ]

Re:Ask HN: What is the cheapest ($/hour) H100 renting servic... by codemk8 on Sunday October 27, 2024 @09:24AM (#41962467)

Runpod with its python APIs.

[ Parent | on HN ]

Re:Ask HN: What is the cheapest ($/hour) H100 renting servic... by huevosabio on Sunday October 27, 2024 @08:10PM (#41966717)

Modal is excellent for prototyping and experimentation, but I find the queueing and startup times hard to stomach. Perhaps if I had a much bigger load it would be snappier.

[ Parent | on HN ]

Re:Ask HN: What is the cheapest ($/hour) H100 renting servic... by uncharted9 on Tuesday October 29, 2024 @01:30AM (#41979667)

https://cloud.vast.ai/

Seeing H100 going for $2.138/hr

[ Parent | on HN ]