News for hackers. Stuff that matters.
Re:Fly.io Has GPUs Now by niz4ts on Tuesday February 13, 2024 @07:45PM (#39364907)
Way simpler than what I was expecting! Any notes to share about Cloud Hypervisor vs Firecracker operationally? I'm assuming the bulkier Cloud Hypervisor doesn't matter much compared to the latency of most GPU workloads.
Re:Fly.io Has GPUs Now by tptacek on Tuesday February 13, 2024 @07:57PM (#39365012)
They are operationally pretty much identical. In both cases, we drive them through a wrapper API server that's part of our orchestrator. Building the cloud-hypervisor wrapper took me all of about 2 hours.