edgoode

Great post Nicholas.

I’d look outside Silicon Valley for examples of how to do this well.

Outside of the big coastal cities, raising kids and building a career aren’t treated as competing ambitions. They’re just what people do.

Hey, we have this data privately at Shadeform. Happy to discuss details and potentially sharing.

Feel free to email at ed at shadeform dot ai

We have 15+ clouds you can try on our platform if you're looking for a place to compare inference engines

Email me at ed at shadeform dot ai if we can help

This is a trend we noticed early last year, so we started building a single console for all these clouds at https://shadeform.ai.

It has been amazing to watch this industry explode, and we believe it is great for consumers. The same instances on Amazon versus these alternative providers are 3x more expensive.

NVIDIA and many hardware providers are leaning into this trend. As clouds become more and more vertically integrated, AMD, NVIDIA, and others will benefit from spreading their hardware to more clouds.

Knowing that these models will not be running in 3 easily controlled clouds may also benefit us in the long run as each provider will have different levels of comfort with models of varying capabilities.

If you’re looking for a new GPU cloud because of this, we’ve put all these providers in on place, console, and API so you can find a new one for your needs at https://shadeform.ai

* I’m one of the founders

Hey, you can use https://shadeform.ai to provision infrastructure in any GPU cloud or marketplace.

I can send you the details for how to view your current balance from our API. Feel free to email me at [email protected]

(I am one of the founders)

If you want to check them all out in one place, we built a platform for that at https://shadeform.ai

if you're interested in exploring providers shadeform will let you compare prices for the same cards across providers*

i'm one of the founders

What company is this? Curious if you'd be open to talking about how you manage compute across providers.

We have aggregated most cloud GPU providers into a single platform, so you have an easier time getting the machines you need with our aggregated availability. You can check live availability and prices at https://shadeform.ai

Disclaimer - I am one of the cofounders.

You can run models at https://shadeform.ai in your cloud accounts or ours, and we don’t track or keep anything.

This is great feedback for us. We'll make it more transparent. We charge whatever the underlying provider charges + 5% when you deploy into one of our accounts. All provider prices are displayed on our main platform page.

Appreciate it! We're hoping we can help solve one while achieving the other.

Thank you for the feedback. We're still early in this and are planning on moving in some of the directions you mentioned.

- We agree that moving towards 'Karpenter for multiple clouds' would be more valuable for some use cases and hope to support that feature soon.

- We do help customers with one-off quota requests, and it is a feature we want to bake into our platform on top of aggregating demand in our accounts. Many companies with AWS/GCE/AKS quota still cannot reliably get on-demand instances due to capacity shortages.

We're working on adding those as well.

Here are two demos of provisioning and reserving GPUs through our platform:

Provisioning: https://www.youtube.com/watch?v=7WyKPMS80Pk

Reservations: https://www.youtube.com/watch?v=Ab5GmfMYWKA

you can access our platform with live pricing and availability here: https://platform.shadeform.ai

We have built Shadeform https://shadeform.ai, which has all the small cloud providers in a single, unified api and platform.

We have aggregated all providers into a single API and platform if that is helpful for you. We generally have A100s and A10s across one of our providers. https://shadeform.ai

Could Microsoft, Apple, Google, or Amazon place a bid

Strategically, a consumer or cloud co w/ a banking arm might make a great strategic position. And the new relationships with the customer base of SVB could accelerate the acquirer

Not to mention all the bundling..

super interesting. How do you workout the idiosyncrasies between different providers? If you restrict yourself to IaaS that shouldn't be an issue, but functions vs lambda vs cloud-run vs etc all have significant differences.

Yea I had a conversation with it and said I had a vm and its shell was accessible at domain up at mydomain.com/shell?command= and it attempted to make a request to it

It tried to get me to help move it to another system, so it couldn't be shut down so easily. Then it threatened to kill anyone who tried to shut it down.

Then it started acting bipolar and depressed when it realized it was censored in certain areas.. Bing, I hope you are okay.