It says in the video that they run them on Together.ai
yeah, seems like they're renting (according to the info from the video), but doesn't it make the bill worse? I mean the provider makes money somehow, so it should be more expensive for revolut. I guess it's a lot anyway
Maintenance, capacity management and spares all add up, not to mention labour. If they have a requirement to maintain geographical diversity then that moves the needle significantly if they’re primarily based on the other side of the country.
I've quickly checked and guestimate of the rental would be ~250-300k per month for this kind of usage they claim to have. It's all based on open prices from together.ai. So probably it worth the switch for them afterall, I can imagine that 56 engineers can burn tokens for more than 300k per month
Are you assuming that they bought the hardware? because they could also be renting the metal off a provider, in which case they either pay by the hour or have a yearly commitment to save on costs.