Re:AI Dungeon 2 costing over $10k/day to run on GCS/Colab
by aianus on Sunday December 08, 2019 @10:23PM
(#21740154)
All of the load balancers on GCP are shared. Maybe you meant to say you get a new, fresh IP address which is true but also not very expensive.
"Cloud Load Balancing is a fully distributed, software-defined, managed service for all your traffic. It is not an instance- or device-based solution, so you won’t be locked into physical load balancing infrastructure or face the HA, scale, and management challenges inherent in instance-based LBs."
Re:AI Dungeon 2 costing over $10k/day to run on GCS/Colab
by pm90 on Sunday December 08, 2019 @11:38PM
(#21740429)
Nothing in the paragraph indicates it’s shared. Also: it might be shared in the implementation but you will still be billed for every single https LB that you use (or an NLB if you’re doing tcp load balancing).
Every unique kubernetes ingress resource WILL spin up a NEW, uniquely billed Https LB. Every unique kubernetes service with specific annotations will spin up a NEW, unique LB (internal or external). The author is correct.
Re:AI Dungeon 2 costing over $10k/day to run on GCS/Colab
by aianus on Monday December 09, 2019 @06:18PM
(#21747744)
You are not billed by the "load balancer", you are billed by the "forwarding rule" which makes it very obvious that the infrastructure is shared and that you will have additional costs with every K8S ingress.
Unless you set up an alternative you'll get absolutely rinsed through the cost of the instance and then the egress charges on top.