snczl
While there is some market variance like the 2022 to 2023 glut, DRAM prices haven't fallen in real terms in over 15 years. This was all done by controlling supply, and it was all done in public. It starts with one of the big three putting out a statement like, "Samsung is considering reducing DRAM wafer output due to softness in the mobile PC segment." The actual reason varies and often makes little sense.
This is followed by similar public statements from the other large vendors expressing a willingness to reduce supply. Once everyone commits in this way, the companies follow up with announcements of actual supply reductions. You can watch this happen any time prices start to dip.
My bet is if the DOJ investigates, they will not find the same sort of embarrassing smoking gun emails between representatives of Micron, Hynix, and Samsung. The collusion was all done in public. The companies will claim it is just good business management, a strategy known as "conscious parallelism." They used this exact defense to get a 2022 antitrust lawsuit dismissed.
That said, their goal seemed to be just keeping prices fixed. They wanted to avoid boom and bust cycles, keep profits high, and keep prices stagnant. A massive price hike invites investigations and creates problems. If DRAM prices just never fall, they can enjoy healthy profits with little risk.
But what happens when your intentionally constrained supply hits a sudden large spike in demand? Prices skyrocket, everyone gets mad, and demands investigations. My guess is instead of being thrilled with the price spike, the executives at the large DRAM manufacturers are very worried someone put something incriminating in a document somewhere that can be subpoenaed ("how we're going to fix prices in public and get away with it").
Qualcomm Reveals “Cloud AI 100” Family of Datacenter AI Inference Accelerators
Use Keepalived (http://www.keepalived.org/) for HA and health checking or use Gorb (https://github.com/kobolog/gorb) and you can dynamically change services / backends using a REST API.