The most important detail here is 128GB ram for GPU computation! This allows to train monster models, ex 1B params GPT series, on single M1 Ultra. This is quite unprecedented. Unfortunately, it is also about 3.5x slower than 3090.