In addition to the batching issue, "a graphics card" is not going to cut it for the multi-trillion parameter frontier models. You're looking at a 512GB Mac Studio to support anything close to those model sizes, and that's with heavy quantization and much worse performance.