It's exciting to see AMD giving Nvidia a run for its money with the MI300X! From what I've read, the MI300X seems to shine with large batch sizes, leveraging its massive VRAM, whereas the H100 SXM remains king for smaller to medium batches. Interesting to see how different use cases might prefer one over the other. Anyone else here considering switching their LLM workloads to AMD? How's your experience been with ROCm compared to CUDA?