Yes, AM5 DDR5 support has been similarly painful to me on four systems (7950X and 9950X). Try forcing the memory speed down to 3600MHz (ouch) when you want to install lots of memory and stay on modules specified on the motherboard's QVL.
I'd probably go Framework Desktop next if I won't need peripherals.
* ASUS X870E ROG CROSSHAIR HERO AMD AM5 ATX Motherboard