For my purposes, the biggest drawback of using an SoC is being constrained to just the unified memory.

Since I run a lot of memory intensive tasks but few CPU or GPU bound tasks, a regular m1 with way more memory would be ideal.