In my experience as a backend services Go developer (and a bit of Scala) the switch to arm has been mostly seamless. There was a little config at the beginning to pull dual-image docker images (x64 and arm) but that was a one time configuration. Otherwise I'm still targeting Linux/x64 with Go builds and Scala runs on the JVM so it's supported everywhere anyway; they both worked out of the box.

My builds are faster, laptop stays cooler, and battery lasts longer. I love it.

If I was building desktop apps I assume it would be a less pleasant experience like you mention.