I get that being able to run arbitrary code on a device is often not that important in practice.

How about being able to not run any code that you don't want your device to run? No DRM, no nag screens, no tracking, etc etc...

A non-rooted phone very much is a general-purpose computer, just not for you.