How do you even get a container like that working?

Even alpine based images have a version of vi (it comes with busybox)