That is really only a political no-no. The issue is that if your VM takes off in popularity, some people get upset that it's a poor fit for their favorite language.

Technically, it's perfectly fine for a VM to be designed so that the semantic gap is small between it and the intended language family.