I suspect it helps to remove shitty window managers like Unity or Gnome3 and go to something more basic like xfce. I just set up an example Ubuntu VM today. Unity is annoyingly laggy. My primary VM with xfce is fine.