You can also hold down shift and click on the icon to open up a new window.
Similarly if you use a keyboard shortcut to open your icons (like Win+1 to open the first icon) holding shift while pressing the shortcut will open a new window (Shift+Win+1 will open a new window for the first icon).
I just tried it and it does open a new instance _and_ go to the switcher which is not great.
Also most of the time if there is already an app window in the workspace, I would want it to be made visible not a new instance to be opened.