Ok, apparently "IM or audio conversations with three or more people" are "not available with Skype* users" according to https://suppont.office.com/en-ca/article/Let-Skype-for-Busin...

This makes it impossible then.