Some friends of mine had a pretty low latency (sub 50ms) using Jamulus (https://github.com/corrados/jamulus), which is an open source conferencing tool specially made for musicians. Need to self-host though.