I am PM from the project - short answer is yes - you can connect to any Postgres endpoint. There are some Azure specific features, like EntraID supported by the extension that don't exist in other cloud providers.