It is possible that the game you refer to has some form of Galaxy integration (GOG Galaxy has its own APIs) when installed from the client. It might still work if you uninstall Galaxy however.

But Galaxy is optional, you can download the offline installers directly from the site. I have around 680 games on GOG and all of them are in my external HDD in their offline installers - i never installed Galaxy on my PC.