Same here but I have the opposite situation. Also work remotely and live in the South of Portugal (so not even in a big city). Been living here for a year and made a lot of colleagues and have a diverse group of people which I do various activities with (some for tennis, others hiking, others going to local fairs). The main difference I think is being more outgoing and even going to events where you don't think you will enjoy just for the sake of being out and meeting people.

ps: if you are in or near central algarve, drop me a line, will be more than happy to go for a beer anytime.