Coastal mist at 5 degrees isn't remotely comfortable to hike in with the clothing you describe, unless perhaps you are trail running.
What's that old line about the worst winter someone experienced being a summer in San Francisco?
But, given the same amount of wind, I'd still rather hike in 5'C vv -40'C.
You must have been trekking through some high winds, I imagine?
-40C ice fishing out in the middle of a lake with no barrier is much different than -40C walking around a small town with buildings and trees and barriers to block the wind.
It feels like you're walking in a void, really.
High winds increase the amount of moisture that does hit your skin, and also saps you of any warmth pockets in your garments much faster.
It's all relative I suppose.
"-40C feels warmer than +5C"
I've been outdoors in both, plenty of times, to hike or to engage in my hobby of landscape photography.
At +5C, it's perfectly possible to hike for hours in light pants and a t-shirt, with a sweatshirt or light jacket in your day pack in case it gets cold. At -40C, I was wearing multiple layers of wool, fleece, and a gore-tex parka, just to stay warm.