Humans radiate a lot of heat, and if we can't dump that waste heat into our environments or take advantage of evaporative cooling, we overheat. Saunas condition people to survive this for longer periods, but they're not something you could make use of in the tropics without any air conditioning, for instance.
We usually keep it at 101F in the winter (since it feels nice to walk out in the cold and soak for 15 minutes) and 98 in the summer -- at 97 I can stay in indefinitely, but my wife gets cold at 15 minutes, so 98 is a compromise.
I wonder if a 100 degree hot tub has a similar benefit as a hot sauna.
But yeah, it's striking how putting it down to 96F can quite quickly make you feel a chill. And not the refreshing chill of jumping into a much-colder-than-that swimming pool, but like the bone chill of having had the heat bled out of you.