[MaxRegret]

Yes, indeed! The actual rate of heat transfer is equal to the temperature delta divided by the thermal resistivity of the body-environment interface. So, to keep your body temperature constant, the temperature delta needs to be your metabolic rate multiplied by the thermal resistivity.

The thermal resistivity depends on, among other things, the material you're surrounded by. That's why if you wear insulating clothes, you're comfortable at a lower environmental temperature (i.e. higher temperature delta).

To this you can add the effect of convection: if the air is moving then you don't accumulate a layer of warmer air around you, so the effective temperature delta is higher. And unless you're in a hot tub or air at 100% relative humidity, then some of the heat you produce goes into evaporating sweat. It takes energy to vaporize water, and this energy is locked into the water vapor until it condenses somewhere else.