Not sure about that. I know altitude affects everyone differently. Watching the 2019 TdF it seemed obvious to me altitude was the big difference for Bernal once the roads were consistently over 2,000m.There is an effect.
But it's not a unique trait that's super different between riders that magically makes them much better or worse just because there's high/low altitude.