Honestly my bigger annoyance is it's relative isolation and it's popularity meaning it tends to be the focal point of a queen stage/final mountain stage which is a terrible combination with it's isolation. You also get the Croix de Fer as a bonus most of the time, which is one of the lamest HC passes. I also think that the last few stages to Alpe d'Huez have overdelivered a lot due to Froome fading in the third week twice and Contador flatout not giving a *** once.Honestly Alpe d' Huez gets a lot of *** and some people treat the climb as if the climb is bad in it self (which it isn't). I too dont have that much of a problem with the Alpe featuring every 2-3 years, its whatever as its one of the better MTFs in the race and is a really nice tourist destination where you always can consider to go, drink some beers and climb some of the most iconic climbs in the world and watch the race.
Lastly, I'm also pretty sure that we CN just has a vocal minority of cycling fans that dislike the Alpe. Casual fans will almost universally love it.