Perhaps it's because I'm British and I'm more familiar with the types of affectations that Kirby has, but I always enjoy his commentary despite any mistakes (to a certain extent I think they are part of his charm!).Yes, he waffles on, and gets rider's names and nationalities wrong, and misstates the obvious or misses some important developing action but I still enjoy enjoy Carlton Kirby's commentary if I'm locked in for hours of viewing.
His commentary style reminds of Test Match Special - the BBC's radio coverage of test cricket. As they're covering a slow sport (which cycling can also be at times, especially in stage races), it frequently leads to commentators going off on a tangent talking about anecdotes from previous matches/pro careers, the cakes/food they're going to enjoy in breaks in play and talking about what they see in the crowd. I think Kirby seems to come from the same type of commentary school, the waffle is a nice way to fill in the background to an event that covers several hours.