"Soul"? To constantly be screaming at idiots to get out of the way? The riders are the soul, not some drunk idiots thinking the whole purpose of the race is them getting on television.
Sure, have spectators on the locations where it's easy for them to move out of the way when the riders arrive, but on some climbs that just isn't possible.
You were watching the race on Puy de Dôme, Woods catching and passing Jorgenson, Pogacar slowly pulling away from Vingegaard, while thinking that what was missing was some idiots getting in the way?
I was at both the Giro, and the Tour. On locations with plenty of room, and not running alongside the riders like some idiot.
Spectators are great, in places where they don't get in the way of the riders.
Of course, this is the absolute best way of dealing with idiots:
Seems like a good rule-of-thumb; "If you're close enough that a rider can steal your sunglasses, you're too close!"
Another great way to deal with idiots might be to publically shame them. Post their pictures on multiple SoMe platforms with captions like "Don't be this idiot!"