Let's go in the other direction. After each rest day, max team size decrements by one. So if no one in your team crashed out yet, you pick someone to send home. That way everyone who's still riding has completed all the stages, but if you lose a rider on day one your disadvantage eventually...