Another reason why we need standard rules
There is no way that this situation would be covered in any set of rules, it would always be up to the TD. If the players all agreed to leave at the same time, you could argue that they were colluding to gain an advantage.
Anyway, I still think there is more to this that we haven't been told.