Yeah, there really is no way to prevent that from happening. Its just a role of the dice.