"We are maintaining balance of the World, a scale that is constantly tipping into chaos. "

Prodigal

The World can be compared to a scale, regardless of where it tips, will cause an imbalance and chaos will ensue.

...Supposedly there would be something like that. But how come it hasn't happened yet?

Because it is the work of the Prodigal. An organization hides from society in order to balance the scale. They will do anything to maintain the position the world it is now; an excellent balance between good and bad. The Organization most preferably wants to view themselves as a group with good intentions, but if they are not afraid to be viewed as the enemy if it means to regain the balance they want.