I would ask the opposite question: why are invite-only "off-the record conferences" of extremely rich and influential people not secret societies?