If they didn't vote, they are, by definition, not "voters".

I prefaced it with eligible which sets the context for the outcome, i.e., what kind of "mandate" is implied by the outcome.