It’s only registered voters too in most states

My understanding is that not registering to vote isn't automatically an opt-out but IANAL.

Depends on the state