I'm using an extension that does exactly that¹, actually every update of the extension is mostly about then supporting more websites and asking permission to access those.
So maybe more developers could do a all sites and manually select sites option?
¹BPC extension
The extension can declare which websites it can access, but the other commenter was looking for the ability for the user to declare which websites it can access.