See this is exactly how we got here.

You multiply the "well we should allow it for uses X Y and Z" takes by every issue and the end result is that there's just enough political will to let the government walk all over everyone and everything else.

You have to draw a line in the sand otherwise you get the political equivalent of everyone littering "a little" and the cumulative result is things being crappy.