When what you're referring to is "science" in quotes, you seem to already have admitted what these people are appealing to is "science" in name only.

People acting in bad faith will appeal to whatever authority they think will achieve their goals. It says nothing of the legitimacy of Science, and if you let the actions of bad actors take actual Science off the table, you've only empowered bad actors to make things far worse for yourself.