This already happens on Hacker News. People frequently flag comments they strongly disagree with, rather than just downvoting them. Despite the fact that the "flag" was originally introduced to flag spam.