I think most will pick up on subtle cues. That said, there is nothing wrong with being direct. And for those people who struggle with saying no, well, practice makes perfect.