It's not that it's difficult, it's that most people don't realize what the day-to-day job is.
They assume they'll be hanging out in a coffee shop all day, chatting with regulars, but in fact the tasks and problems they'll have to solve is very different from what they imagine.