How much trouble is it? I found with gardening that it was fun for a while, but not fun enough for me to sustain itself as a hobby for it's own sake. And the time investment was not worth the crop.
I'd love to grow mushrooms if, once you get past initial learning, it's very low-effort.