Of course there is a significant overlap in readers of both genres. I am mostly the same as you though, I rarely read fantasy.

Always annoys me having to wade through fantasy to find the sci fi on bookshop shelves. At least you can filter to just sci fi for ebooks mostly.