What if I told that all fiction books were fantasy?

Then I would say that you are engaging in equivocation, using a definition of "fantasy" different than the one applicable as a genre label in discussing genre labels.