the cheap house thing has nothing to do with if you’re foreign and everything to do with a bank not wanting to lend money for something there’s no market for.
you can easily buy these homes with cash. i know because i have a ton of friends that have done exactly this.
if you want a cheap house in a good market like tokyo, osaka or fukoaka, then you can do so through a bank via the normal routes