I actually had the same experience as you (own it, played it only a bit for similar reasons), but FWIW I believe there is a sandbox mode to just play around in.

Another chill medieval town building game is Manor Lords. It has some management but overal is laid back.