Higher = right = after, Lower = left = before. Once you play some games, it will become more natural. At least this was the feedback from friends playing the game.