It means trust builds slowly but can be lost rapidly. It's not about horse theft.