Agreed. I've seen local officials convicted of misusing an offical credit card for groceries and other personal purchases, even though they paid everything back and there was no "loss" to the taxpayers. But they were still misusing public credit for personal benefit.
Of course it was a pretty clear pattern of usage over time, not a one-time thing that could be explained as accidental.