Csv files are fine with a bot categorizing the expenses.

No need to have a desktop app to do entry.

Why would I worry about an LLM properly cataloging expenses (book keepers job) when we keep human in the loop with the CPA to check their work?

I think you don’t understand the problem the AI solved/reduced costs on.