I would not trust LLMs with the final word on anything financial.

Not exactly accounting, but ChatGPT (whatever the paid model was in March) told me that paying down principal early would have virtually no effect on interest over the remainder of the loan. It was confused by the fact that it was a short balloon with payments amortized using a 30 year schedule. I did the math by hand to check and told it it was incorrect and it gave me the classic “oh yeah, sorry about that”. It’s the type of thing where for someone that is knowledgeable about the domain, it wouldn’t pass the sniff test. I am not sure if LLMs have a sniff test.

I can’t imagine how hard this will hallucinate when there are layers of accounting, tax codes, etc. But who will notice when it sounds so convinced it is right?