built a small voice notes thing for myself last week and the surprise was that transcription accuracy wasn't the hard part. it's that i almost never want the raw transcript, i want the cleaned up version of it. keeping that out of scope is probably the right call for a dictation tool though.
I'm considering adding a feature to include auto punctuation and capitalization. Would that solve it for you?