Yeah, it's too bad. Apparently it only performs well in certain languages: "The model is natively multilingual, achieving strong transcription performance in 13 languages, including English, Chinese, Hindi, Spanish, Arabic, French, Portuguese, Russian, German, Japanese, Korean, Italian, and Dutch"
It did great English and Spanish, it didn't switch to Portuguese, french nor German, maybe struggle with my accent.
Try to warn it you are going to switch language to Portugese. Worked for me.