I have the same observation, when I need to ask someone to repeat, it's usually not because I didn't hear the sound, it's that my brain CPU struggled to process and decode the sound fast enough. Sometimes I ask to repeat and while saying it, the background brain CPU thread figures out what was said.

This usually happens in my non-native languages (but not only), and especially for speakers with accents I'm not used to.