For asynchronous downloading of huge media files, speed should not be a priority?

Afaik it's used more for circumventing anti-bot measures and solving challenges than the download handling itself.

This is accurate (maintainer of downstream project that depends on yt-dlp for archiving operations).

When downloading huge media files, the only speed you're being limited by is your bandwidth.

Everything else is completely negligible.