I assume a not insignificant portion of people, especially men, are taking steroids/testosterone/human growth hormone or whatever else to augment their fitness.

Yes, a large proportion of older age-group endurance athletes are taking some sort of (legal) hormone therapy and then racing without having the required TUE in place. There is virtually zero blood testing in local amateur races so they just cheat and never get caught.