From my experience the best person to read these images is the medical imaging expert. The doctor who treats the underlying issue is qualified but it's not their core competence. They'll check of course but I don't think they generally have a strong basis to override the imaging expert.

If it's something serious enough a patient getting bad news will probably want a second opinion no matter who gave them the first one.