Yeah, it does have that flaw: the philosopher who goes outside the cave isn't just in a larger cave, he sees reality, supposedly. And weaker minds reject it because they just can't handle the blinding light of the truth, not because there might be further errors.