We're quickly approaching the point where you can have an LLM do this, and if it passes "the doc passes", if not, time to edit.

I was gonna say this. Really good idea. Having an LLM go through the docs and try to implement something. Challenge would be to prevent it from using any prior knowledge or experience, depending on the docs target audience. Good prompt is essential.