Yes - exactly. Because they don't hallucinate in the same way - they are perfect for detecting each other's hallucinations.

But when you ask the SAME LLM (with the same context) they remember the hallucination so it doesn't work. You have to use a fresh one without the same context