> LLMs generally only debug systems by reading the code with whatever information you give them in a prompt.

Oh, I wish. "This call doesn't return, how strange! Let me fire off a bunch of small test script one after another, with a timeout of 10 minutes each, to narrow down where the error might be!" In terms of tokens, it's maybe even efficient. In terms of time it isn't!