We'll know he's gone too far if he has to take another "voluntary" trip to Israel