I suspect LLMs would actually struggle significantly with doing it consistently if given purely as a prompt instruction, but you could always constrict the sampling to force words that create a legitimate chain or fine tune / RL in some signal that would assist with it.
[deleted]