This text injection has always bugged me in computers (SQL etc). Like would they treat an input string as a command under any circumstance?

That's literally the only thing LLMs do.