If you truly want low latency input on a Mac then your Terminal app needs to be able to run full screen to enable Game Mode: https://support.apple.com/en-euro/105118