Did this many years ago (but with bash) -- life changing is an apt way of saying it.
Here's the Bash commands for this in case anyone is looking for them
bind '"\e[A"':history-search-backward bind '"\e[B"':history-search-forward
Here's the Bash commands for this in case anyone is looking for them