That's basically how Apple TV works and it drives me nuts.

And miss me with the "but you can use your iPhone", because that's exactly what is wrong with Apple products. I don't want an iPhone, and there is absolutely no technical reason to not have a better virtual keyboard or supporting non-Apple devices as remote controls.