I've had similar thoughts and ended up going with FreeBSD and no network connection for my use case. It's been great. It gives you some of the expected terminal ergonomics (and USB support) without the distractions.