Before writing my comment, I started Emacs as `emacs -nw` in Gnome Terminal and failed to find a way to move point with my mouse. If there is any additional configuration I need to do to Emacs or a different terminal-emulating app I need to install, I'd be glad to learn about it.

I didn't mean to suggest that pointing devices are completely useless in a terminal, but it has always been my experience that what the device can do is severely limited compared to graphical Emacs.