The phone network already needs to know where your phone is to be able to route incoming calls.

Also, I don't get how the situation with your home internet connection changes much. Your ISP knows exactly where you are because your house doesn't move.

Right, but for most people you can reasonably be expected to be in your house so it isn't that big of a security risk