Phone networks by design track you more precisely than possible over a conventional internet connection to facilitate the automatic connection to the nearest available network. Also, for similar reasons it requires the phone network to know that it is your phone

The phone network already needs to know where your phone is to be able to route incoming calls.

Also, I don't get how the situation with your home internet connection changes much. Your ISP knows exactly where you are because your house doesn't move.

Right, but for most people you can reasonably be expected to be in your house so it isn't that big of a security risk

You don't need to connect to the internet for that. It has nothing to do with web browsing at all.

Installed apps can track you even more, so what you're arguing for is presumably not "don't use websites on your phone", but rather "do not use your phone, just use your desktop computer".

Which sure, not using your phone is more secure, but good luck convincing users that they shouldn't use any apps or websites on the go.