The Reminders app has significant location-based functionality, which obviously won't work if it can't access your location.

It remains private because this runs locally. It's not sent up to the cloud.