It doesn't need to be a cold GPS signal, it only needs to be one that doesn't track you. Your drone doesn't have access to the internet to do the almanac and ephemeris download, that's the difference.
Aiding the fix by obtaining data from a faster unidirectional source (instead of satellite to device, it's just internet to device) doesn't reveal anything private, unlike mass-capture of WiFi (B)SSIDs.
Also, I would look into the quality of the GPS radio and antenna you are using - $95 u-blox modules will get an RTK-quality fix without outside assistance in minutes.