The worst case of refusing to unlock your phone is that they keep your phone for some days/weeks/months while they investigate.