That is the same excuse cops regularly use to violate peoples rights and justify illegal searches and stops or claim they are impaired when they aren't. The very fact that people are being closely watched or monitored is in itself a reason for people to be nervous.
Yes, some people will be stressed and nervous for benign reasons. Criminals will also be stressed and nervous.
A good security system will use multiple signals to filter out false-positives.