This seems to be a concern people bring up from to time so I thought I would start a thread dedicated to the topic.
I've shot panoramas and generl photography in public places myself. I get stopped in places like shopping malls (private property) and was actually stopped once at a carnival held on public land. Security pointed out child protection safety laws. Personally I am not aware of any such laws here in AZ but more public venues are prohibiting photography especially if children are involved such as swimming pools, school plays and events, etc.
Google street views as been hit with concerns by people over privacy issues as well catching some where they shouldn't be, license plates, house numbers etc.
Here is a very good link I found that addresses many of these issues.

If anyone can share their own personal experiences or knowledge of local laws please share them.