Power perception doesn't mean squat as a danger in my world. Oh, he cast a spell? Gee, he must be a Magician... or a member of the clergy... or a Bard... or a Farmer who wants to check the weather... or just about anybody. If magic use isn't rare, who really cares if someone knows you cast a spell? If I pull out my cell phone and make a call, everyone knows I have a cell phone. Nobody cares unless I'm doing it in a meeting or something.
Well, I mean, Power Perception could give you away, but no more than any other perception skill could.