I guess most folks let 1 success on a perception test go a lot farther than I do. According to the Perception success table, 1 success gives the result of "Something is there", 2 successes gives the result of of suspecting what type of thing it is. I'd interpret that to mean, if someone got 1 success, they may think the person may be acting strange when a spell is cast, but a lot of people act strange when a spell goes off. 2 successes means they have good reason to believe the person may be casting spells. 3 successes and they KNOW a spell is being cast. Most folks have an average of 3 intelligence, and in a crowded restaurant, not everyone would be in a position to notice anyway.
Another instance where this is favorable is in stealth tests. I may have a guard hit that 14 target number with his perception test, but that doesn't mean he's whipping out his gun and and hitting the panic button. It just means he noticed something. At that point, he either investigates, or if he's some low rent thug w/ a badge, ignores it and goes back to sipping soycaf.
End point being: One success should not give your mage away if casting a spell.