I think paternalism and condescension always contain aggression and violence. But it's easier for the person passing judgment to convince themselves that they're still "good people"...