Actually, depending on that white person's additional identity markers, punching that white person may well be punching down. Are they disabled? Poor? A woman?

Who's doing the punching?

Is a Black man who otherwise has no marginalized identities and is wealthy punching a white person with five marginalized identities?

That sure as hell seems like punching down to me.

Or are people of color immune from enacting oppression?