Um. Being disabled means being marginalized. Being fat means being marginalized. Being Black means being marginalized. These categories of people are all denigrated based on that marginalization.

Why do YOU find it so unbearable to be associated with disabled people? This sounds like ableism to me. In fact, it sounds like you believe that being disabled is inherently bad and makes your life worse, and you are trying to argue to me that being Black does not have that impact.

I would agree that being Black does not have that impact.

I would also assert that being disabled does not have that impact.

Being disabled or being fat means existing in a category of people who society has decided it is socially acceptable to pity, look down upon, resent, and hate.

It seems to me that you are arguing that Black people do not deserve to be treated this way--but it is totally fine with you for fat people or disabled people to be treated this way.