A joke about racism could be in the form of a story where "Person A says racist thing (that we don't get to hear), then Person B hits them". Sure, that's nowhere near funny enough to be called a joke, but it is simultaneously about racism while surely not being remotely racist?
I appreciate that a lot of the time people will define a joke as "about racism" while ignoring the fact that it ALSO contained racism - after all, if the actual racism in the joke isn't funny then why are you making the joke be about racism at all? - but I've definitely heard off-hand jokes that were about racism without having any racism in them (either in content or intent).
Not to mention that if you make a joke about racism that gets directed against your own race, it's hard to see many people viewing that joke as racist in itself.
Many people don't see the difference between a joke about racism and racism.