Being eaten raw doesn't mean being eaten without washing. That should get rid of most of the stuff. My understanding is that cat litter is a danger factor because it gets dry and fecal matter particles get thrown in the surrounding air. Which wouldn't be a problem in the garden.