The main health concerns aren't due to the fact that DU is highly radioactive in itself, but that tiny DU 'dust' particles break of from the munitions on impact and inhaling these particles can be very dangerous.
There is also some evidence that long term exposure to DU can lead birth defects and potentially other health problems, but the causality is very difficult to tease out.
So while I agree that DU isn't used because it is radioactive, that doesn't change the fact that it does potentially cause serious health issues.
I would strongly advise against that. DU (Depleted Uranium) is not (very) radioactive, but it is still extremely toxic (as toxic as unprocessed Uranium, IIRC), and also carcinogenic.
If you ate off of it, you would become very sick, very quickly.
So, DON'T.