No, it is just that physicists means something different than mathematicians when they use the word "function". Just assume that they always are distributions that are evaluated with dirac deltas and everything makes sense.