Yes I have, but it's normally obvious from the context that a fruit or nut is being referred to, usually by qualifing the workd with either 'fruit' or 'nut', or the person holding either.

If someone asked me to buy some meat and I returned with a few apples I'd receive a Merriam-Webster dictionary to the head!