Yeah, I dug up a bunch of quartz crystals, some granite containng small fossils (tiny clams, small spiral shells etc), and a few pieces of turqoise in the backyard as a kid. How interesting the rocks in your own backyard are depends a lot on the geological history of the area though.

If it contained fossils, it wasn't granite.