I've tried that. Toothpicks break off and don't clean the gunk. Round cylinders are fine because the contacts are flat. There are even keychain metal lightning cleaners that are basically just large paperclip-like ends, and that's what many Apple store employees use.

Edit: as long as you're not using a needle-like piece of metal to dig at or bend the contacts, it should be fine.