I found this app which you can use to find out which of your local fonts support a given symbol:
http://www.fileformat.info/info/unicode/font/fontlist.htm?te...
On my Vista system, the 0x267a (recycling) symbol is supported by "Malgun Gothic", "Meiryo", "Microsoft JhengHei", "Microsoft YaHei", and "Segoe UI".
Not sure which of these are always available.
From looking at the Vista fonts I have available, it doesn't appear to be available there either. If it does work, I'd be curious to know what fonts it's provided by.
Let this be a lesson: Don't use weird Unicode characters unless you know that everyone that needs to see them can see them.
FWIW, if you can't stand the little blank boxes, here's a Free font set that covers most of Unicode: http://dejavu-fonts.org/