http://hackademix.net/2010/03/24/why-noscript-blocks-web-fon...
"It really worries me that the FreeType font library is now being made to accept untrusted content from the web. The library probably wasn’t written under the assumption that it would be fed much more than local fonts from trusted vendors who are already installing arbitrary executable on a computer, and it’s already had a handful of vulnerabilities found in it shortly after it first saw use in Firefox."
10 years ago we had similar issues with 2d graphics. For example, rendering huge fonts could cause the X display server to crash: http://xforce.iss.net/xforce/xfdb/9313
With WebGL, the attack surface is many times larger. I'm sure we'll see plenty of exploits leveraging vulnerabilities in the display subsystem.
On the other hand, if it's ever going to happen, it will probably take a few embarassing public incidents to make the vendors change their priorities.