I feel like that is very hard to make work securely when the boundries are so ill defined. At the end of the day, untrusted code is untrusted. What happens when you use your math library to do some math on a security critical value?