And here I was going to say "the grain you get from high ISO film (http://i.imgur.com/4FDyk.jpg)". Dang kids, get off my lawn!
Anyways, you can actually see this effect (combined with chromatic aberration, which simulated the effect of cheap camera optics) used to great effect in P.T., which was a sort of tech demo/playable trailer for an upcoming silent hill game. Here's a screenshot: http://www.silenthillmemories.net/silent_hills/screens/pics/...
In any case, it's great. The noise hides some details that would otherwise reveal flaws in the render, similar to how motion blur and focus help as well.
That's the advantage of ray tracing: you're simulating physical reality, so any errors emulate physical reality as well.
In the case of noise, it's simply the result of each pixel not having sufficient sampling depth, because the ray tracing algorithm hasn't been run long enough. This is exactly the same as when it happens with a camera: if you opened the shutter for a longer time period, the noise would go away (although you might not be able to hold the camera still).