This series of blog posts from Mike Farnsworth (a rendering fanatic and blender contributer) goes over how to create a "modern" ray tracer from scratch. Highly reccomended:

http://renderspud.blogspot.com/2012/04/basic-ray-tracer-stag...