I used to have trouble getting numpy and scipy installed - until I started using homebrew. It blows MacPorts out of the water. Just make sure your architecture is set correctly as Jesse outlines in this blog post, otherwise you'll run into problems building the various C components with gcc.