I don't know what kind of testing you've done but nothing even approaches the speed of Lucene. It's by far the fastest open source search engine currently available. If you're using Rails, I cannot recommend Solr enough. It's amazing.
Cutting's a genius.
Do you have references for "nothing even approaches"? Specifically compared to Sphinx? The only comparisons I've found are showing sphinx coming ahead in many indexing/search cases (if only slightly). See my other comment on this thread with links to benchmarks where sphinx clearly "comes close". We did a good bit of research on this, so it does feel odd that you'd say "nothing even approaches".
It was also ridiculously easy to get Sphinx up and going. Lucene is a killer engine, no doubt, but Sphinx's ROI alone won us over.
I've used Sphinx in one of the PHP/MySQL projects, and its much faster than any other (free/open) data indexing platform I've used. Althought configuring Sphinx and getting it to run takes a bit of an effort, but its worth it.
If you're working in Rails and you just want simple search, Sphinx is the fastest path to getting started.
I think of Lucene as more implementor-neutral than Sphinx; Lucene is an API as well as a Java library.
For our tests, it indexed much faster than the common Lucene implementations, and for our needs was also a tad faster overall. I haven't tried the newest version, though.