But it also covers events that are directly or indirectly significant to the plot or setting of... most... of the other books. So if you are going to read them all, you get more out of the rest for having read it first.
Surface Detail also really stuck with me for its unique conflict & setting. It's about a war over the fates of people unwillingly uploaded into a simulation of hell after their deaths. With the soldiers being continually "reincarnated" back into different iterations of the same fight. Banks has a really unsettling edge to a lot of his stuff that is just barely kept out of view in a lot of the culture books, but this one he just lets it rip and it's very effective.
The ending of Consider Phlebas was a bit of a trainwreck in my opinion :)