You have to consider that when an investment bank sells you a structured product it then naturally has the opposite position. If you want something that pays off if interest rates rise, an investment bank can sell you something like that in the form of an interest rate swap. You are now long interest rates and the bank is short them, but there wasn't anything malicious there. The bank just sold you the product you wanted. Now the bank has to hedge somehow or sell the swap on to someone who wants to be short interest rates. It may have clients that are interested in that sort of exposure.
I'm not trying to defend Goldman here, but when people say things like "banks are betting against their clients" it usually shows a misunderstanding of the business.
That was the fraud. It told its clients the portfolio had been created by someone who was trying to put together a reasonable-ish CDO when in fact it had been put together with the exact opposite in mind. I will also point out that there are no claims by the SEC that Goldman itself was short the CDO.
http://wheredoesallmymoneygo.com/goldman-sachs-fined-550-mil...
They're potentially using insider information on deals and risk in order to profit; I'm not sure they should even be allowed to bet against their clients, because it gives them all sorts of perverse incentives. But it's a complex area, and I'm no expert in it...
I agree it would be hard for that to end in a fraud conviction, and as you say perhaps more regulation would be required for that to even be possible, but perhaps more regulation of this area is required.