The good thing smart contracts are inspectable, so there is at least the open source aspect to help mitigate concerns.
The only gambling smart contract I'm aware of is the Mayweather/McGregor one, which broke because the API they used to report the win changed from reporting 'w' for win and 'l' for loss to 'W' for win and 'L' for loss, and nobody could update it.
Thankfully the author was trustable, after all, and put a refund method in it, otherwise it that money would have been gone forever. [0]
So, the use cases have been tried and they've all failed.
[0] https://www.removeddit.com/r/ethtrader/comments/6w5wcn/impor...
Which means any and all bugs or exploits are also law. And we know for certain that there will be bugs and exploits, which is why smart contracts are such an exceedingly daft idea.