Hire someone to offer the bribe. Target a well-known corrupt official, and gather lots of evidence to make it obvious that a bribe has happened. Publish the results, get a scalp.
On top of punishing the individual corrupt official, if every official knows that any bribe offered might be a trap, they'd be much more likely to turn it down. Certainly makes the cost of bribery for bribers a lot more expensive to account for the extra risk.
Hell, you don't even need to hire someone. Just have an open offer that if someone can prove they successfully bribed an official, you'll pay them three times the bribe amount.
Busting lower level folks probably won't fix anything. You'll just get mired in their terrible slowness and endless rules, pointless paperwork and so on. At least bribing folks, you can get stuff done.