Sure. There are also several places with much worse infrastructure around the world. If you don’t want to pay taxes, go to Somalia.
Really, Cyprus and Malta are not that different from Dubai, and neither is their business model. The difference is that Cyprus and Malta are part of a larger entity that guarantees certain things, such as human rights[0], reimbursement of up to 100k € if the bank goes bankrupt[1] and support for temporarily failing countries[2]. Oh, and the risk of Iran attacking Cyprus or Malta is surprisingly low as well.
[0] extradition to the US from the UK being one of the interesting things here.
[1] cf. the EU’s opposition to the Cypriot government’s original idea to just take n% from everybody.
[2] extra loans to Ireland, cheap money to Italy etc.pp.