I could write pages of this stuff, but let me write more positive things. The best way to enjoy the islands in Croatia is actually by boat, rented or otherwise (they are not expensive). There are beautiful quiet coves where you can spend your days and nights, only going for resupply in towns. You anchor in a quiet cove, and in the evening you take your tender boat to the town if you want to walk around it. Next day you sail to another island and repeat. That experience is actually awesome.
If a boat is out of the question, being in some apartment is an option, I would just advise not to be in the town center or near it, or anywhere where some very local beach is. Mostly there will be a caffee with blaring music and nobody likes to sleep with earplugs. Also this is and advice for any island, and true, a lot of those islands are quite different than each other.