You can. Or at least Apple can (for which they’ll charge you $80 or so). Sure, you can’t “hot swap” during the day, but if you like the size, it seems well worth the expense to get a new battery installed.