I had to stop taking naltrexone after ~6 months because it was giving me insomnia / I started noticing an irregular heartbeat during the night (don't think this was naltrexone related though). But the effects persisted for a long time. It was like a complete reset with respect to my response to alcohol.
Unfortunately after a year or two of drinking again without it, I was back to binge drinking again. Very similar pattern to OP.
In the end I made the decision that it's not worth the hassle - had my last few parties with family and friends over Xmas & new year and then quit altogether from Jan 1st this year. Difficult at first but non-alcoholic beers have been amazing to trick my brain into thinking I'm having a drink with everyone else when out and about and, honestly, recently I haven't been missing it at all.
Good luck OP!
I found keeping a drink log helpful just for cutting down. I measured each drink with a measuring cup, and recorded the time and quantity. To my surprise, the act of maintaining a log naturally and painlessly reduced my consumption by 50% (a greater reduction was more of a struggle).
Highly recommend reddit.com/r/Alcoholism_Medication has a next step for anyone interested in learning more. Not only is the community extremely supportive, the sidebar links out to great resources including a free/legal PDF of the aforementioned Espaka book. That book was my starting point, highly recommended, it is a quick read and lays down the foundation for The Sinclair Method in the first few chapters (it is an incredibly simple system and that is why it works).
I used this method, along with keeping a log of drinks consumed, to eventually quite drinking over the course of a year. I went from having anywhere from 3-8 drinks a night, every night, to eventually stopping completely. In turn I've been sober 6 years now.
I found keeping the drink log useful both for charting my progress, and also just forcing me to be honest with myself about what I did and did not drink. It's too easy to skew ones memory in favor of having less of a problem if you feel like it.