Meds can have disruptive side effects that make them difficult to adjust to. This is the primary reason I don't take them now. This is not true for everybody, and the side effects often wear off after a little while.

I wouldn't be afraid of neglecting yourself more. It's difficult to describe the effects of antidepressants, as their onset is extremely gradual (weeks to months) and it's been a while for me, but they basically shift the average mood up from "everything is kinda awful" to a more neutral equilibrium.

Antidepressants aren't the only option. Therapy is also effective, and if you feel that you're neglecting your life it does give you a place to talk about it.