I think only you can make this decision. If the cons don't effect your personal happiness or mental health, than I see no reason not to stay. If the job stresses you out and you feel your skills will get stagnant, I would recommend quitting. You can always use this job as a stepping stone to a better job.