Children and abolitionists weren’t masters and were still killed. There’s a big difference between being angry at slave owners and carrying out genocide. The latter is what happened in Haiti and people in the US actively feared that for decades.