How is it harder? It's a genuine question, not a rethorical one. Never used Yocto, but buildroot allows you to stack multiple filesystem layers on top the one produced by buildroot.