While agriculture certainly did create social stratification, it's hard to imagine a couple guys in a society of egalitarian hunter-gatherers could force everybody else to go along with a scheme of agriculture. It seems more likely that the elites began to show up after agriculture was established than the other way around.