There has been interesting research over the last couple years on this topic. It is in fact not royal jelly that pushes female bees down the queen development path, but rather the addition of honey and pollen that stops them from becoming queens. Feeding beebread to female larvae is what alters their gene expression to less developed ovaries, because of a specific plant chemical, where they would all normally develop into queens.

DOI: 10.1126/sciadv.1500795