Your epigenetic state very much starts off inherited from your parents. Also, it's not just a gene switch, and in fact that probably is it's least relevant role, if any. Rather, and besides being a hereditary factor, it determines the structure/packing of your nucleosomes, and therefore determines the integrity of your cell as a whole, not just your gene expression levels.