Computationally relevant information is sometimes embedded in runtime state (for example, yeast prions), but this is very rare. For small bacteria, you can switch out the entire genome with a new genome and have them continue living just fine. For all intents and purposes on an engineering level, everything is/can be encoded in DNA.