You don't need to keep all the transactions. The original paper addresses how to compact the chain. Basically, you only need to keep hashes.