Sure, this is sometimes done using hardware with host memory access / DMA support, like PCIeScreamer type PCIe cards. This is also used for network level exploits when there's some kind of ephemeral or negotiated encryption key at play.