Yep it is fun to think about. Especially when you realise that information is not abstract but physics. I recommend reading the “Constructor Theory of Information” if you haven’t already. It is free online.