The litmus test is does the packaging begin to break down after 10 or so minutes holding wet food, if yes then the packaging is likely just paper, i.e. cardboard, if it can sit in a fridge for 48 hours without issue it has plastic.
The hardest part for me would be milk. I buy milk by the gallon (usually a gallon per week), and my kids love to drink it. I make yogurt and occasionally make cheese, so we would probably not suffer too much if we can get milk relatively cheaply. Milk does come in cardboard containers, but I'm pretty sure they're lined with plastic, not wax, and I honestly don't know where to get milk in glass containers.
Meat would also be hard since it always comes shrink wrapped in plastic and I don't know how to get it otherwise. We have a butcher nearby that would probably work with us, so it's solvable.
Instead of trying to eliminate plastic, maybe I'll try this with eliminating all waste. Food scraps will go to the compost and packaging will need to be recyclable. It would be interesting to see what I can cut out that isn't recyclable.
In Ontario, Chapmans ice cream (and other brands too, probably) is available in cardboard boxes which unfold, leaving you with a perfect rectangular block of ice cream sitting on a flat piece of cardboard.
Otherwise, ice cream generally comes in rectangular-oval tubs made of cardboard. The only plastic is in the rim of the lid.
You can also get no name "ice cream" in 4 litre plastic buckets, but that generally has so little cream it's technically "frozen dessert".