BTW if you're concerned about "not preserving historical truths", a major contemporary truth is that Central Europe is part of the common EU market and Schengen Area, while Eastern Europe isn't. So that's quite relevant for the market situation.
East == bad
Central == better
Therefore Central Europe always extends far enough to encompass the speakers' country. Similar thing happens with Europe and countries beyond the Black Sea.
Seeing as Germany itself has a Protestant-Catholic split, nevermind the rest of Central Europe, Catholicism is probably not it. Neither Latin script, nor the extent of the historical German population, unless you consider the Baltics Central Europe.
It seems there is indeed more than one way to look at it. For some, it is about not being in the same category with Russia, for some it's their Austro-Hungarian history. For some it's Germanic languages. Is the German North Sea coast any more Central than, say, Belgium? How about Slovenia? Is Südtirol Central Europe?
Where exactly the line is tends to depend on the context. In my experience, people from the region don't care much about the Iron Curtain line, unlike Anglos or the French.
So if your goal is to communicate with English speakers, I'd stick to "Eastern Europe".
(Please don't respond with some argument about balancing a cutout of Europe on a needle, etc., I'm talking about using words instrumentally.)