I've been doing this for years. At one point my first email provider removed the catch-all feature. Despite pleading with them, all they could suggest was adding each address as a real account or alias account. There's no way I'd remember them all! So I had to switch providers.