The Rocket paper [0] for time serie classification works along those lines. They use a linear classifier on top of an ensemble of random convolutions.

[0]: https://arxiv.org/abs/1910.13051