I've experienced that too for sure, but https://lemmy.world/ has been pretty responsive for me.

Keep in mind this is a little different than other social networks - there isn't a single centralized server so if you hit the software on a server that's underpowered or not configured properly, you'll get a very different experience.