Searx is only as slow as your configuration allows it. You have to check the preferences, under engines, and deselect the offending slower engines. Some will take up to 10s to return any result. If you only choose faster engines, searx will also be faster.