Yes. The new ChatGPT Plugins are not yet supported outside of the official web interface. Other than that, most third party client actually allow more customization (custom system prompt, temperature adjustment, ...)