Just set it up so it only activates extensions when entering a specific workspace. You can add the extensions names to settings.json in the .vscode (I believe) folder in the root of your project and they will enable/disable on load.

https://code.visualstudio.com/docs/editor/extension-gallery