The documentation[1] shows examples of how to wrap configuration code and if then block so that section will only run when being triggered from the browser. You can also use this same technique to make config from your terminal that doesn't fit in the extension not appear.

[1] https://github.com/glacambre/firenvim#building-a-firenvim-sp...