A compromise might be to hide navigation elements or margin notes until you hover / click on an element, sort of like how Wikipedia enables page previews on internal links.
> https://www.gwern.net/About
what the hell, its like someone vomited CSS on that page
[1]: https://meyerweb.com/eric/thoughts/2020/07/01/accordion-rows...
[2]: https://www.gwern.net/About
[3]: https://www.inkandswitch.com/local-first.html