I doubt that’s an issue if people seek out your website and use it. Unless your primary growth strategy is Google SEO, I doubt that tweaking your PageSpeed Insights score is going to do much in cases like this where the site actually does load quickly in practice.