It really depends on your network connection. If it is fast fetching a small HTML page is nearly instant, if it s not then it will be noticeable compared to locally cached data.

Now you don't need to do it as complex as Gatsby does, you could literally just GET the HTML file and throw away the result so that it is in the cache.