I'm not that worried about websites banning the Pi as the traffic is really low, on concurrent calls it's unlikely to be a problem as I don't expect the Pi to query several websites in parallel.

Certainly it's something worth implementing if I ever start getting more traffic.

Thanks for sharing.

For this article, does the OP feel they need the proxy due to scraping rapidly?

The actual problem is that some websites block IPs from known cloud providers, so, it doesn't matter which headers you use because what's blacklisted is the IP address.

In the post I detailed that I run a service (https://cazadescuentos.net) which is a browser extension to look for discounts.

Sometimes, such service needs to look for the actual discounts, it queries the actual stores from the server that's on the cloud, but some stores doesn't let it go.

So, I mounted a Pi at home that resolves only those problematic queries, I expose the Pi at home to my cloud server by using a SSH tunnel.