Re:Common Crawl
by kevincox on Saturday March 27, 2021 @09:19AM
(#26602085)
IPFS doesn't require any blockchain.
In fact someone could easily setup some IPFS nodes that fetch the data from the current host if requested over IPFS.[1] This way people could access it via IPFS and provide an alternate mirror of the data.
- Even if the source is unavailable there may be other copies on IPFS which would be transparently used.
- There may be some performance benefits in rare cases.
- If you are accessing this on a bunch of machines your IPFS gateways would handle downloading the source once, then automatically using the local copy from inside your network.
The maindownside is that if Amazon is donating their resources why bother with IPFS?
In fact someone could easily setup some IPFS nodes that fetch the data from the current host if requested over IPFS.[1] This way people could access it via IPFS and provide an alternate mirror of the data.
[1] https://github.com/ipfs/go-ipfs/blob/master/docs/experimenta...
The main benefits here would be
- Even if the source is unavailable there may be other copies on IPFS which would be transparently used.
- There may be some performance benefits in rare cases.
- If you are accessing this on a bunch of machines your IPFS gateways would handle downloading the source once, then automatically using the local copy from inside your network.
The maindownside is that if Amazon is donating their resources why bother with IPFS?