News for hackers. Stuff that matters.
Re:How we built a P2P file sharing network from scratch by grailed on Tuesday August 06, 2019 @04:34PM (#20629310)
This article outlines how three engineers built a p2p file sharing network from scratch, and what they learned along the way.

It's a great high level primer if you're curious about how distributed hash tables or sharding works.

[dead]
Re:How we built a P2P file sharing network from scratch by therockhead on Wednesday August 07, 2019 @08:43AM (#20634147)
Not sure I follow, could you expand ?
Re:How we built a P2P file sharing network from scratch by mav3rick on Wednesday August 07, 2019 @02:15PM (#20637319)
Absolutely amazing article. Where can I get work like this where I get to design distributed systems from scratch ?
Re:How we built a P2P file sharing network from scratch by cdbattags on Tuesday August 06, 2019 @10:59PM (#20631664)
someone should add "2017" somewhere to this
Re:How we built a P2P file sharing network from scratch by JeremyBanks on Wednesday August 07, 2019 @09:04AM (#20634288)
Why? It doesn't seem like time-sensitive content. Should any link to tutorials or documentation also have a date on it?
Re:How we built a P2P file sharing network from scratch by thepangolino on Wednesday August 07, 2019 @09:40AM (#20634578)
Perhaps yes. Unless you don't mind kids learning to code like it's 1995 again.
Re:How we built a P2P file sharing network from scratch by didsomeonesay on Wednesday August 07, 2019 @11:48AM (#20635795)
An article titled "Teaching kids to code like it's 1995" would definitely spark my interest. Somebody please write that!
Re:How we built a P2P file sharing network from scratch by arpa on Wednesday August 07, 2019 @10:09AM (#20634792)
What's wrong with coding like it's 1995? Did I miss some major paradigm shift in programming?
Re:How we built a P2P file sharing network from scratch by keanebean86 on Wednesday August 07, 2019 @12:23PM (#20636162)
#1 Thanks to the internet, Async has because far more important to understand. #2 CPUs have gotten waaay faster and ram is now plentiful so there's little need for heavy optimization in most cases. #3 you're almost guaranteed to have at least 2 core available so multi-threading is a real option now. #4 monolithic code bases are the devil now #5 some 3rd gen and I think all 4th gen laungages include automatic garbage collections so memory allocation is not a concern for most people

Ok I guess none of those are huge paradigm shifts but in many ways we've gotten pretty spoiled over the past 25 years. A lot of the old struggles have been mitigated at the expense of a lot of cpu cycles. NPM is a great example of the unneeded waste that has accumulated over that time.

We went from think about every byte to just tossing everything in and letting a transpiler remove all the fluff. You can certainly make the argument that computers should do that work but I think theres a middle ground between neurotic 1995 and kitchen sink 2019 that we'll hopefully eventually find.

Re:How we built a P2P file sharing network from scratch by arpa on Wednesday August 07, 2019 @03:54PM (#20638238)
Hey, nice points. Really, no sarcasm, I wholeheartedly agree. However you, like me, seem to disagree with our parent comment - that coding 1995 was not really that bad...
Re:How we built a P2P file sharing network from scratch by MuffinFlavored on Wednesday August 07, 2019 @11:40AM (#20635720)
Is it P2P but not decentralized because clients get metadata from supernode1.xorro-p2p.com?
Re:How we built a P2P file sharing network from scratch by Mathnerd314 on Wednesday August 07, 2019 @12:13PM (#20636038)
They have a DHT; I think the supernode is just for bootstrapping. Similarly all Bittorrent clients start with a hardcoded list of peers.
Re:How we built a P2P file sharing network from scratch by vector_spaces on Wednesday August 07, 2019 @10:51AM (#20635241)
I'm working through the first set of Cryptopals so I appreciate the discussion of XOR distance here. Wondered if xorro referred to the XOR operation, now I know. Thanks for sharing
Re:How we built a P2P file sharing network from scratch by kingludite on Tuesday August 06, 2019 @07:56PM (#20630828)
distributed != decentralized
Re:How we built a P2P file sharing network from scratch by joombaga on Wednesday August 07, 2019 @08:42AM (#20634138)
Is there a problem with their definitions?
Re:How we built a P2P file sharing network from scratch by kingludite on Sunday August 11, 2019 @06:14PM (#20670880)
The text fails to explain the difference between the 3 types of networks. Centralized, decentralized and distributed.

> "BitTorrent, Gnutella, Freenet: Decentralized"

> "In a decentralized system like BitTorrent, every computer/node acts as a client and server"

F

Re:How we built a P2P file sharing network from scratch by K2L8M11N2 on Thursday August 08, 2019 @01:20PM (#20646453)
Why use SHA1 if you’re building it from scratch?
Re:How we built a P2P file sharing network from scratch by chrisjarvis on Wednesday August 07, 2019 @01:17PM (#20636760)
this is so interesting thanks for writing about it. I also want to do something in this space and this is a great resource.
Re:How we built a P2P file sharing network from scratch by pictur on Wednesday August 07, 2019 @11:31AM (#20635623)
Great article