News for hackers. Stuff that matters.
Re:PolarFS: Alibaba Distributed File System for Shared Stora... by j16sdiz on Tuesday August 21, 2018 @11:48PM (#17816143)
The protocol is interesting.

But given how often the Alibaba cloud fails in production, I won't hold my breath.

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by baotiao on Wednesday August 22, 2018 @01:14AM (#17816477)
The protocol is interesting, and we will provide the TLA+ proof soon.
Re:PolarFS: Alibaba Distributed File System for Shared Stora... by kjeetgill on Wednesday August 22, 2018 @05:32AM (#17817459)
Are you from the PolarFS team? This paper looks amazing, I'll be sure to give it a thorough read!

I was curious: could you compare and contrast it with what I imagine are it's competitors? Hdfs, ceph, glusterfs etc.

Have you replaced any of those existing systems internally yet?

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by KaiserPro on Wednesday August 22, 2018 @06:52AM (#17817750)
HDFS isn't really a filesystem.

The main competitors at this scale would be Lustre & GPFS

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by baotiao on Wednesday August 22, 2018 @08:25AM (#17818165)
Yes I am from the PolarFS team. You can read from the paper that we have compared PolarFS with ceph.
Re:PolarFS: Alibaba Distributed File System for Shared Stora... by tanilama on Wednesday August 22, 2018 @12:00AM (#17816188)
Will appreciate some specific examples.

Disclaimer: Not Alibaba employee

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by exabrial on Wednesday August 22, 2018 @02:25AM (#17816750)
Former Alibaba employee: every day.

There's no planning, no communication, tons of underqualified middle management, tons of politics, and a lot of really bad ideas are pushed by HIPPOs.

China is general about 10-15 years behind on software development. Currently Alibaba's big push internally is a framework that essentially resembles EJB 2.1 stateful beans, but built on Spring.

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by B1FF_PSUVM on Wednesday August 22, 2018 @06:56AM (#17817762)
> pushed by HIPPOs

https://whatis.techtarget.com/definition/HiPPOs-highest-paid...: "HiPPO (highest paid person's opinion, highest paid person in the office)"

Re:PolarFS: Alibaba Distributed File System for Shared Stora... by ofrzeta on Wednesday August 22, 2018 @04:13AM (#17817161)
I guess you are frustrated but most of it sounds like everywhere else. Also I think you are exaggerating. For sure they are not 10-15 years behind. There are some fine ideas and implementation for instance the Pouch container and p2p distribution system, even by Alibaba. Hyper.sh is chinese, too. OpenResty is nice. PingCAP, the makers of TiDB are chinese, as well.
Re:PolarFS: Alibaba Distributed File System for Shared Stora... by exabrial on Wednesday August 22, 2018 @10:32PM (#17824080)
Well, half the time things went down is because the data center hit capacity and someone exploits something in the console to shut down your workloads, which makes for a bunch of fun.