News for hackers. Stuff that matters.
Re:C5: A simple, reliable, scalable, open-source database by mattbillenstein on Tuesday April 15, 2014 @10:13PM (#7595649)
So this is an improved hbase or something completely different? If the plan is for analytic workloads, what is the query language?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:17PM (#7595664)
That's a great way to think about it. We want to push it back into the HBase ecosystem as well. Users can use tools like presto and impala to access the data via sql.
Re:C5: A simple, reliable, scalable, open-source database by hiroprot on Tuesday April 15, 2014 @10:21PM (#7595684)
I think a good way to explain the project would be to outline how it improves upon vanilla HBase. I'd be interested in seeing the differences.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:28PM (#7595710)
Some high level points written in a rush

- We say we can do failover in a couple of seconds. We want to make it subsecond, but we can't do that reliably yet. In HBase this story is much more mixed. - We wanted to really reduce complexity, as a result, you can just apt-get install c5 on each node and you are done. It's one daemon, one log file, and that's it. No xmx nonsense, and almost no tuning or config files. I don't know if you have dealt with hadoop before, but the complexity is high. - Finally we have a much more advanced wireformat. In fact it's advanced by being simple (protobufs + http). As a result clients in languages other than java become very easy, without a thrift client.

In the future expect even cooler features, but for v1 we are just aiming for HBase compat.

Re:C5: A simple, reliable, scalable, open-source database by hiroprot on Tuesday April 15, 2014 @10:36PM (#7595745)
That actually sounds great...hope to give it a try once the OSS version is available.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:44PM (#7595764)
I should also mention we had to work on our own version of protobufs. It's totally compatible but much faster in java. Check our blog for details. It's already open source!
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:32PM (#7595727)
Come to think of it, those are the main points we have in the middle of the webpage. I guess we just didn't outright compare it to HBase.
Re:C5: A simple, reliable, scalable, open-source database by setuporg on Tuesday April 15, 2014 @09:33PM (#7595476)
C5 is a simple, reliable, and scalable open source database which improves on HBase in every way. It is optimized for fast failover and can be used in production for both OLTP and analytics, eliminating a whole class of pipelines and bottlenecks. It is the first HBase successor, fully HBase API-compatible, developed from the ground up to run on the cloud installs with very easy to no maintenance and tuning. Failover happens instantly, which makes it a viable option for APIs, and all the data is accessible to Hadoop analytics flows right away. C5 takes full advantage of high speed IO (SSDs) and is simple to grow to hundreds and thousands of nodes as needed.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @09:41PM (#7595508)
So nice to see a plan come together.
Re:C5: A simple, reliable, scalable, open-source database by phacops on Tuesday April 15, 2014 @10:09PM (#7595630)
Is the 10c/GB/month a hosted-mode fee, or the commercial license when running the open source package yourself?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:11PM (#7595636)
hosted mode. All the software will be open source. We will be on top of Amazon.
Re:C5: A simple, reliable, scalable, open-source database by cgio on Tuesday April 15, 2014 @11:57PM (#7596021)
In the investors section I see Roger Bramford. Is he still with Oracle as per the short bio linked?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @11:58PM (#7596024)
Yes he is. We chatted today in fact. In my humble opinion, he's the biggest badass there.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @12:14AM (#7596075)
And no this is not a sekrit oracle project. He just knows a winner.
Re:C5: A simple, reliable, scalable, open-source database by hiroprot on Tuesday April 15, 2014 @09:53PM (#7595571)
So, where is the opensource version for this?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @09:55PM (#7595581)
Great question. We will be releasing in under a month. There's still a couple of things we want to roll out so expect a bit of trickle for a month.
Re:C5: A simple, reliable, scalable, open-source database by SEJeff on Tuesday April 15, 2014 @10:58PM (#7595819)
Please include a Dockerfile. Bonus points for trusted builds
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @12:21AM (#7596100)
Re:C5: A simple, reliable, scalable, open-source database by notacoward on Tuesday April 15, 2014 @11:18PM (#7595885)
MIA, and until it actually happens they shouldn't be using "open source" in their pitch.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @12:22AM (#7596102)
Fair enough. We actually thought we were going to open source half of it last week. I assure you it will be open.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @09:56PM (#7595591)
It will start out on github.
Re:C5: A simple, reliable, scalable, open-source database by ryanobjc on Tuesday April 15, 2014 @10:36PM (#7595741)
Re:C5: A simple, reliable, scalable, open-source database by hiroprot on Tuesday April 15, 2014 @10:04PM (#7595612)
I love the premise of this, but consider me sceptical...those are some pretty bold claims for a brand-new database.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:11PM (#7595640)
But yes, please be skeptical. I can't wait for you to see the tests though. I bet you will fall in love.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:09PM (#7595629)
It's not from scratch. We have about 100k lines of HBase in there. I am sorry if that isn't clear.
Re:C5: A simple, reliable, scalable, open-source database by hiroprot on Tuesday April 15, 2014 @10:11PM (#7595638)
I got that part, but a decent part of it is new and unproven, right?
Re:C5: A simple, reliable, scalable, open-source database by ryanobjc on Tuesday April 15, 2014 @10:22PM (#7595686)
A lot less than you'd think - the fundamentals of HBase are excellent. File formats, compacting, etc is all solid and the same.

The issues arise during fail over and the architecture of how HBase and HDFS interact. That is where the most changes are, and while it seems scary, I think people will find the changes most refreshing, and cut out literally hundreds of thousands of lines of code out of the write and read paths!

Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:18PM (#7595668)
Fair enough. Plenty of new code. However, the design isn't a research project. It's actually pretty conservative.
Re:C5: A simple, reliable, scalable, open-source database by afaqurk on Tuesday April 15, 2014 @09:51PM (#7595560)
The video mentions that it is 10 cents per GB per month. But the price is listed at $1/GB/month.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @09:53PM (#7595570)
Oh dear sorry for the oversite. It's a dime. We will update it now.
Re:C5: A simple, reliable, scalable, open-source database by ryanobjc on Tuesday April 15, 2014 @10:30PM (#7595718)
Fixed, thanks for the early bug report!
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:52PM (#7595791)
all fixed
Re:C5: A simple, reliable, scalable, open-source database by triplesec on Tuesday April 15, 2014 @11:35PM (#7595942)
So, someone managed to make a Hadoop that doesn't suck, then?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @11:38PM (#7595955)
We benefited greatly from Hadoop and it's legacy. Hadoop solves hard problems for some of the biggest companies. On the other hand it is very complicated to install and manage. Additionally HBase still has a ways to go with bindings in other languages and availability. By fixing this it should expand the set of use cases that Hadoop can be applied to.

We think we have built an enhanced version of the bottom of Hadoop that is a pleasure to run. We hope you find it pleasurable as well.

Re:C5: A simple, reliable, scalable, open-source database by webmaven on Wednesday April 16, 2014 @08:20AM (#7597274)
So, no charges for bandwidth in or out of the hosted version?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @12:01PM (#7598573)
That's the plan. We want to include it in the base price.
Re:C5: A simple, reliable, scalable, open-source database by dkroy on Tuesday April 15, 2014 @11:25PM (#7595907)
Can I sign up without having to call or email?
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @11:29PM (#7595926)
Soon it will be completely open source. In less than a month.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @11:31PM (#7595933)
Sorry what exactly is the question?
Re:C5: A simple, reliable, scalable, open-source database by rainer89 on Wednesday April 16, 2014 @12:20AM (#7596096)
I think he got the same question that i , we want to test the database and begin to do fun stuff with that but we dont want to call or write email (not that i a problem with that), is just curiosity if going to have a botton "sing in" or "try" ?
Re:C5: A simple, reliable, scalable, open-source database by dkroy on Thursday April 17, 2014 @11:02PM (#7607758)
Yeah, I was really interested in messing around with it, but was being lazy and would have rather just entered my credit card instead of having to call or email.
Re:C5: A simple, reliable, scalable, open-source database by fizx on Tuesday April 15, 2014 @10:56PM (#7595810)
Congrats on the launch!
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Tuesday April 15, 2014 @10:57PM (#7595815)
dawwww!
Re:C5: A simple, reliable, scalable, open-source database by WorldWideWayne on Wednesday April 16, 2014 @01:01PM (#7598966)
> OhmData is the simplest distributed database ever created.

> C5 is a next generation distributed NoSQL system.

Is it called OhmData or C5?

Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @07:02PM (#7601061)
Lol good point. I'll tell our guy. C5 is the DB OhmData is the company.
Re:C5: A simple, reliable, scalable, open-source database by alexnewman on Wednesday April 16, 2014 @07:59PM (#7601288)
Where's the first one. I heard Ohmdata's c5 is the simplist...