News for hackers. Stuff that matters.

schumihan

Re:Comparing Mongo DB and Couch DB on Wednesday August 10, 2011 @10:11PM (#2871045)
Cassandra is a good fit for write heavy workload, as it is optimized for write...
Re:Twitter: From Ruby on Rails to the JVM [video] on Saturday July 30, 2011 @10:21PM (#2827423)
Agreed. You can achieve very high productivity if you use Scala and Java properly.
Re:HTC Buys S3 Graphics From VIA, WTI For $300 Million on Wednesday July 06, 2011 @10:03AM (#2733932)
I just notice VIA and HTC are founded by the same woman[1], and I know the financial situation of VIA is not good...

[1] http://blog.laptopmag.com/2011-most-important-women-in-mobil...

Re:Inside Facebook Messages' Application Server on Thursday April 28, 2011 @10:20PM (#2496090)
"A user's data is stored in a single row in HBase"

Some column families of HBase can be accumulated to hundreds of mega bytes very easily, I'm afraid...

Re:Dropbox authentication: insecure by design on Thursday April 07, 2011 @10:32PM (#2422165)
The token in cookie stored by browser is portable, either. How can web apps prevent the attackers exploiting the system from stealing the cookie token?
Re:10 petabytes - visualized on Sunday January 16, 2011 @05:20AM (#2109116)
When different customers use different key to encrypt the data, even if the source is the same, the outcome is different. So it is not feasible to do de-duplication across different customers' data, unless all of them use the same key.
Re:10 petabytes - visualized on Saturday January 15, 2011 @10:17PM (#2108537)
Does SpiderOak only provide backup service? Erasure encoding is efficient for cold data. Do you use erasure encoding to distribute the hot data across clusters?
Re:Why a small team chose Mercurial. on Saturday January 15, 2011 @05:06AM (#2106791)
I use patch queue[1] to manage these short lived branch, and it works for my purpose. You just pop the patches and delete them all when you want to prunge the branch. It also make it easy for others to review your code.

If these short-lived branch will be merged back shortly. Bookmark is another alternatives.

[1] http://mercurial.selenic.com/wiki/MqExtension [2] http://mercurial.selenic.com/wiki/BookmarksExtension

Re:Google Code Blog: Google URL Shortener gets an API on Monday January 10, 2011 @08:38PM (#2090506)
If I tries to shorten the url of http://google.com several times, goo.gl always give back different result. I just wonder will goo.gl merge theses url together sometime later?

This interesting found implies how goo.gl is designed. They prefer writing directly to avoid duplication check and random seek caused by the check. And they though most of the urls are cold so it is not essential to merge them together to keep the hot cache small.

Or they assume nobody wants to play the system in this way. :-)

The architecture of MegaStore is so complicated... There are so many roles in the system, e.g. stateless replicate server, different stateful paxos instances, stateful co-coordinator, bigtable and other auxilary roles.

I suspect some roles are added later because the original implementation does not meet their design goal, as patch to normal software product.

It is a nightmare for operation engineers of GAE.

Re:Riak 0.14 is out on Thursday January 06, 2011 @05:51AM (#2074845)
Unlike Bigtable/HBase, cassandra is fully distributed, either, just as Dynamo...
Re:Riak 0.14 is out on Thursday January 06, 2011 @05:49AM (#2074839)
For any SQL/NoSQL system, the more RAM, the better. They need as much RAM as possible to cache the data.

If you observed cassandra consumes a lot of RAM even with small dataset, you should tune the GC settings. Besides it, JVM itself consumes a lot of RAM.

Re:Meld - a great visual diff and merge tool for linux on Friday December 31, 2010 @06:47AM (#2055192)
Most of the time, I use both as a tool to do visual diff, instead of code merge.

KDiff3 is not so good as winmerge as visual diff tool. And kdiff3 UI has small problem on Ubuntu, as it was not developed for gnome environment.

+1 for beanstalkd. Zero deployment and blazing fast!
Why are there so many "best papers" on CHI 2010?
Re:Meld - a great visual diff and merge tool for linux on Monday December 27, 2010 @05:46AM (#2042257)
I like winmerge. Even kdiff3 is not as useful as winmerge, IMHO.

http://kdiff3.sourceforge.net/

Re:Azul's Pauseless Garbage Collector on Sunday December 19, 2010 @09:39PM (#2023142)
On their hardware appliance, they use a special instruction to implement the barrier. For software appliance, the performance may be a real problem.
Re:Ask HN: Why Gmail '50 invites left' feature still exists? on Wednesday December 15, 2010 @06:53AM (#2007808)
I think this is reasonable.

My guess: Gmail wants you to invite somebody in your contact list directly. And they are reluctant to reset the cap of invitation because there are so many users in the system.

Re:Ask HN: Why Gmail '50 invites left' feature still exists? on Wednesday December 15, 2010 @06:51AM (#2007802)
But why do they not hide the interface directly?
Re:Yahoo Pluton on Thursday December 09, 2010 @10:40PM (#1990495)
Can we build a system above ZeroMQ for such purpose easily? I think the async semantic of ZeroMQ is suitable to mitigate the latency of multiple RPC.
Re:Objective-C Memory Management For Lazy People on Thursday December 09, 2010 @10:38PM (#1990492)
It's very difficult to avoid it when thing goes complicating. A may reference B, B may reference C, ... and somewhere, X may reference back to A. If this strategy makes sense for big project, many hackers work with C++ can use it either, as the performance overhead is very low.

But in the real world, reference-count based GC just has limited usage.

Re:Objective-C Memory Management For Lazy People on Thursday December 09, 2010 @05:38AM (#1986919)
Reference count based GC? How would you deal with circular reference?
Re:Yahoo Pluton on Wednesday December 08, 2010 @01:22AM (#1982115)
Is it similar to ZeroMQ(http://www.zeromq.org/)?
Are you use 0.6.x branch or 0.7 branch? 0.6.x is quite stable in my deployment.
I suppose fb caches the recent messages in memory, and use HBASE as archive storage most of the time.

It depends on the developer's favor to pick up a system. If it's me, I will pickup cassandra. The consistency model is not so hard to work with.

UDP is more easier to penetrate a firewall, IMHO...
Re:Yahoo Open Sources S4 Real-Time MapReduce Framework on Wednesday November 03, 2010 @10:24PM (#1867361)
You can work with much higher productivity in java...
Re:Yahoo Open Sources S4 Real-Time MapReduce Framework on Wednesday November 03, 2010 @10:22PM (#1867355)
I don't think so. Percolator does not support stream operators, and it supports transaction semantic. Streaming process engine like s4 will never handle the race conditions brought by multiple writers.
I'm one of them. The weakness of yuku is most of the videos are uploaded by the website itself, not the user generated content. The reasons behind it is quite complicated...

Older »