News for hackers. Stuff that matters.
Re:As Digg Struggles, VP Of Engineering Is Shown The Door by gaiusparx on Tuesday September 07, 2010 @05:39PM (#1670187)
The other problem is they have been hyping V4 for a long time by making beta testing invite only and hard to get. It would have been better if they can have a public V4 beta running in parallel with V3 since it is a rewrite.
Re:As Digg Struggles, VP Of Engineering Is Shown The Door by blantonl on Tuesday September 07, 2010 @06:56PM (#1670376)
you can't do a parallel beta test of two functionally different sites. You would end up with two separate data stores, workflows, and ultimately a confused user base.

Never mind the fact that the user base is confused by the rollout.

And never mind the fact that Google has forever damaged the term "Beta" in the minds of general Web consumers.

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by patio11 on Tuesday September 07, 2010 @07:17PM (#1670427)
And never mind the fact that Google has forever damaged the term "Beta" in the minds of general Web consumers.

The general web consumer still thinks betas are a type of fish. Not really relevant to the median Digg user, though, since they are not the general Web user.

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by dawie on Tuesday September 07, 2010 @05:42PM (#1670192)
Even better: Have a link that says: "Try the new Beta" at the top like gmail and google docs, with a "Go back to Old Version".

Implementing this should not be to hard and it allows them to get some feedback.

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by pilif on Tuesday September 07, 2010 @06:39PM (#1670329)
Considering the completely different backends of v3 and v4, I think, this would have been incredibly hard to implement. At least if changes in one system should end up in the other.

In this case you would not just have to write scrips to one-time migrate all needed data from v3 mysql to v4 Cassandra.

No. You would have to build a mechanism that doesn't just do it in both directions, it would also have to work at near-realtime speed.

If you then need consistency of the transferred data, this quickly gets impossible. Try finding a way to ensure consistency between these two completely different architectures.

In the end, most of v3 would have needed to be rewritten for a parallel use to be possible, at which point you don't really gain much.

"not hard to implement" - sigh

Disclaimer: I don't work at digg and I don't know more about their backend than the rest of the public. I did however just get around doing something like what you describe and there it wad "just" a different schema on the same database backend and even just that would have been hell

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by MartinCron on Wednesday September 08, 2010 @12:02AM (#1670981)
In a way, the one-time migration might be harder than near-realtime bidirectional synchronization. That way, you could move portions of users to the new system and back as needed. A sudden leap from one backend to another is like jumping over the grand canyon on a motorcycle. Personally, I would rather build a bridge.
Re:As Digg Struggles, VP Of Engineering Is Shown The Door by pilif on Wednesday September 08, 2010 @03:28AM (#1671295)
For the concurrent configuration to work consistently, digg would probably have to port v3 to the new backend.

Now in the current case, the most issues apparently come from the non-working backend as opposed to the changed featureset.

So while they could have run the two versions in parallel, they would not have gained anything. Likely, this was their rationale behind not doing so in the first place.

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by MartinCron on Wednesday September 08, 2010 @01:36PM (#1672634)
No, for the current configuration to work, you would have to create a way to move data in both directions from the "old" backend to the "new" backend. Ideally, you would slice up the beast so you didn't have to do this with everything all at once.

It's not a system that would be ideal for something transactional like a bank, but it may have been possible for an organization like Digg.

Re:As Digg Struggles, VP Of Engineering Is Shown The Door by bryanh on Tuesday September 07, 2010 @06:08PM (#1670264)
As a developer myself, I love hearing:

> Implementing this should not be to hard...