News for hackers. Stuff that matters.
Re:AWS services to avoid by ComputerGuru on Sunday May 10, 2020 @10:08AM (#23132671)
I was agreeing with you until

> And this most of the times does not happen too.

This rubs me very very wrong. There is no maybe in data integrity. Redis wasn’t designed to be ACID and shouldn’t be treated as such just because “usually” it doesn’t lose data “under the right circumstances.”

If a sysadmin uses an RDBMS with relaxed fsync, they know what they are getting (and durable writes is not one of them, no usually about it). Same for Redis.

Re:AWS services to avoid by antirez on Sunday May 10, 2020 @10:22AM (#23132779)
What I meant is that beat effort consistency can be super naive or can try hard, even without guaranteeing it, to avoid losing data in certain failure modes.
Re:AWS services to avoid by shanemhansen on Sunday May 10, 2020 @05:41PM (#23136494)
> If a sysadmin uses an RDBMS with relaxed fsync, they know what they are getting

Removing fsync is generally referred to as "running with scissors" mode, although postgres now supports it better with unlogged tables.

Re:AWS services to avoid by unexaminedlife on Sunday May 10, 2020 @06:16PM (#23136819)
Building computer systems / architectures is always about compromises. If your requirements are that "everything must be perfect always", you will never deliver anything.

I came up with a "mental framework" that allowed me to get beyond these details early when I started architecting systems for companies.

1) Identify what are the possible malfunctions

2) What mechanisms will I use to detect these malfunctions as early as possible

3) Do I have a clear and concise recovery path for said malfunctions.

This frame of thought has taken me far (in terms of being able to accomplish a lot in my career so far) and allowed me to move forward without (a) extensive, time-consuming, research into the specific tools I'm using into the specific situations which may never happen, (b) extensive costs hiring experts in these niche areas.

Re:AWS services to avoid by tfehring on Sunday May 10, 2020 @07:48PM (#23137391)
ACID guarantees feel like they can be distilled to "everything must be perfect always" - and you can ensure ACID and still ship, just by using an ACID database. It's a hard problem, but it's also a solved problem.

Sometimes you don't need ACID guarantees, which is part of the reason databases like Redis exist, and is why the compromises you're describing are important. But in this context it sounds like the framework you're describing would lead to rolling your own ACID for Redis instead of just using an ACID database to begin with.

Re:AWS services to avoid by unexaminedlife on Monday May 11, 2020 @10:12PM (#23149861)
I guess it's almost like speaking two different languages when talking about what a DB guarantees and what your application REQUIRES in the form of guarantees. Typically, in my experience, they're not the same thing. Or not ALWAYS the same thing. Within the problem space you're trying to come up with a solution for, I'd say it's highly unlikely "ACID" guarantees are sufficient to say categorically (with 100% accuracy) that "my application is perfect because: ACID".
Re:AWS services to avoid by skyde on Sunday May 10, 2020 @08:38PM (#23137708)
agree with you (computerGuru) at large scale any rare or corner case happen multiple time per day :-)

Redis was never designed for strong Synchronous replication of transaction or Strong leader election.

So each time a master crash you have a high chance of some recent acknowledged write being lost.

Re:AWS services to avoid by masnao on Sunday May 10, 2020 @10:19AM (#23132747)
> sysadmin

we live in the age of devOps. there's no such thing as sysadmin, or god forbid, DBAs.

/sarcasm

Re:AWS services to avoid by ramraj07 on Sunday May 10, 2020 @10:51AM (#23133049)
For real! Where did all those DBAs go??
Re:AWS services to avoid by lykr0n on Sunday May 10, 2020 @11:16AM (#23133257)
They're charging $400 an hour to come in and unfuck years of devs thinking they can design databases because they read a MySQL How-to Article
Re:AWS services to avoid by oneplane on Sunday May 10, 2020 @11:01AM (#23133122)
They retired and since no millennial wants to work for an Oracle degree no new ones came in to the field /s
Re:AWS services to avoid by laurentdc on Sunday May 10, 2020 @01:26PM (#23134328)
We gladly paid one 800 € for three hours of work.. fixing a botched stored procedure on IBM DB2. Gray haired DBAs with the right blend of dev, ops and most importantly business domain knowledge (something many people in IT seem to overlook) are worth gold
Re:AWS services to avoid by jcims on Sunday May 10, 2020 @11:05AM (#23133166)
infrastructure as code == infrastructure by coders