News for hackers. Stuff that matters.
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by piinbinary on Sunday March 19, 2017 @01:21PM (#13908363)
With drives like this, the approach of "throw more hardware at it" continues working for databases to the point where most database loads in the world can be handled on a single machine.
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by rosser on Sunday March 19, 2017 @01:38PM (#13908496)
As someone who's worked with PostgreSQL for a decade now, I've very definitely seen cases where memory bandwidth is the bottleneck, not disk bandwidth. I'm pretty sure the IO subsystem would still be a narrower pipe than main memory, even if you stuck Optane devices in every available connector at the same time and striped across them.

EDIT: Don't mistake me, I'm very excited about the potential of Optane devices in the workloads my databases handle (though, since my postgres machines are all in the cloud right now, that remains a purely theoretical question). It's just not a panacea.

Then again, nothing is.

Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by jrockway on Sunday March 19, 2017 @02:46PM (#13908872)
Scaling beyond what fits inside one computer is a reasonable concern that this addresses, but ultimately that one computer can be sucked up by a tornado at an inconvenient time, so distributed systems will always be necessary for availability and durability.
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by yjftsjthsd-h on Monday March 20, 2017 @12:41AM (#13911751)
Resiliency, yes, but maybe not performance. Still a great win :)
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by zzzcpan on Sunday March 19, 2017 @02:05PM (#13908660)
"where most database loads in the world can be handled on a single machine"

I don't think it works like that. There is always some point when at certain number of users avoiding downtime becomes more important, than handling a load and hardware performance stops matter as much.

Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by Shivetya on Sunday March 19, 2017 @02:47PM (#13908877)
high availability systems can counter this and if properly implemented you could share certain workloads with both the primary and HA systems; basically anything which doesn't change data.

the its memory and storage would be a boon to dynamic indexing and common table expressions.

maybe this new technology will bring single level storage as IBM has employed on some machines to the public. Where all storage is treated as one resource and only the machine knows the difference.

Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by kartan on Sunday March 19, 2017 @04:18PM (#13909375)
The more powerful the computers, the more data we want to aggregate and process. All that tracking that companies are gathering has to be used somewhere.

Also SaaS means that one provider holds data of thousands of companies. Salesforce, for example, has more than 100,000 customers. So the scale is still too big for one machine (or two or three for redundancy).

Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by brianwawok on Sunday March 19, 2017 @04:23PM (#13909397)
Sure but Salesforce has natural sharding. Customers never need to see each other's data. So can a single DB hold the largest customer? That is more the question here...
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by snuxoll on Monday March 20, 2017 @11:15AM (#13914866)
> Customers never need to see each other's data.

Correct and incorrect at the same time. Separate orgs may not need direct access to each others rows in the multi-tenant database, but there are plenty of use cases where data does need to be shared between them (companies with multiple orgs, like ours - business parters, etc) and Salesforce has tooling to handle this (Salesforce to Salesforce, Lightning Connect).

Re:Intel’s first Optane SSD: 375GB that you can also use as RAM by peterwwillis on Sunday March 19, 2017 @03:23PM (#13909089)
There are faster drives. Load is just one factor in database design.

For example, if you want fast query returns, the speed of light will limit you if you're using one machine and your query comes from around the world. Then there's the whole high availability thing.

One single machine just doesn't fit every scenario.