Sure it is. You just need a one to one function from person to [0, eight billion]. Use that as your array index and you're golden. 8 GB is overkill, really, you could pack some boolean datum like "is over 18" into bits within the bytes and store your database in a single gigabyte.
Writing your mapping function would be tricky! But definitely theoretically possible.
I'm old enough to have built systems with similar techniques. We don't do that much anymore since we don't need to, but it's not rocket science.
We had spell checkers before computers had enough memory to fit all words. They'd probabilistically find almost all incorrect words (but not suggest corrections). It worked fine.
Re:Big data is dead (2023)
by iraqmtpizza on Monday May 27, 2024 @06:49AM
(#40489534)
meh. memory address is the ID
Airline booking numbers used to just be the sector number of your booking record on the mainframes HDD.
Re:Big data is dead (2023)
by rrr_oh_man on Monday May 27, 2024 @07:42AM
(#40489879)
That’s why they were constantly recycled?
My jaw just hit the floor. What a fascinating fact!
Re:Big data is dead (2023)
by mauriciolange on Monday May 27, 2024 @07:43AM
(#40489880)
source?
This is such a simple scheme.
I wonder how they dealt with common storage issues like backups and disks having bad sectors.
Re:Big data is dead (2023)
by giantrobot on Monday May 27, 2024 @01:00PM
(#40492555)
They're likely record based formatting rather than file based. At the high level the code is just asking for a record number from a data set. The data set is managed including redundancy/ECC by the hardware of that storage device.
Nitpick but I cannot help myself: 8 bits are not even enough for a unique integer ID per person, that would require 8 bytes per person and then we are at 60GB already.
I agree with pretty much anything else you said, just this stood out as wrong and Duty Calls.