News for hackers. Stuff that matters.
Re:FeatureBase: Open-Source, Real-Time Database Built on Roa... by JAA1337 on Wednesday September 14, 2022 @09:09AM (#32836635)
I've seen bitmaps mentioned a number of times lately. I must admit it is not something I am all that familiar with. Can someone explain to me why bitmaps are more valuable than standard column oriented databases?

I havn't wrapped my head around how this helps speed up queries while data is being ingested.

Re:FeatureBase: Open-Source, Real-Time Database Built on Roa... by kurosknight on Wednesday September 14, 2022 @10:34AM (#32837824)
They are useful for categorical variables. For example, is a record in the "Likes motorcycles" category? They are fast because (well, one reason) bitwise logical operations are very fast for CPUs to do.

Adtech is an example of a sector that benefits from this...they slice and dice datasets a lot to target ad campaigns and such. Being able to do that quickly is useful.

Re:FeatureBase: Open-Source, Real-Time Database Built on Roa... by JAA1337 on Wednesday September 14, 2022 @10:47AM (#32837998)
So are you saying that the data is stored in categories which allows for those types of lookups to run faster? Do you have specifics on how the design of a bitmap based database achieves this? How does it maintain these relationships? Just through 0 and 1's?

I guess it's easy for me to visualize both row and column based. Im struggling with the bitmaps concept.

Re:FeatureBase: Open-Source, Real-Time Database Built on Roa... by kordlessagain on Wednesday September 14, 2022 @04:49PM (#32843153)
Here's a good write up on some of what you are asking in their blog: https://www.featurebase.com/blog/bitmaps-making-real-time-an...
Re:FeatureBase: Open-Source, Real-Time Database Built on Roa... by witchbane on Wednesday September 14, 2022 @11:18AM (#32838442)
So is the thinking you run them alongside a traditional RDBMS as sort of a cache or view optimized for bitwise operations?