News for hackers. Stuff that matters.
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by rubenvanwyk on Friday May 30, 2025 @08:10AM (#44135384)
Cannot wait for OrioldeDB to reach General Availability. Postgres needs options for open-source separation of storage and compute.
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by the_duke on Friday May 30, 2025 @08:14AM (#44135423)
That kind of exists thanks to NeonDB? https://neon.com

Althoug with them being recently acquired by Databricks it remains to be seen how the open source version will fare.

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by akorotkov on Friday May 30, 2025 @05:12PM (#44139933)
> That kind of exists thanks to NeonDB?

This is unrelated to NeonDB. OrioleDB has been acquired by Supabase. https://supabase.com/blog/supabase-acquires-oriole

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by mattashii on Saturday May 31, 2025 @06:54AM (#44143405)
Neon is indeed unrelated to OreoleDB, but Neon does also provide the separation of storage and compute in Postgres which GP asked about ("Postgres needs options for open-source separation of storage and compute"). A mention of Neon (which is Apache 2 licensed) therefore isn't totally unwarranted.
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by rubenvanwyk on Sunday June 01, 2025 @02:28PM (#44152816)
I understand Neon is open source and I think it’s an awesome product, but apart from the risks associated with longevity of open source once a company gets acquired - although the storage engine is open source, the control plane isn’t and is non-trivial to implement oneself. Orioldedb is positioned as a Postgres extension, which is must easier to setup (even on an existing operating database) than migrating to a completely different architecture that Neon provides.
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by dkhenry on Friday May 30, 2025 @08:58AM (#44135765)
OrioleDB isn't a separation of storage and compute, its a more efficient storage engine for Postgres to replace the existing HEAP engine. This is like how in MySQL we could swap MyISAM for InnoDB and eventually RocksDB.

I did some benchmarks on it previously to show how much of an improvement it gives over the stock HEAP engine

EDIT: correct link to the public dashboard below, thanks for the heads up @kiwicopple

https://airtable.com/app7jp5t0dEHyDpa8/shr00etqywoDW2N6N

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by CathalMullan on Friday May 30, 2025 @10:02AM (#44136336)
There's an experimental feature which separates storage and compute.

https://www.orioledb.com/docs/usage/decoupled-storage

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by kiwicopple on Friday May 30, 2025 @09:15AM (#44135937)
fwiw I couldn't access your airtable link, but I found this one online:

https://airtable.com/app7jp5t0dEHyDpa8/shr00etqywoDW2N6N

thanks for running the benchmarks, it helps to have external parties verifying the progress

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by iamdanieljohns on Friday May 30, 2025 @01:40PM (#44138386)
Is the need for Oriole negated by using a system that separates storage from compute like Neon, Xata?
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by tudorg on Friday May 30, 2025 @02:56PM (#44138972)
Answering on behalf of Xata, it is orthogonal. I'm curious to try out Oriole on our platform when I get some time.
Re:Bridged Indexes in OrioleDB: architecture, internals and ... by nikita on Friday May 30, 2025 @02:31PM (#44138807)
(Neon CEO)

Not really. OrioleDB solve the vacuum problem with the introduction of the undo log. Neon gives you scale out storage which is in a way orthogonal to OrielDB. With some work you can run OrioleDB AND neon storage and get benefits of both.

Re:Bridged Indexes in OrioleDB: architecture, internals and ... by akorotkov on Friday May 30, 2025 @05:10PM (#44139924)
> OrioleDB solve the vacuum problem with the introduction of the undo log.

Way more than just this!

> With some work you can run OrioleDB AND neon storage and get benefits of both.

This would require significant design work, given that significant OrioleDB benefits are derived from row-level WAL.