Re:Show HN: CozoDB, Hybrid Relational-Graph-Vector DB, the H...
by zh217 on Thursday April 20, 2023 @12:35PM
(#35642553)
For the parquet question: currently CozoDB is developed by a single developer (me), but I am starting to explore ways of expanding the development team. Certainly a lot more features will be added if that happens, and parquet support looks like a really useful one.
Re:Show HN: CozoDB, Hybrid Relational-Graph-Vector DB, the H...
by anonzzzies on Thursday April 20, 2023 @01:54PM
(#35643677)
Any contact info for you to discuss contributing?
Re:Show HN: CozoDB, Hybrid Relational-Graph-Vector DB, the H...
by zh217 on Thursday April 20, 2023 @12:30PM
(#35642480)
Yes this is correct, only the query's answer set need to be in memory. We are also working on streaming for the Rust API, in which case you don't even need to keep the whole set in memory for simple queries.
FYI here is a not very rigourous performance and memory usage analysis (for a previous version without the vector search capability): https://docs.cozodb.org/en/latest/releases/v0.3.html
Re:Show HN: CozoDB, Hybrid Relational-Graph-Vector DB, the H...
by luizfelberti on Thursday April 20, 2023 @12:37PM
(#35642579)
Thanks for the speedy response!
Cozo is looking like a top-contender for my project so far :)
By larger than RAM I mean the entire WikiData knowledge graph (~100GB), with something like 16GB of RAM.
Another question: any plans for supporting Parquet files with query pushdown? I honestly doubt Parquet's efficiency can be matched with RocksDB (but I'm happy to be proven wrong), and having to convert big datasets is always a pain...