News for hackers. Stuff that matters.

sachaarbonel

Re:ReefDB: A lightweight SQL database in Rust on Saturday May 06, 2023 @04:58PM (#35845310)
I'm excited to share my recent Rust project: ReefDB, a lightweight, in-memory and on-disk database management system with basic SQL query capabilities and full-text search. I built it to improve my Rust skills and provide a learning resource for those interested in database systems.

ReefDB's commit history offers insights into the development process and the incremental steps taken to build a working database system from scratch, making it a valuable learning tool for those diving into the world of databases.

*Features:*

- In-Memory or On-Disk storage options - Basic SQL statements (CREATE TABLE, INSERT, SELECT, UPDATE, DELETE) - INNER JOIN support - Full-Text Search using an Inverted Index - Custom data types (INTEGER, TEXT, FTS_TEXT)

*Future Improvements:*

- Support for more SQL statements, indexing and query optimization, transactions, user-defined functions, and much more - Improved error handling, full-text search capabilities, authentication mechanisms - Distributed database management, command-line interface, better documentation, and performance benchmarks

ReefDB is licensed under MIT, and I welcome any feedback, forks, improvements, or pull requests from the community.

If you like ReefDB, please give it a star on GitHub: [ReefDB](https://github.com/sachaarbonel/reefdb)

Thank you for your attention, and I hope you have as much fun with ReefDB as I did building it and learning from its development process!

Re:How to Build a Semantic Search Engine in Rust on Wednesday November 09, 2022 @02:00PM (#33536299)
Thanks for the clarification, I should have mentionned it
Re:How to Build a Semantic Search Engine in Rust on Wednesday November 09, 2022 @12:28PM (#33534898)
You welcome, I'm glad it helped! I can write a followup article on how to restify it and containerize it with pytorch if you want
Re:How to Build a Semantic Search Engine in Rust on Wednesday November 09, 2022 @12:22PM (#33534803)
well technically yes, but since it's in Rust once you have your embeddings, with some tweakings you could just store them and query them offline via ffi or wasm in an app for example. Also I am not a huge fan of maintaining python projects they often don't run after a while if I didn't properly maintain a virtual env etc never had this issue with Rust projects.