fs90

https://github.com/nodedb-lab/nodedb

Hey HN,I've been working on a multi-model database called NodeDB.Originally, i've found out the idea of SurrealDB quite good. However, it doesn't have some graph and vector features that I need. And since it is just a KV wrapper, instead of purpose-built engine, the performance will never be close to the specialized databases (like Neo4j, Pinecone, Clickhouse, etc).And i've asked myself, what...

https://github.com/nodedb-lab/nodedb

https://github.com/farhan-syah/splintr

Hi HN,I built Splintr, a BPE tokenizer in Rust (with Python bindings), because I found existing Python-based tokenizers were bottlenecking my data processing pipelines.While OpenAI's tiktoken is the gold standard for correctness, I found I could get significantly better throughput on modern multi-core CPUs by rethinking how parallelism is applied.Splintr achieves ~111 MB/s batch throughput (vs...