News for hackers. Stuff that matters.

ofiryanai

Hey, very inspiring article, Redis engineer here. How do you work with static allocation on variable query structure, and row counts that can explode depending on the data shape?

And isn't there a benefit for small allocations on advanced memory allocations that you can't leverage if all is working in big page allocations? Do you implement memory allocations from scratch or leveraging existing allocator on top of these memory blocks strategy somehow?

Re:Bitchat for Gaza – messaging without internet on Sunday November 16, 2025 @12:31AM (#45943008)
So far Iran looks like the aggressive nation (who also funded Hamas and all acts of terror in the middle east instead of investing in drinking water infrastructure) thats going down, with the love of god, after 50 years since its revolution. Israel seems more resilient at the moment, only responding to savagery from Gazans. Remember October 7th and the hostages that could've ended it so much time ago
Re:Redisearch New Vector Quantization on Friday September 26, 2025 @06:18AM (#45384829)
A deep dive into Redis and Intel partnership that introduced a new Vector search compression SVS-Vamana. Discussion and benchmarks on various new quantization production-ready techniques
Re:From where I left on Tuesday December 10, 2024 @12:56PM (#42379296)
Very exciting! I sympathise with the Redis "lego" way. But don't you think that hybrid search ha meaningful use cases? E.g searches that combines BM25 or piplned search in more sophisticated way than simple filter + knn / hnsw then filter? Or maybe its more for a search engine than a cache
Re:Creating a search engine for fun and because Google sucks on Sunday September 08, 2024 @04:15AM (#41478967)
Kagi implements search from scratch, from the indexing through querying. This looks more like a frontend makeover
Re:Israel used AI to identify 37,000 Hamas targets on Thursday April 04, 2024 @01:20AM (#39926834)
They permitted larger numbers of civilians being killed in the pursuit of terrorist barbarics who raped and murdered and dragged babies with their mothers into underground dungeons, and praised themselves for that while hiding between civilians.
Dresden wasn't full of guerilla army disguised as civilians, and there weren't even the tools to target specifics as we have today. Any civilian was evacuated from north Gaza 5 months ago, secured by IDF under Hamas attacks. Those who stayed there insist on sticking to a war zone and risk to be labeled as terrorists. blowing up mosques and houses is nothing compared to raping innocents with no one to defend them miles away. And while they hold hundreds of the same innocents underground and keep provoking Israel's destruction, I see no reason to care about their precious houses. Israel is judged by Western morals in a barbaric medieval war that it was dragged into.
Vector search is no replacement for complex logic, its merely another data type like bm25 ir regular range filter. Searchbase looks to me as better fit for intuitive data exploration, rather than replacing existing robust high throughput searches
Re:Vector database is not a separate database category on Tuesday October 03, 2023 @07:22AM (#37750364)
the interest in vector database rise as an external, specialized service in a system that runs in addition to the "single source of truth" data lake where the data actually resides. like Redis and Memcached before, it solves a specific problem. Redis started to act like a fully fledged DB (with weird persistency method and guarantees) only after it was really wide-spread. sure, every DB will support vector and every vector search engine will act like a DB. But that's missing the point that vector search is an expensive problem with tradoffs that justify a specialized design

btw I'm working in a DB startup - https://hyper-space.io/

I think only 1 to 0, as the cosmic ray cause electrons to "discharge" hence lowering the voltage, assuming that 1 is a little bit higher voltage than 0. But far from an expert in electronics and physics :)
Re:Let's write a compiler, part 5: A code generator on Thursday August 19, 2021 @08:39AM (#28233062)
I'm aiming to analyze all the BI queries in my organization, some of them are quite complicated and most of them are hundreds lines of sql. Thanks for the direction, I'll dive into it
Re:Let's write a compiler, part 5: A code generator on Thursday August 19, 2021 @06:23AM (#28232180)
Hi all, I have a bit off topic question but seems related.

I'm trying to write sort of a SQL compiler. The current goal is to analyze queries and find similarities, later maybe to translate between sql dialects. I found Uber's QueryParser[1] but it's in haskell, so I started wrapping the python sqlparse[2] library and implement a Visitor to traverse their weird AST. 1. How close is it to implementing a compiler? 2. Is there theory you can suggest further reading for that matter? 3. Would you use a different language/library then I picked?

Thanks :)

[1] https://github.com/uber/queryparser [2] https://github.com/andialbrecht/sqlparse

Re:GitHub – nushell/nushell: A new type of shell on Wednesday June 16, 2021 @11:52AM (#27529934)
On top of the nice approach to structured output with pipelines, the "cross-OS first" approach is amazing! Very cool to use a modern shell that can fit both Windows and Unix by design (and not through WSL), hell I'm going to try to introduce it to my small company as a standard tool. Hope it's not in a too immature stage, however it looks very shining and promising considering the enthusiast contributors community. I'm in
Re:SSH Examples, Tips and Tunnels on Monday December 31, 2018 @03:08AM (#18793607)
I remember as the average packet size on the internet. Googling average packet size yields that- https://etherealmind.com/average-ip-packet-size/