News for hackers. Stuff that matters.
Re:Open Sourcing Dicer: Databricks' Auto-Sharder by atuladya on Tuesday January 13, 2026 @06:30PM (#46610016)
Right - this is not about sharding data/datasets. This is for sharding in-memory state that a service might have. The problem of building services at low cost, high scale, low latency and high throughput is common in many environments including our services at Databricks, and Dicer helps with that.

There are no comments on this comment yet.