News for hackers. Stuff that matters.
Re:The DuckDB Local UI by stared on Wednesday March 12, 2025 @10:48AM (#43343859)
I really like the columns explorer, https://motherduck.com/blog/introducing-column-explorer/.

Just a few days ago I have been looking for existing column explorers that look like from Kaggle Dataset, but I was not able to find anything. And this one by DuckDB is better!

Re:The DuckDB Local UI by thenaturalist on Wednesday March 12, 2025 @10:53AM (#43343914)
I have seen a ton of DB GUI clients/ cloud based data tools for analytics purposes and the fact that MotherDuck's column explorer/ column data distribution is hands down the best I know is puzzling me.

It seems nobody else besides them cares.

Seeing data distribution, unique values, min/ max/ percentiles is so easy and powerful.

Really commend whoever came up with that.

It's a bit of a shame this metadata cannot be queried itself, would be immensely useful for automatic data profiling/ QA at scale.

Re:The DuckDB Local UI by stared on Wednesday March 12, 2025 @11:03AM (#43344020)
Do you know if there is any open source TypeScript component that can be used in a project?
Re:The DuckDB Local UI by thenaturalist on Wednesday March 12, 2025 @11:05AM (#43344047)
None of the UI is OSS as far as I am aware. :/
Re:The DuckDB Local UI by hamilton on Wednesday March 12, 2025 @12:54PM (#43345209)
True; at the moment the UI is not open source. We've talked about releasing the Column Explorer as a standalone component, but haven't been able to prioritize it yet. We'd like to!
Re:The DuckDB Local UI by stared on Thursday March 13, 2025 @09:29AM (#43353134)
It would be wonderful for the community - as it is the best tool in the class.

And foremost - thank you for designing this awesome component!

Re:The DuckDB Local UI by mritchie712 on Wednesday March 12, 2025 @11:03AM (#43344022)
it's partly bc this would be extremely slow and expensive with many other databases (e.g. it'd be really slow on postgres, very expensive on snowflake).
Re:The DuckDB Local UI by aszen on Wednesday March 12, 2025 @12:46PM (#43345114)
Re:The DuckDB Local UI by oulipo on Wednesday March 12, 2025 @10:57AM (#43343942)
Seems heavily inspired by the column summary of ObservableHQ, but that's nice!
Re:The DuckDB Local UI by hamilton on Wednesday March 12, 2025 @12:47PM (#43345133)
(I designed and built the Column Explorer feature)

Observable's column summary feature is very nice! But I do think there's a very common lineage around these kinds of diagnostics which motivated both Observables and ours. See Jeff Heer's profiler paper[1] for more.

I'm very passionate about this area because I think "first mile problems" are underserved by most tools, but they take the longest to work out.

We had to do some gnarly things[2] to make this feature work well; and there's a lot of room to make it scale nicely and cover all DuckDB data types.

[1] http://vis.stanford.edu/papers/profiler [2] https://motherduck.com/blog/introducing-column-explorer/

Re:The DuckDB Local UI by oulipo on Wednesday March 12, 2025 @01:30PM (#43345608)
Interesting, I guess there's plenty of ideas to grab from their work too! https://observablehq.com/documentation/cells/data-table
Re:The DuckDB Local UI by thenaturalist on Wednesday March 12, 2025 @06:16PM (#43348220)
Personally, thank you for this awesome work!

I find the ease and intuitiveness of navigating it as well as the clarity of the information presented even for the density of a small window or many columns outstandingly pleasant.

Kudos to you!