vgt
Shameless plug - if you love DuckDB but don't want to manage it yourself, or if you need a supported 3rd party ecosystem, sharing/IAM, a fully-fledged beautiful web UI - all the things beyond DuckDB that are important to adapt DuckDB as a solution - I encourage you to look at MotherDuck. You can sign up in seconds (about 17 seconds, I timed it), you get a 30 day Free Trial without having to put in a credit card. We also offer a perpetual Free Tier and a Startup Program for qualifying startups.
(co-founder at MotherDuck)
Feel free to reach out to [email protected].
(Co-founder)
- Managed storage with zero-copy clone (and upcoming time travel)
- Secure Sharing
- Hybrid Mode that allows folks to combine client (WASM, UI, CLI, etc) with cloud data
- Approved and supported ecosystem of third party vendors
- Since we're running DuckDB in production, we're working very closely with the DuckDB team to improve both our service and open source DDB in terms of reliability, semantics, and capabilities
(co-founder at MotherDuck)
Vector Similarity Search in DuckDB
Build Sub-Second Data Applications with Motherduck's WASM SDK
Differential Storage: A Key Building Block for a DuckDB-Based Data Warehouse
The Column Explorer: A Birds Eye View of Your Data
We at MotherDuck took an incremental approach. We launched something more akin to lane-assist. We're calling it FixIt - an in-flow visual aid to help you identify and fix errors in your SQL [0].
I think there's gobs of opportunities to improve the analytics experiences without resorting to "L5 self-driving" (e.g. full text-to-results)
[0] https://motherduck.com/blog/introducing-fixit-ai-sql-error-f...
What's really exciting is what you can do with DuckDB, MotherDuck, and WASM. A powerful in-browser storage and execution engine tethered to a central serverless data warehouse using hybrid mode [1] opens the doors for unprecedented experiences. Imagine the possibilities if you have metadata, data, query logic, or even LLMs in the client 0ms away from the user and on user's own hardware.
So we're doing this in our UI of course, but we also released a WASM SDK so that developers can take advantage of this new architecture in their own apps! [2]
[0]https://motherduck.com/blog/introducing-fixit-ai-sql-error-f...
[1]https://motherduck.com/docs/architecture-and-capabilities
(head of produck at MotherDuck)
An open source DuckDB text to SQL LLM
Perf Is Not Enough
Just Released: Hybrid Query Processing Paper at CIDR 2024
Global economy relies on this stability, and US benefits the most from the stability of the global economy.
We also didn't "spend 75 billion dollars". Very little actual cash went to Ukraine from the US. We gave them old stockpiles, which we were going to decommission anyway, and paid maintenance for. We also paid US companies to increase production (of ammunition for example), and given that the Russia conflict is increasing demands for ammunition, increasing supply is not a bad thing.
This is such a lazy talking point permeating conservative spheres. And it quite likely coming straight from Russia psy-ops.
(co-founder and head of produck, feel free to reach out)
"The team at DuckDB Labs has been hard at work improving the performance of the out-of-core hash aggregates and joins."
Aside from that, since April DuckDB has vastly improved performance of a number of queries, including aggregates, joins, window functions. [0]
[0] https://duckdb.org/2023/09/26/announcing-duckdb-090.html#cor...
Yes, we are indeed a good use case for this. For one, we built a fully-fledged managed storage system on top of DuckDB, with better performance and caching and the like. Two, we're going to be pretty good at reading from S3 because we've optimized that path. Three, our storage has sharing/IAM and is about to have things like zero-copy clone and time travel.
Happy to answer any Qs.
(Head of Produck at MotherDuck and a huge fan of DuckDB)
One of the reasons we exist is because DuckDB is meant to be a single-player database. MotherDuck is doing tons of heavy-lifting to turn it into a true multi-player data warehouse, so things like IAM/sharing, persistence, time travel, administration, the ecosystem and so forth.
What's magical about MotherDuck is that virtually any DuckDB instance in the wild can connect to MotherDuck by simply running '.open motherduck:' [1], and suddenly you get all these aforementioned benefits.
[1] https://motherduck.com/docs/getting-started/connect-query-fr...
DuckDB performance improvements with the latest release
Making PySpark Code Faster with DuckDB
[0] https://www.theguardian.com/technology/2023/sep/26/eu-warns-...