News for hackers. Stuff that matters.
Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by rjkennedy98 on Tuesday July 10, 2018 @09:01AM (#17497641)
Maybe not Mongo itself but schema-less NoSQL databases are very useful for Data Hubs that integrate many different data sources. If you work as I do on a team that has 100+ members, trying to integrate 25 billion documents with 30+ datasources and 60+ APIs, then a schema-less database where you can more flexibly handle changes to the document model (which are happening every day) is ideal. Trying to build that in MySQL would be a disaster.
Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by arcticfox on Tuesday July 10, 2018 @09:13AM (#17497725)
Right, but you could just build that in Postgres with JSONB
Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by ruiquelhas on Thursday July 19, 2018 @05:24AM (#17564858)
Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by shoo on Wednesday July 11, 2018 @04:08AM (#17505239)
So the question might be: when would building it as postgres + jsonb not be appropriate?
Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by sixdimensional on Tuesday July 10, 2018 @11:15AM (#17498805)
I like using tools like Apache Drill for the schemaless use case. I apply that in use cases where you’re dropping files with maybe similar schemes into a folder and doing exploratory analysis on the way to a structured solution, or for quick throwaways, or even for data integration ELT type solutions, as you mentioned. This use case works well with data vault-like architecture (or “data lakes”).

Actually, anything that can read and perform a SQL query against a standards based file in a file system (e.g. CSV, JSON, Parquet, etc. on HDFS or regular FS). Apache Hive, PrestoDB, Spark, or even some RDBMS which support Foreign Data Wrappers can do this, although some of those require a schema to be specified for querying even if the underlying files can be of different schemas. Drill doesn’t have that limitation and can literally query without metadata. Schema / data types matter so true schemaless can be difficult unless you manually map data types, but it has a place.

Re:Ask HN: Have you ever chosen Postgres over Mongo and regr... by overcast on Tuesday July 10, 2018 @10:27AM (#17498378)
The vast majority of projects are basic CRUD operations, using relational data. Not something you should ever do in a NoSQL database. That's the problem, people were using it for EVERYTHING. Your use case is very niche.