tshiran
Re:“Starflake Reflections”, Expanded REST APIs, and More – Dremio 2.0
on Wednesday April 25, 2018 @02:52PM (#16924796)
This is great. Starflake reflections are so much nicer than old fashion cubes.
Re:Analysis of strengths/weaknesses of Apache Arrow
on Tuesday March 27, 2018 @12:59PM (#16690457)
Arrow has really taken off over the last year. I'm seeing it in tons of different projects.
Re:Do we need a third Apache project for columnar data representation?
on Tuesday October 31, 2017 @12:45PM (#15594605)
I would argue that the fact that Arrow has been integrated into so many projects over the last year is proof that a separate project made sense. Dremio, PySpark, Pandas, MapD, NVIDIA GPU Data Frame, Graphistry, Turbodbc, ...
Looking Back at How We Exited Dremio from Stealth
Re:The Decline of Investment in San Francisco Startups
on Friday July 21, 2017 @02:29AM (#14818485)
We considered starting a company in SF a couple years ago. I'm glad that we decided to instead start it in Mountain View (http://www.dremio.com). We're able to attract very talented people from San Jose, Milpitas, Redwood City, etc. where rents are a bit more reasonable.
Re:Gpu.js – GPU Accelerated JavaScript
on Friday July 14, 2017 @09:06PM (#14774477)
This is cool
Data Debt Calculator
Re:The Data Science Process
on Monday February 13, 2017 @12:22PM (#13636954)
Great article, this is the exact process I've observed multiple times.
What can LIGO see? Let's look at gravitational waves with SQL
Re:Splitting Equity Among Founders
on Wednesday December 02, 2015 @04:32PM (#10665993)
Unless there's a really good reason to not split it equal, I think it's better if both founders have the same amount of equity. Otherwise you could create unnecessary tension which is the last thing you want at that early stage.
Re:Apache Drill 1.0 – Schema-Free SQL Query Engine for Hadoop and NoSQL
on Tuesday May 19, 2015 @01:51PM (#9571858)
Nice
New Apache Drill release enables “SQL on anything”
Running SQL Queries on Amazon S3
Re:Apache Drill: Schema-free SQL Query Engine for Hadoop and NoSQL
on Wednesday December 03, 2014 @12:15PM (#8694935)
Another analogy that might help is strongly typed vs. loosely typed languages. There are pros and cons to both Java and Python, and both are widely used.
Re:Apache Drill: Schema-free SQL Query Engine for Hadoop and NoSQL
on Wednesday December 03, 2014 @12:14PM (#8694931)
I think there's a tradeoff here. It's like MongoDB - hundreds of thousands downloads per month because it enables people to build and deploy applications faster. For many cases a relational database is still better though.
The nice attribute of Drill is that it works on schema-less data as well as data with strong schemas. The user can make the tradeoff between agility and 'safety'.
Re:Apache Drill: Schema-free SQL Query Engine for Hadoop and NoSQL
on Wednesday December 03, 2014 @03:12AM (#8692481)
It depends what you mean by layout. If you add/remove/change the fields in the records, Drill can handle that. It can also handle a situation where you move from one format (say JSON) to another format (Parquet) and have mixed formats in a directory.
Drill is described as schema-free, but the data doesn't have to lack schema. Some data (Parquet, Avro) has schema, while some data (JSON, HBase, MongoDB) doesn't (ie, each record could have different fields). Drill is designed to allow queries on any data. Also, Drill leverages the structure that's embedded in the data without requiring IT to redundantly define schemas in a centralized schema repository. In other words, if there's a schema embedded in the Parquet file, why require the user to then go and maintain the same schema, explicitly, in Hive metastore?