News for hackers. Stuff that matters.
Re:Apache Drill's Future by timClicks on Wednesday May 20, 2020 @04:01PM (#23251099)
I'm really impressed with the misson of Drill - write SQL for disparate data sources - but I've actually never installed it. When I have a bunch of parquet/csv/... files sitting around, I can normally slurp them in with pandas.
Re:Apache Drill's Future by cgivre on Thursday May 21, 2020 @10:57AM (#23259104)
Try it out! I'd agree that if you have 1 CSV you don't need Drill. If you have more than one, is where it starts to get interesting. Also there is PyDrill which enables you to execute a Drill query and put the results directly into a pandas data frame. If you're an R person, there's Sergeant that does the same.
Re:Apache Drill's Future by timClicks on Thursday May 21, 2020 @11:20PM (#23268369)
Are you Charles Givre? I have your book!
Re:Apache Drill's Future by cgivre on Friday May 22, 2020 @11:25AM (#23273105)
I am!! Glad to hear you liked the book!