mattexx
Re:Engineers Shouldn’t Write ETL
on Saturday March 19, 2016 @09:11AM (#11318362)
The best-case outcome of many efforts of data scientists is an artifact meant for a machine consumer, not a human one.
I posit this outcome is absolutely necessary for any data science project to be worthwhile in any organization.
In the case where the project produces a report and goes no further, you still need the data and code for reproducibility, one of the main principles of the scientific method [1].
In the case where the project gets handed off to engineers to re-implement, reproducibility is even more critical, since the engineers best effort to reproduce the code will almost certainly not be successful the first time, and you will need to validate many versions of the production model. Doing this by hand even once it wasteful, doing so many times is tragically so.
In the case where the data scientists can produce a service worthy of production use, kudos!! But understand the caveat that in truly big data or big compute flows, this outcome remains highly unlikely.
Re:A short fable of software engineering vs. regular engineering
on Sunday January 10, 2016 @12:53PM (#10876231)
Hacking != Software Engineering
Re:0 A.D.: A free, open-source game of ancient warfare
on Friday November 27, 2015 @09:45PM (#10639790)
I downloaded today and played a couple rounds on my c2007 MacBook Pro. I did notice occasional lag in 2 player mode but nothing horrific. I didn't see anything that felt like a bug. Very nice!
Re:Otto: Meet the Successor to Vagrant
on Saturday November 14, 2015 @09:02AM (#10565688)
Sounds like Rails for Devops. Works great until it doesn't...
Re:GitHub user 4148 just starred 129k repositories and still counting
on Thursday November 05, 2015 @10:43PM (#10517726)
meh
Re:Code Review – A Needed Habit in Science
on Friday October 30, 2015 @10:03AM (#10477847)
+1. We review pretty much all code at Climate Corp (even science code) but code review seldom reveals design flaws. I still think code review is incredibly useful. It makes all of us better coders. It just isn't everything.
Re:Volkswagen's U.S. head: individuals engineered emissions cheating
on Thursday October 08, 2015 @02:41PM (#10355035)
...and monkeys might fly out of my butt. :-D
Re:I'm Obsessed with San Francisco's Bunk-Bed Craigslist Ads
on Saturday September 26, 2015 @09:00AM (#10282985)
There were plenty of RVs on Duboce under the 101 in the Mission when I worked there ~2010. And on International Blvd when we left Oakland last year. I'm sure there are plenty of other undesirable neighborhoods around the bay area. Not that I'd recommend it...
Re:How a car works (2012)
on Friday July 17, 2015 @10:37AM (#9902932)
This all begs the question, "What kind of car do you drive?" :)
Re:Don't Enforce R as a Standard
on Friday April 03, 2015 @03:34PM (#9317902)
Peer review is a huge part of our culture here at Climate. It's often unreasonable to expect a single reviewer to review a complex paper, so we sometimes address this by assigning each reviewer a domain.
Something like:
Reviewer 1: Review scientific theory (domain expert)
Reviewer 2: Review scientific methods and conclusions (senior scientist)
Reviewer 3: Review code for scientific accuracy (senior programmer)
Re:Try Three Times
on Friday March 06, 2015 @12:53PM (#9158391)
I agree that using exceptions as flow control is b-a-d. This is an easy fix in this case, set `:throw-exceptions false` in your http call and check the status code, rather than catch exceptions.