News for hackers. Stuff that matters.
Re:Free tools to help with data analysis by jabberthemutt on Monday February 25, 2019 @03:43AM (#19244070)
Low quality listicle SEO spam for their 'courses'. Submitter is abusing HN to spam nothing but links to their site.

Please avoid giving this kind of noise any attention or links.

Re:Free tools to help with data analysis by wodenokoto on Monday February 25, 2019 @04:24AM (#19244231)
I agree that this is very low quality. It is basically 5 of the names of 5 random tools with a generic description.

What is a good way to deal with low quality submissions on HN? We can't downvote and even posting on the link is a positive signal.

Re:Free tools to help with data analysis by jabberthemutt on Monday February 25, 2019 @11:08AM (#19246584)
I usually comment and flag.
Re:Free tools to help with data analysis by davedx on Monday February 25, 2019 @01:21AM (#19243463)
I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk!

https://datadojo.app

Re:Free tools to help with data analysis by ivan_ah on Monday February 25, 2019 @06:00AM (#19244683)
Interesting. Very nice to see live-updating of results like Excel.

Python fails on this transform function:

  def f(a):
      v = a if a >= 4 else 2
      return v
Message in red: "Error: (Brython compile error)"

Update: I recommend you try https://pypyjs.org/ for python in the browser.

Re:Free tools to help with data analysis by davedx on Wednesday February 27, 2019 @08:19AM (#19263026)
I looked into this more. The issue is, at least in a default input, a is an array type, so you need to either access a[0] or map over it. e.g. this works:

  def f(a):
    v = a[0] if a[0] >= 4 else 2
    return v
It looks like the main issue here is getting the correct compile error from Brython. Funnily enough this seems easier to do for the PySpark version :)
Re:Free tools to help with data analysis by davedx on Monday February 25, 2019 @06:08AM (#19244721)
Thanks! I’ll look into it. The reason I chose Brython was because it transpiles in the browser, so no server side compilation needed.
Re:Free tools to help with data analysis by throway88989898 on Monday February 25, 2019 @12:37AM (#19243270)
*Data

TLDR:

Anaconda - Python package manager

Rstudio - IDE

OpenRefine - data cleaning

Apache Airflow - programmatically author, schedule, and monitor workflows

H2O - Statistical and ML Algorithms

You may also like

https://github.com/Gerenuk/Data-Science-Notes/blob/master/to...

https://github.com/bulutyazilim/awesome-datascience

Re:Free tools to help with data analysis by hgasimov on Monday February 25, 2019 @02:44AM (#19243808)
Plotly for visualization, Shiny for creating interactive reports in R, Dash for creating interactive reports in Python
Re:Free tools to help with data analysis by wodenokoto on Monday February 25, 2019 @02:44AM (#19243813)
Is there a relationship between Open Refine and Google clouds Data Prep?
Re:Free tools to help with data analysis by henrikberggren on Monday February 25, 2019 @01:35AM (#19243520)
What is this exciting dana analysis you speak of!!??
Re:Free tools to help with data analysis by xrd on Monday February 25, 2019 @01:42AM (#19243552)
I don't know anything about Dana analysis and I'm 45. My career is done! Technology moves so fast!
Re:Free tools to help with data analysis by mirimir on Monday February 25, 2019 @01:38AM (#19243535)
DNA data?