News for hackers. Stuff that matters.
Re:Visualize data instantly with machine learning in Google ... by mbesto on Friday June 02, 2017 @11:24AM (#14470550)
When I worked for SAP back in 2007 (I was a fresh grad at the time), I was working in the business intelligence (reporting, analytics, and data warehousing) group and noticed how cumbersome it was for organizations to simply create and view reports (we're talking millions of dollars). I once said to my boss "you realize that in the future we'll simply just write 'show me a line graph for sales in the northeast'".

And so here we are now.

Re:Visualize data instantly with machine learning in Google ... by tryitnow on Friday June 02, 2017 @12:15PM (#14471015)
I'm currently evaluating BI vendors for my company and just about every major contender has this functionality or is developing it. Read the Gartner report from 2017 and they basically just come out and say that this will be the new standard in BI.

The much harder problem is data management and preparation. Anyone with half a brain and a decent visualization tool can create basic graphs - but that doesn't mean they should, especially if the organization doesn't have good data management processes in place.

Issues like data governance, data prep, and data modelling are the major pain points for me. And honestly, developing a useful BI solution is more about culture change than it is technology. If a company has poor data governance, it doesn't matter how whiz-bang their technology is, they're still not going to get useful insight from their numbers.

Re:Visualize data instantly with machine learning in Google ... by ozataman on Friday June 02, 2017 @01:45PM (#14471905)
And data management / preparation is where major mistakes are made - get a join wrong and you may easily be missing data or double counting something just obscure enough to go unnoticed like "ancillary sales".

There is something potentially harmful, or perhaps that needs addressing, about end-user tools growing in expressive power. A good friend who does statistical genetics work once told me "but I don't want every user running their own regressions and drawing nonsensical conclusions from badly prepared data!"

Re:Visualize data instantly with machine learning in Google ... by shostack on Friday June 02, 2017 @07:53PM (#14474080)
Yep. Wake me when an AI can tell me "hey, that monthly trending conversion report you asked me to pull...yeah, you're missing two days worth of data when tracking broke, so it will just make your numbers look lower when rolled-up monthly and be hard to notice."

BTW, that is also the reason I not only set alerts, but review data at a daily level when pulling any rolled-up reports of significance.

Re:Visualize data instantly with machine learning in Google ... by kyleschiller on Friday June 02, 2017 @11:21PM (#14474840)
Why can't AI tell you you're missing data?
Re:Visualize data instantly with machine learning in Google ... by massaman_yams on Tuesday June 06, 2017 @02:53AM (#14495290)
For most use cases, you don't even need AI. Once you reach a certain scale, there are certainly ML-based solutions available: https://medium.com/netflix-techblog/rad-outlier-detection-on...
Re:Visualize data instantly with machine learning in Google ... by gefh on Friday June 02, 2017 @07:25PM (#14473962)
That ship sailed somewhere around Excel 95...
Re:Visualize data instantly with machine learning in Google ... by temp246810 on Friday June 02, 2017 @05:57PM (#14473613)
Just out of curiousity, which one did you go with?

We're in the middle of doing this ourselves and would like to hear a random HNers thoughts on the subject.

Re:Visualize data instantly with machine learning in Google ... by paulrosenzweig on Friday June 02, 2017 @07:52PM (#14474072)
I'm at a ~100 person company. We've been using Mode for about six months and like it.
Re:Visualize data instantly with machine learning in Google ... by primeblue on Friday June 02, 2017 @08:57PM (#14474327)
Microsoft PowerBI
Re:Visualize data instantly with machine learning in Google ... by elorant on Friday June 02, 2017 @12:14PM (#14471002)
The problem is that this approach requires well structured data and most corporations have data all over the place, in legacy systems or some half-assed backed solution that kind of works. So even if you provide them with some state of the art platform that pulls graphs out of thin air they'd still need shitloads of consulting and custom made tinkering to make it work.

The other problem is that most executives don't even know what kind of graphs/reports they need. Sure, they can have the classic sales by region and stuff, but the really important things are hidden and require a lot of digging and asking to get to.

Re:Visualize data instantly with machine learning in Google ... by MitjaBezensek on Friday June 02, 2017 @11:41AM (#14470700)
So many of our clients (I'm still working in the BI space) are still using Excel workbooks and sending them to each other over email. I think it will take quite some time before we see any major improvements in this area. But I agree with you. Some of the stuff I see makes me cringe.
Re:Visualize data instantly with machine learning in Google ... by tempfs on Friday June 02, 2017 @12:24PM (#14471107)
Excel is the appropriate tool for one-off adhoc analysis.

When something needs to be regularly produced, then and only then should it be moved to a formal BI solution.

People have a lot of questions and Excel is an approachable tool for small analysis that users can self-serve with.

Re:Visualize data instantly with machine learning in Google ... by cat199 on Saturday June 03, 2017 @12:10AM (#14474965)
OMG you are so like 5 days ago..

everybody knows the correct answer is jupyter notebooks, and totes everyone like uses them, that's what it said on my facebook the other day.

Re:Visualize data instantly with machine learning in Google ... by cat199 on Saturday June 10, 2017 @12:14PM (#14527847)
wow forgot to add /s here, clearly lol
Re:Visualize data instantly with machine learning in Google ... by simo7 on Friday June 02, 2017 @03:20PM (#14472622)
I doubt it.

NLP interfaces in reporting work for simple things, when you want to start doing more advanced things they become incredibly verbose and inconsistent.

That's where a well designed UI really shines...and will continue to do so.

Re:Visualize data instantly with machine learning in Google ... by peatmoss on Friday June 02, 2017 @06:09PM (#14473663)
And I'd argue that a well-designed UI only goes so far, and that eventually you need the expressiveness of some sort of programming language. This suggests a hierarchy of user interfaces for complex tasks:

structured language > purpose-specific UI > natural language (processing)

Old adventure games were really illuminating with respect to limitations of natural language interfaces. Rather than allowing for the expressiveness of natural language, you simply had the feeling of groping around like a blind child at an easter egg hunt for the few valid operations that existed.

I feel like this using GUI tools for data tasks. It's like being forced to communicate by banging rocks together compared to, say, the expressive power of R or Python.

I wonder if natural language interfaces could leapfrog GUIs if we all up and learned something like Lojban...

Re:Visualize data instantly with machine learning in Google ... by simo7 on Saturday June 03, 2017 @12:13PM (#14477020)
"Show me country & city as rows, year as a column, sum the amount of population for country/city combination, show the YoY as a column and the subtotal for city".

Really? That's 3 clicks a way with a well-designed UI.

And what if I have those 3 fields in different tables? Even more verbosity...

P.S: My job has nothing to do with designing UIs, just to dispell any doubt :)

Re:Visualize data instantly with machine learning in Google ... by hacker_9 on Friday June 02, 2017 @01:24PM (#14471715)
Watching the gif on that page, it actually seems slower to use. Instead of just drag selecting the table, I have to write out all the header text now by hand.
Re:Visualize data instantly with machine learning in Google ... by blazespin on Friday June 02, 2017 @07:05PM (#14473902)
Yeah, this. It's cool but you probably have to match some grammar and really it's just a long text format for some keyboard shortcuts a pro could do.

That being said, it's a start. SQL as natural language.

Re:Visualize data instantly with machine learning in Google ... by putlake on Friday June 02, 2017 @08:05PM (#14474114)
It will all be voice driven soon so natural language has an advantage over using hands.
Re:Visualize data instantly with machine learning in Google ... by Nydhal on Friday June 02, 2017 @11:36AM (#14470663)
> we'll simply just write 'show me a line graph'

How about we just 'say' it ? At one hackathon, I had the idea of making an Alexa skill that would translate simple voice commands like 'graph column A' into matplotlib functions and then show the graphs. Teammates weren't too excited about spreadsheets though.

Re:Visualize data instantly with machine learning in Google ... by reitanqild on Friday June 02, 2017 @12:14PM (#14471009)
Wouldn't that make "mechanical keyboards for everyone in the open floorplan" seem like a smart decision?
Re:Visualize data instantly with machine learning in Google ... by elefanten on Friday June 02, 2017 @12:40PM (#14471250)
I think that depends... open floorplans already have plenty of ambient noise usually. Chatter, people on phones and web calls. If the voice input picked up in a small range and people got in the habit of kinda semi-whispering their occasional commands... I doubt it'd be a massive difference.

But I'm assuming lots of things, I can also envision your scenario playing out to great annoyance.

Re:Visualize data instantly with machine learning in Google ... by Roverlord on Wednesday June 07, 2017 @06:58AM (#14505128)
https://en.wikipedia.org/wiki/Subvocal_recognition

You don't necessarily need to make noise to speak to computers.

Re:Visualize data instantly with machine learning in Google ... by hacker_9 on Friday June 02, 2017 @01:37PM (#14471837)
Just need to bypass the mouth and jack-in directly to the speech center in the brain.
Re:Visualize data instantly with machine learning in Google ... by reitanqild on Friday June 02, 2017 @02:46PM (#14472368)
At that point it would be tempting to bypass the screen, the eyes and the brain as well ;-)
Re:Visualize data instantly with machine learning in Google ... by shitgoose on Saturday June 03, 2017 @11:18AM (#14476768)
brain was bypassed long time ago...
Re:Visualize data instantly with machine learning in Google ... by spinlock on Friday June 02, 2017 @12:13PM (#14470996)
OMG, Google stole your idea. You should sue.