News for hackers. Stuff that matters.
Re:Is Microsoft Excel an Adequate Statistics Package? by lordnacho on Saturday August 27, 2016 @03:32PM (#12373800)
No way, not data science. How are you going to load in millions, possibly billions of individual numbers?

With finance there's a lot of things that seem like good fits, but only if you keep them small. Something like a personal budget is fine, where everything fits on a screen.

Re:Is Microsoft Excel an Adequate Statistics Package? by dandermotj on Saturday August 27, 2016 @06:59PM (#12374554)
The "big data vs. small data" argument isn't the issue for data scientists. It's the total lack of decent statistical libraries, visualisation tools, programming capabilities and on and on. Don't think anything I've worked on would come close to hitting the excel memory ceiling, but without a doubt completing it in excel would be nigh on impossible.
Re:Is Microsoft Excel an Adequate Statistics Package? by PeterisP on Thursday September 01, 2016 @03:24AM (#12403601)
A simple excel pivotchart on 10k-100k financial entries often works better than the best BI / MIS packages.

For most companies, all their data science fits in excel easily. Full transaction history with each individual item sold since founding the company? No problem. Every single visitor/page view on their website? I've seen such logs imported to excel to do some rough aggregation. Manufacturing data about each particular widget sub-part that ever went off your conveyor belt? Again, for many companies with hundreds of employees that would still fit in excel without issues.

There are so many companies who speak about big data while their largest datasets can fit into RAM of a cheap laptop. That doesn't mean that data science and analysis is worthless to them, quite contrary.

Re:Is Microsoft Excel an Adequate Statistics Package? by blahi on Saturday August 27, 2016 @03:57PM (#12373905)
I have 2.4 billion data points loaded in Excel at the moment.

Not that it matters. "Data science" is not something that magically kicks in after you go beyond some "big data" threshold.

Excel is heavily used in managerial science type of positions and I can assure you those are rather heavy on the "data science" workflows.

Re:Is Microsoft Excel an Adequate Statistics Package? by ramblenode on Saturday August 27, 2016 @04:32PM (#12374039)
The maximum number of rows in the most recent version is 1,048,576 [0]. I'm deducing then that your data is in wide format. What would happen if you wanted it in long format? It seems you would just be out of luck with Excel, which is not a problem in any other major statistics software.

[0] https://support.office.com/en-us/article/Excel-specification...

Re:Is Microsoft Excel an Adequate Statistics Package? by blahi on Saturday August 27, 2016 @04:44PM (#12374083)
Except that there is Power Pivot which is xVelocity - the same columnar store database use in SQL Server.
Re:Is Microsoft Excel an Adequate Statistics Package? by goatlover on Saturday August 27, 2016 @09:25PM (#12374896)
Why on Earth would you use Excel for that many data points?
Re:Is Microsoft Excel an Adequate Statistics Package? by blahi on Sunday August 28, 2016 @02:34AM (#12375552)
Quik self-service OLAP. Blazing fast slice & dice and multidimensional expressions (cube formulas). I would need a corporate BI solution to get that and it won't be self-service.

Nothing beats Excel + Power BI in reporting.