News for hackers. Stuff that matters.
Re:I was wrong about spreadsheets (2017) by ekianjo on Friday July 12, 2019 @08:32AM (#20420195)
> I have deep respect for Excel.

I do something around the same line as you describe (build better tools in R/Python for larger data problems) but I have a deep aversion to Excel. It's proprietary, has horrible standards (it does not support native UTF8 csv files for example), and is stuck in the 80's in terms of paradigm. And this is precisely the tool that prevents people from doing things more efficiently because "they can do it manually in Excel even if it takes a long time". It makes people take really, really bad habits.

Re:I was wrong about spreadsheets (2017) by halfeatenpie on Friday July 12, 2019 @11:53AM (#20421604)
Excel is a tool. It empowers those who don't know how to code to do their jobs more effectively than before without "learning to code". It's something you keep in your garage in case you need it. It depends on what their current workflow is. Sometimes I'll use Excel, sometimes I'll use R/Python.

What's important is that Excel gives you access to the computing power of modern technology with a lower barrier-of-entry/knowledge. That's one of the most valuable things that many people fail to understand. Not everyone is a programmer and for a lack of a better term, "doesn't really care about UTF-8 and just want the calculations to work". Also, in many cases Enterprise IT in critical infrastructures are resistant to supporting R or Python due to their security models (firewall rules prevents install.packages('tidyverse') for example).

This is what makes us specialists and someone they bring on board to help them out and explain to them about what the "best-use-case" is, and then watch as people try to cram a square peg into a round hole.

Re:I was wrong about spreadsheets (2017) by astine on Friday July 12, 2019 @09:02AM (#20420360)
Well if you're using Python, you're following an imperative/oop paradigm which goes back to the sixties, so I don't know why you'd criticize Excel for using a dataflow model. I can understand not wanting to use Excel because it's proprietary (but Libreoffice isn't) but I can can understand not wanting to deal with a lot of it's legacy cruft, but for the stuff that Excel does well, it does it a lot more quickly, more interactively, and more intuitively for most people than a similar solution in Python. In fact, one of the key benefits of an Excel solution is that you can see every step of your calculation which creates a degree of self documentation which you don't get with Python, for example.
Re:I was wrong about spreadsheets (2017) by ekianjo on Friday July 12, 2019 @09:55AM (#20420740)
> that you can see every step of your calculation which creates a degree of self documentation which you don't get with Python, for example.

If you want to do that in Python then Jupyter Lab/notebook is a good solution to document your code and see the result of each operation. And way faster than Excel for large data tables.

Re:I was wrong about spreadsheets (2017) by BeetleB on Friday July 12, 2019 @11:13AM (#20421282)
Yep. My first job had a lot of Excel. I hated it. Once I learned pandas, I rarely needed Excel again for my work.
Re:I was wrong about spreadsheets (2017) by taneq on Friday July 12, 2019 @10:18AM (#20420906)
Think of all the open, modern, nicely standards compliant tools that you use. Now think of the fact that Excel lets people solve their problems more easily than all the things you like.

I'm not saying it's good, but it's better than everything else (for the people who use it.)

Re:I was wrong about spreadsheets (2017) by phonon on Friday July 12, 2019 @09:05AM (#20420379)
> it does not support native UTF8 csv files

It does though? You can export as a UTF-8 csv file...check the export options.

Re:I was wrong about spreadsheets (2017) by ekianjo on Friday July 12, 2019 @09:54AM (#20420729)
I am talking about importing CSV files in UTF8. If I use Japanese characters for example it fails utterly to display properly unless I import it as "Text" first.
Re:I was wrong about spreadsheets (2017) by jchb on Friday July 12, 2019 @10:48AM (#20421114)
The secret trick for importing data into Excel (without actually writing a file in the Excel file format): don't try CSV - as you have already noticed that will fail in all kind of fragile ways depending on your character encoding and operating system locale. Instead, convert your data into an html table and then paste or import that into Excel.

But not any html table, you need to have the appropriate proprietary css properties in there, such as the mso-data-placement:same-cell. Those are actually documented ...in the Office HTML and XML Reference published in 1999.

Re:I was wrong about spreadsheets (2017) by chaseha on Friday July 12, 2019 @11:09AM (#20421245)
I frequently go from SQL query results to HTML table to excel in a similar manner, but I haven't had issues w/ any proprietary CSS properties. Using Paste Special -> Match Destination Formatting it always comes out without any issues
Re:I was wrong about spreadsheets (2017) by phonon on Friday July 12, 2019 @03:02PM (#20423402)
No, you should use the Data import tools--that's what they're there for!
Re:I was wrong about spreadsheets (2017) by phonon on Friday July 12, 2019 @03:00PM (#20423394)
Yes, it takes a little longer, but you should use Data > From Text/CSV for more complex text/delimited imports.
Re:I was wrong about spreadsheets (2017) by formercoder on Friday July 12, 2019 @08:42AM (#20420242)
In what way is the paradigm stuck in the 80s?