I re-wrote the process in AWK, and was able to complete the data-reduction task in about 60 seconds on a DEC 5000 workstation. But my numbers did not match the spreadsheet results, and finding out why was an interesting process.
I then encountered small, remote offices of big international firms -- usually real-estate, insurance companies -- that had limited local IT support. It was Excel macros all the way down.
And then a large biotech firm, where it took KPMG analysts a few months to determine that our entire business relied upon this one guy's spreadsheet.
So yeah.
But:
Excel dies, let us suppose... What will these people come up with? Alexa queries?
I have preferences other than Python, but mostly I csn read code written by the scientists who wrote them. They may be abominations, like global state variables and magic numbers, but they are readable.
Is Python any reason to hope for a better world?
(Hmm. Off-topic, perhaps. Your story woke some memories of tough IT experiences.)
Ideally, excel with separated actual use cases, which the original app merges into one thing:
- data entry into tables
- auto-generated tables over some ranges (dates, counts)
- constants / described values (they end up on a side, sometimes in a named cell if you're lucky)
- presentation/report layer
I think Access did some good things, but is too close to be database to be comfortable. BI to is great for the last part, but it's a separate/expensive product.
As someone who was a software engineer in a brokerage and had to deal with clients excel sheets: open/libre office not letting you do that is a feature.
We would be given excel sheet that would depend on a specific version of Excel. We had sheets in the hundreds of megabytes. We had sheets that would take overnight to run. We had sheets with sheet dependencies. We had sheets that needed to be run in a specific order manually. We had sheets with 13,000 manually entered rows, each with 53 columns.
These things, and I use the term thing since eldritch abominations does not convey the horror of using them, were responsible for investing hundreds of millions of dollars.
The day excel dies is a day I will celebrate.