News for hackers. Stuff that matters.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @07:05PM (#5583173)
Excel isn't the problem. Mediocrity is. Or, I should say, mediocrity when you need something more (like reliability, because you're making major decisions based on the data furnished).

Excel is great at providing a mediocre database, presentation template, calculation engine, and model builder, all-in-one. It's even Turing complete (although it makes it hard to write decent code, since that's not the point.) It does a large number of things, and a mediocre job of all. Often, this is enough. It gets the job done for small toy problems, and often that's a start. However, basing billion-dollar decisions based on Excel code? Are you kidding me?

This is exactly why I rail so hard (and without giving, ever) against Corporate injections into software. Corporate America is founded on mediocrity being good enough. Sometimes it is. Sometimes, it's fucking not. When it's not, stop using Excel as a database (it's not one) and fire all your CommodityJavaDevelopers writing SingletonVisitorFactories and start doing things right. Since you don't know how, you have to hire someone like me and give that person lots of autonomy, but it can be done.

Re:Damn Excel – How the 'most important application' is ruin... by throwawaay on Saturday April 20, 2013 @07:25PM (#5583221)
Excuse me, but given your history of writing overly verbose, self-important Grand Proclamations: I imagine the only reason someone would have to hire you is if they wanted tomes written about how they could Do Things Right while probably not getting much actual work product done in return.
Re:Damn Excel – How the 'most important application' is ruin... by fretless on Saturday April 20, 2013 @08:41PM (#5583385)
Yes, but the silver lining is that you'll open your thesaurus and learn words like

"jeremiad"

"screed"

"phillippic"

"tirade"

MOC is a strong advocate for scala and clojure, so I figure he's ok

Re:Damn Excel – How the 'most important application' is ruin... by thucydides on Saturday April 20, 2013 @10:23PM (#5583624)
Church's writing is consistently insightful and interesting. This is a silly attack.
Re:Damn Excel – How the 'most important application' is ruin... by throwawaay on Saturday April 20, 2013 @11:26PM (#5583748)
When someone spouts big talk like "start doing things right. Since you don't know how, you have to hire someone like me and give that person lots of autonomy, but it can be done" and all they're known for (please correct me if I'm wrong here) is writing a lot of text on HN, I don't think a little snark is out of line.

I get that railing against unsympathetic targets like big corporations makes for entertaining reading, but I don't think that actually qualifies anyone for the job he was describing.

Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:21PM (#5583333)
while probably not getting much actual work product done in return.

That was fucking low, man.

I'm actually extremely productive when things work right, but when people persist in fuck-uppery it's like a low-grade chronic earthquake-- not exactly dangerous, but jarring and impossible to ignore and eventually exhausting.

By the way, the danger of startups isn't failure. It's that you end up like me: someone who can't tolerate the mediocrity, idiocy, and resistance to creativity that most people bring to their working lives. In most corporate environments, those are affordable background noise. In startups, they're existential risks. Unfortunately, it's hard to unlearn an allergy to fuck-uppery.

Re:Damn Excel – How the 'most important application' is ruin... by sliverstorm on Saturday April 20, 2013 @08:31PM (#5583354)
I don't approve of attacking other people, but when you sit such a high horse, don't be surprised when someone tries to pull you down.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:41PM (#5583383)
I am humble and arrogant at the same time.

I am humble in the sense that I have a keen awareness of my limitations. I don't know what happens after death. I don't know if there is a God. I don't know more than 1.5 natural languages. I'm a mediocre athlete. On most topics, I'm less smart than a person with a passing knowledge of the field, and my opinion is consequently less useful.

I'm arrogant insofar as I've seen through the corporate nonsense and, after having watched people way inferior to me making huge decisions that affect peoples' lives, I feel an urge to step up. I know for a fact that these intellectual children are not the best people to be making such calls, because I am better.

Now, that said, I'm far from the smartest person out there and if someone smarter than me steps up so I don't have to, then that's great! I don't care about being the leader and I'd rather not. I want a competent leader. If that person is someone other than me, then great! But usually the people who are smarter than me shy away from power; they're smart enough to realize that that competition is utterly soul-raping.

The world needs people like me with actual competence and the courage to, at least, try to turn it into something.

Re:Damn Excel – How the 'most important application' is ruin... by sliverstorm on Saturday April 20, 2013 @09:00PM (#5583439)
Notice I am not objecting to you making the statements you have made; I'm just saying that with such statements, will come attacks. Justified or not, expect them.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @09:20PM (#5583483)
Yeah, you're absolutely right.

I like animated disagreement. My wife and I argue constantly. It's great, because although I have a lot of good ideas, I have plenty of bad ones. Ideas are best tempered with fire. Let's beat the damn thing until we have something good. It's a difficult, chaotic process and it takes a lot of passionate minds. Corporate processes tend toward creative mediocrity by default because no one cares. Well, if no one cares, then why are we having this fucking meeting? Just go off and do it, then.

Ad hominem attacks piss me off because they're just so fucking useless. They add nothing, but they change the discussion to a toxic one quickly.

Maybe he wasn't making an ad hominem attack. Maybe I'm just insecure because so much of my career has been wasted on manager-blessed bullshit and I'm finally waking up. I lost someone last winter, so the value of time has really been impressed on me of late.

Re:Damn Excel – How the 'most important application' is ruin... by WalterBright on Saturday April 20, 2013 @08:42PM (#5583387)
> Corporate America is founded on mediocrity being good enough.

Corporate America isn't founded on anything in particular. Corporations are founded on what its individual founders think is important.

This implies that if you have a better idea on how to run a corporation, start one and prove it's better.

Re:Damn Excel – How the 'most important application' is ruin... by _delirium on Saturday April 20, 2013 @08:57PM (#5583433)
There's a rather complex relationship between business success and being "better" in any sense other than the mere tautological fact of business success. It is not a very good way to "prove" anything beyond that, without either additional evidence, or axiomatic assumptions.
Re:Damn Excel – How the 'most important application' is ruin... by auggierose on Saturday April 20, 2013 @07:43PM (#5583259)
Mmmh, you write so much that it would be easy to write you off as crazy lunatic (as some here do for sure). But you amassed crazy Karma in just 2 years and I very much agree with your last two blog posts, so I'll give you the benefit of my doubt. Also this comment about Excel is spot-on.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:05PM (#5583299)
it would be easy to write you off as crazy lunatic (as some here do for sure).

Only the 10 or so Google trolls.

But you amassed crazy Karma in just 2 years and I very much agree with your last two blog posts, so I'll give you the benefit of my doubt. Also this comment about Excel is spot-on.

Thanks. I try.

Re:Damn Excel – How the 'most important application' is ruin... by bloblaw on Saturday April 20, 2013 @08:55PM (#5583428)
You should call it as you see it. The comment sure looks, walks, and quacks like a troll.
Re:Damn Excel – How the 'most important application' is ruin... by gav on Saturday April 20, 2013 @08:09PM (#5583306)
It's a crazy rant against mediocrity; given the majority of corporations will be average or worse, what's his goal? To tell people to try harder?
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:17PM (#5583326)
Mediocrity != average. The average MIT CS grad student isn't mediocre, but even above-average corporate cultures (e.g. Google, which is legitimately top-20%) are mediocre.

I feel like mediocrity (as a pejorative) is an artifact of a convex performance function where excellence is 10x as potent as a half-assed performance, as opposed to concave work where it's 1.2x. We don't gripe about cab drivers doing "mediocre" work. We ask them to take us somewhere and if they do it, we're usually happy.

[ETA: I realize I didn't answer your question. The reason corporate mediocrity is evil is that it's an artifact of the wrong people making decisions. If you wish to excel, you'll make a real effort to listen to people and get the right ideas into implementation. But a lot of companies tolerate executive bikeshedding because they don't care about excellence.]

Re:Damn Excel – How the 'most important application' is ruin... by rubinelli on Saturday April 20, 2013 @09:41PM (#5583520)
Most people pay lip service to excellence, but what they really want is consistency. In a corporation, a career developer that works his 40 hours and consistently delivers uninspired but clean and correct code is more valuable than one rockstar that creates a brilliant system in one weekend and spends the rest of the month burned out.
Re:Damn Excel – How the 'most important application' is ruin... by gpcz on Saturday April 20, 2013 @08:40PM (#5583377)
I think mediocrity is a function of the risk your company is willing to take. The more risk-averse, the more mediocre. I don't have data to back this up, but I'd bet dollars to donuts there's a correlation between risk-aversion and company size. For example, here's a speech by a guy working for IBM during days they were developing the PC explaining his gripe with the organization: https://www.youtube.com/watch?v=IbRmaIzGTOM#t=5m55s
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:53PM (#5583419)
My thoughts: there's good risk and bad risk and, in the technological economy, you need to know the difference.

Good risk: trusting smart people with their own time. Don't take this risk and you will fucking fail because everyone with an IQ over 125 will sabotage you (or, at least, abandon you for better things.)

Bad risk: not backing up your database, skimping on code correctness in safety-critical code, playing with guns.

People who don't know the difference should not be making decisions that affect other people.

Re:Damn Excel – How the 'most important application' is ruin... by nahname on Saturday April 20, 2013 @07:22PM (#5583212)
Even if you are right, that pill will never be swallowed the way you are delivering it.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:12PM (#5583311)
I'm considering starting an anti-consulting service focused on corporate culture. It's $40k for one month with a catch: after I do X amount of fieldwork and figure out all the things you're screwing up HR and culture-wise, I'd be contractually precluded from working with you in the next 5 years. Why such a restrictive and seemingly self-destructive structure? That structure means I will do something most people (who are looking to retain a long-term employment relationship) won't, and that's tell the truth. Burned Bridges Consulting, LLC.
Re:Damn Excel – How the 'most important application' is ruin... by jayzee on Saturday April 20, 2013 @08:34PM (#5583362)
I really like the idea of "Burned Bridges Consulting!" There is something there...
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @08:46PM (#5583402)
I am considering launching as a freelancer and I'm trying to figure out how to finance it in the context of my bidirectionally extreme (high magnitude; both directions) reputation (which is somewhat an exaggeration of my actual personality; when I write, I'm trying to communicate and sometimes I drive hard.)

I'd prefer to spend most of my time on actual work. I'm getting back into Clojure and rediscovering the joy of coding (which disappeared, with fleeting breaks in it, when I went to Google and had to answer to a middle manager, which just sucks all the life out of what we do). That said, if someone is willing to give me $40,000 to tell him what he's doing wrong, I'll do so.

(In person, I'm much less abrasive, though. If I actually respect someone, and I respect most people, I'm nice.)

Burned Bridges Consulting would work because it's structured to produce the only employment relationship in which telling the truth is possible: one where there is no possibility of continuance.

Re:Damn Excel – How the 'most important application' is ruin... by RWeaver on Saturday April 20, 2013 @09:20PM (#5583481)
I don't know if you've ever been in management, but if not I think that would be the wall you'd run into.

Imagine if a manager had tons of advice for programmers, ie; 'listen to what management says, build what we want not what you think we want, pay attention when we interrupt your coding!'

If you've already done the whole management thing also and it worked out well then good luck to you.

Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @10:09PM (#5583591)
I'm actually a believer in removing management, at least of the traditional do-as-I-say variety.

The only credibility that has any place in anything is the credibility that comes from making others' lives easier-- solving their problems, teaching them, building things they want.

Re:Damn Excel – How the 'most important application' is ruin... by reaclmbs on Saturday April 20, 2013 @10:11PM (#5583595)
Are you able to actually solve problems (with leadership) instead of just pointing them out? You have no track record of that.... in fact, just the opposite. But if you managed to change things around you could become an easy hire and own a new niche. Maybe even start a nice big company around it. Work pro bono on two major things, show measured improvements on dimensions you promised to improve, and then ask for your contract rate.
Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @10:43PM (#5583659)
To be honest, I'd rather solve problems with real work and lead by doing. I enjoy work a lot more than I enjoy yelling at people.

I think I'm poisoned by corporate environments (a startup being the worst) where you have to yell at people for days to get the permissions necessary to do a few hours of real work. I fucking hate that shit. Eventually, people stop yelling at each other about work (because they forget how to work) and are just yelling about the yelling. That's what Corporate America really is: recursive wankery with almost no one really working.

Re:Damn Excel – How the 'most important application' is ruin... by jodrellblank on Sunday April 21, 2013 @06:17PM (#5586680)
Re:Damn Excel – How the 'most important application' is ruin... by orangethirty on Saturday April 20, 2013 @07:29PM (#5583229)
I get your point, and agree that Excel is not the problem. What I reason is the issue is that Excel was marketed as the program to use to do any kind of business data calculations and manipulations. As a result, people think that Excel is a great solution to a myriad of problems. You and me know it is not. But try explaining that to a multi million business that grew to that size whilst using Excel. Sure, they need something better, yet will almost never understand why. People are also afraid of change. They are convinced Excel is the mesiah of business software. How could you convince anyone to give up their mesiah?
Re:Damn Excel – How the 'most important application' is ruin... by marcosdumay on Saturday April 20, 2013 @08:12PM (#5583310)
> How could you convince anyone to give up their mesiah?

Yeah, you don't. But you let them fail, and then convince the next generation that their elder's messiah is a fraud. Mainly by being very vocal, and using the failures to showcase your point.

In a while, either everybody realise what they're worshiping is just some normal piece of data, or you started another holly war.

Re:Damn Excel – How the 'most important application' is ruin... by gruseom on Sunday April 21, 2013 @02:14AM (#5584055)
That's not why people don't want to give up Excel. It's because in Excel they can do what they want themselves rather than having to rely on programmers. That's a really big deal and it's not something we programmers can easily appreciate.
Re:Damn Excel – How the 'most important application' is ruin... by unholyalliance on Saturday April 20, 2013 @09:05PM (#5583447)
To use the old saying, when all you have is a hammer, everthing begins to look like a nail. To most office workers, Excel is their hammer. You can stretch it to extreme limits by using things like pivot tables, and complicated lookup functions. It's easier for them this way, that is to say they have fluency in excel, but none in programming, which means they fail to realize that a simple well written script could save them from every having to repeat a task.
Re:Damn Excel – How the 'most important application' is ruin... by LyndsySimon on Sunday April 21, 2013 @01:56AM (#5584024)
Excel is extremely powerful for data analysis, and is getting more powerful still as new versions are released.

If a dataset is under 200k or so rows, I'll generally do analysis in Excel. Larger than that, and I'm turning to Python.

Even then, the end result has be be passed to someone who isn't an analyst/developer, so where does it go? You guessed it: into an Excel spreadsheet, formatted nice and neat, and sent up the chain.

Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @09:12PM (#5583466)
This is a great point. Excel is a great tool, but it's the Blub of non-technical business people.
Re:Damn Excel – How the 'most important application' is ruin... by Too on Sunday April 21, 2013 @03:29AM (#5584196)
That's how these decision makers earn their money.

If everything works they can claim they did in one month what a team of 10 would do in a year. Bang, instant bonus!

If things doesn't work, they blame the tools and try again.

Re:Damn Excel – How the 'most important application' is ruin... by redler on Saturday April 20, 2013 @09:06PM (#5583453)
You can't spell "autonomy" without "money". Well, yes you can. But the point stands -- replace autonomy with money in that sentence. There are organizational pathologies that lead to big companies not hiring the most talented and independent thinkers, but in so many cases the problem is that they don't want to spend sufficient money for a staff with the skills, experience, and creativity to provide solutions better than "works well enough".
Re:Damn Excel – How the 'most important application' is ruin... by bloblaw on Saturday April 20, 2013 @08:37PM (#5583372)
So Excel is garbage and the best solution is to hire you? Let me guess...you're a consultant.

Watch a skilled engineer or accountant use Excel and you'll see it's good for more than "toy problems".

Re:Damn Excel – How the 'most important application' is ruin... by michaelochurch on Saturday April 20, 2013 @09:14PM (#5583471)
Excel is not garbage. I'm not a MSFT fan at all but it's a great product. It is not, however,

* a database,

* a high-performance computation framework,

* a good programming model for long-lived "code" or multiple-writer projects.

Re:Damn Excel – How the 'most important application' is ruin... by LyndsySimon on Sunday April 21, 2013 @01:57AM (#5584025)
If you want to be semantic, it is in fact a database. It isn't a good RDBMS, but it is a database.

It's also not a bad computational framework, within the bounds of its capabilities.

Re:Damn Excel – How the 'most important application' is ruin... by gtani on Sunday April 21, 2013 @01:14AM (#5583947)
i found out the other day criticizing anything about excel gets you pushback or backlash or some kind of "back"

https://news.ycombinator.com/item?id=5574764