News for hackers. Stuff that matters.
Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Tuesday January 17, 2017 @10:30AM (#13418301)
This is a great example of how technical debt 'kills'. It's not a murder, it's negligence and a slow demise.

I went through one of these projects. The tech debt was never as bad as you describe, but it was a small company operating on a short runway. It also taught me an unfortunate lesson about non-technical founders and the dangers of outsourced code.

The MVP for the company had been bought off the shelf. It worked fine, but the code was abstruse and utterly resistant to change. As the price (in time and dollars) of change requests grew, they sensibly in-housed development. Unfortunately, their clients had some idea what to expect in terms of features per day and dollar. Requests like "let us use our logo and custom color scheme" turned out to be serious challenges since every color and style decision was clumsily hardcoded, so we took far too long to achieve them.

Ultimately, we ended up a contract behind - bringing in business to fund delivering on the previous request. Most startups operate under the gun like that (with either fundraising or contracts), but they start there and labor to escape. We started solvent, and had no clear plan to break out of tech debt - a rebuild would have been too slow, 'working smarter' wasn't viable, and expanding the tech team would have come too late and too costly.

So, we died. Not because we couldn't do work, but because we couldn't do it at a competitive speed.

Re:Ask HN: Have you ever worked on a product that was killed... by ryandrake on Tuesday January 17, 2017 @10:43AM (#13418422)
Seen this a lot. A lot of companies think they are "product" companies, but due to their unwillingness to push back on customers, they become custom engineering shops, bolting on little one-off mods to their project over and over to appease bad customers (or to appease POTENTIAL customers who haven't even bought the product yet).

Stop me when you recognize this one: "Hey your product is great, but we really want something that does [totally different thing]. If you just add that thing, we will pay for all the NRE and you can sell it to others as part of your product! Win win!" Advice to junior developers: If you hear such talk in the hallway, RUN!

Re:Ask HN: Have you ever worked on a product that was killed... by kernelbandwidth on Tuesday January 17, 2017 @11:33AM (#13418856)
We're an enterprise software shop, which necessarily means we do a lot of custom work, but we're careful to consider what we'll do. My mentor is an old hand that been through multiple exits, and in every meeting we have, he hammers this point. You're either a product shop, or a professional services shop, and if you don't know which one you are (or you believe wrongly) you die. Simple as that. The deeper you get into the consequences of knowing (or even forcing) which you are, the more implications it has for everything from product design to business strategy, and it's extraordinary how such a simple seeming thing effects such a vast amount of the company.
Re:Ask HN: Have you ever worked on a product that was killed... by jrs235 on Tuesday January 17, 2017 @12:16PM (#13419191)
Companies that think they are a product shop but chase enterprise customers and do professional services often fall to appropriately charge enough for their services. Enterprise level customers require not only more features, more guarantees, and more support, then require more attention. Are you appropriately including sales time and expense chasing them to get a contract as well as support resources into your CAC? Are you appropriately accounting for all the added expenses (and future expenses including lost opportunities)? If not, you're probably losing your tail.

P.S. "Are you" is not directed to the OP but to the business owners/leaders that don't know what they are doing.

Re:Ask HN: Have you ever worked on a product that was killed... by kernelbandwidth on Tuesday January 17, 2017 @02:43PM (#13420483)
Yes, this. One of the big things I talk about with sales is the difference between changing a priority for a customer vs. adding distinct new things. As a recent example, a client wants better and faster feedback on the trial they're conducting (we're in the med-tech space), and we've already got a new dashboard designed and on our product roadmap. I'm more than happy to prioritize that over other product pieces if it'll get us the contract, because we're already going to do it, we're only changing the 'when'.

On the other hand, when they ask for something off the roadmap, we get into more complex issues (is this market-demand data, or custom work?) Particularly for grunt-level custom work (say, adding a support for tracking data on a niche wearable device that we don't currently support) there's a lot more questions that follow.

One of the most insidious of the latter, IMO, is that if it's just for one contract, then we're either hiring contractors/outsources (expensive, high management overhead), hiring new engineers (risky to grow headcount on a whim), or redirecting resources to tasks that are likely to have both lower ROI and provide lower growth for the re-tasked engineer. At our small size and need for high-quality people, I consider this to be a real cost too.

Re:Ask HN: Have you ever worked on a product that was killed... by jrs235 on Tuesday January 17, 2017 @02:51PM (#13420552)
We (I) feel these same things.

>when they ask for something off the roadmap

Then we also get side tracked and lose focus. Leadership and management expend too much energy trying to figure out what to do. Then they want estimates from the developers so they can figure out an estimated ROI. But they rarely seem to worry about the true income potential, focusing mostly on just the initial development cost.

Pursue it? Don't pursue it? If we do, how will we? Will we be >hiring contractors/outsources (expensive, high management overhead), hiring new engineers (risky to grow headcount on a whim), or redirecting resources to tasks that are likely to have both lower ROI and provide lower growth for the re-tasked engineer.

Then is it really surprising that this lack of focus and discipline trickles down to those doing the work and the work itself? Technical debt in the making. It starts at the top.

Re:Ask HN: Have you ever worked on a product that was killed... by kernelbandwidth on Tuesday January 17, 2017 @03:11PM (#13420730)
Absolutely. A brief story on tech debt from the top:

One of the more frustrating things I've experienced is when I got push-back for implementing more project management process (we have a very light process, but when I took over it was sticky-notes-on-the-desk level). The complaint was "we can't slow down development to do more process". Very through-the-looking-glass, as I, the Engineer, was arguing for more management process and Leadership wanted less.

But of course, accurate estimates were needed, just, you know, without making measurements. I implemented some process anyway. We actually increased development speed from less churn and lowered communicated (consult docs before breaking someone's flow), improved estimates, and we've been able to better contain our tech debt.

Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Wednesday January 18, 2017 @02:28PM (#13429500)
> Very through-the-looking-glass, as I, the Engineer, was arguing for more management process and Leadership wanted less.

I suspect you could go a long way with the heuristic "If engineering asks for more process, always give it to them."

It's not flawless, but it's like hearing Ron Paul call for a new regulation - when a request is that out of character, you should usually suspect that there's some good motivation.

Re:Ask HN: Have you ever worked on a product that was killed... by cthulhubot on Tuesday January 17, 2017 @02:50PM (#13420535)
This is a frighteningly accurate description of the company I'm currently at. They spent many years chasing after the enterprise level customers at the cost of alienating their smaller team level users and never had an answer when requests would crop up from the larger accounts asking for features ('just get it done'). Now they're trying to pivot back to the team level customers and are having an supremely difficult time dealing with the tech debt built up by addressing the enterprise level concerns. We tout ourselves as being a product shop when in reality we're trying to be both.
Re:Ask HN: Have you ever worked on a product that was killed... by jrs235 on Tuesday January 17, 2017 @03:50PM (#13421055)
What industry are you in or where is the home office located?
Re:Ask HN: Have you ever worked on a product that was killed... by rvdavis on Tuesday January 17, 2017 @12:14PM (#13419182)
Can you expand on what your mentor defined as a "product shop" vs "professional services shop"?
Re:Ask HN: Have you ever worked on a product that was killed... by kernelbandwidth on Tuesday January 17, 2017 @02:31PM (#13420368)
Sure, but the answer is pretty trivial: If you spend more than half your time on customization, you're a professional services shop.

He also added that if you're a product shop doing less than 70% off-the-shelf, you're probably screwed, while 90% off the shelf is really the ideal (again, enterprise software).

I think the more interesting question is "what counts as professional services?" This gets much trickier, for example when you start building out APIs to make second- or third-party integrations easier, is that "product" or "professional services"? It certainly seems like product building, but if you're doing for a customer's use, it gets real blurry real fast. If you're not using that API internally, you're almost certainly on the professional services side. If you do use it internally, is it rock solid enough that you can support and expose it without that support becoming professional services?

Drawing sharp lines aside, this all probably seems kind of trivial, but the first time I ran through our product design with him and we discussed this, I went back and radically re-thought a lot of our strategy, particularly at the customer interfaces.

Re:Ask HN: Have you ever worked on a product that was killed... by rvdavis on Tuesday January 17, 2017 @05:28PM (#13422066)
Great explanation, thanks!
Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Tuesday January 17, 2017 @11:02AM (#13418584)
Ouch, that's almost word-for-word from the company that died of debt.

It was enterprise sales, so customization was unavoidable, but no one was differentiating between big and small changes, or big and small buyers. The product was desperately struggling to do ~3 things at once, and still being sold to potential buyers on the promise of a fourth thing it would do "soon".

Re:Ask HN: Have you ever worked on a product that was killed... by jrs235 on Tuesday January 17, 2017 @11:57AM (#13419046)
Enterprise customers which require enterprise sales require enterprise pricing. If appropriate enterprise pricing is not in place then you risk an enterprise failure.
Re:Ask HN: Have you ever worked on a product that was killed... by ayuvar on Tuesday January 17, 2017 @11:55AM (#13419033)
I think every one of my former employers who have failed, did so by doing those 'customs.'

The last one even spun off a dedicated team that built (hacked) prototype customs in order to secure sales, then threw away the prototype and, after collecting the commission, told the new customers that it would take several years to get what they just saw in production but in the meantime we can do our existing product with some mods.

I imagine the pressure to accept these deals is immense though. Why let an innocuous little feature request hold up such a great deal?

Re:Ask HN: Have you ever worked on a product that was killed... by cerved on Tuesday January 17, 2017 @01:58PM (#13420070)
Sounds like poor sales to me
Re:Ask HN: Have you ever worked on a product that was killed... by pavel_lishin on Tuesday January 17, 2017 @11:15AM (#13418712)
"Let us use our logo" doesn't seem like an unreasonable request.
Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Tuesday January 17, 2017 @01:24PM (#13419787)
And it wasn't!

That was part of the problem: the sales people couldn't push back on most requests because they were often quite reasonable. When they were more demanding, it was usually from a large prospective buyer so we had to bend over backwards.

The result was that we had huge tasks to do with no (current) revenue, and small tasks to do that took 10x as long as they should have. Since servicing existing revenue streams (even on reasonable requests) became so time-consuming, handling big enterprise demands became totally untenable.

Re:Ask HN: Have you ever worked on a product that was killed... by johnnyhillbilly on Tuesday January 17, 2017 @05:04PM (#13421834)
Sounds like you needed better sales people.
Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Wednesday January 18, 2017 @02:32PM (#13429544)
We needed a lot of things. Better (or more technical) sales was one. More mid-level engineers was another. Mostly, though, we just needed more time or money.

Our target market was very reluctant to moving from a paper system to a software system, so there was a lot of foot-dragging and feature requests. That delay had just never been budgeted into schedules or runway.

Re:Ask HN: Have you ever worked on a product that was killed... by wayn3 on Tuesday January 17, 2017 @12:35PM (#13419365)
thats one line of code on some part of some html template if done in a non-idiotic fashion (speaking to the javascript overcomplicators)
Re:Ask HN: Have you ever worked on a product that was killed... by Bartweiss on Tuesday January 17, 2017 @01:26PM (#13419804)
Heh, yep.

And it was one line of code, after several hundred lines had been torn out and rearranged to ensure that different clients could insert their own pictures of different sizes without everything exploding. The whole team was desperately trying to force enough flexibility into the software that one-line changes could be made in <10 lines, instead of >100.

Re:Ask HN: Have you ever worked on a product that was killed... by nicostouch on Tuesday January 17, 2017 @11:46AM (#13418957)
I remember my first day on the job too.
Re:Ask HN: Have you ever worked on a product that was killed... by dagw on Tuesday January 17, 2017 @05:58PM (#13422304)
Last company I worked for did that to great success. All our customer got a custom version of our product tailored to their needs and their project. At least half our customers where doing something that needed at least one new feature that we didn't currently have. If you build your business model around that it is not necessarily a problematic model.
Re:Ask HN: Have you ever worked on a product that was killed... by andrewclunn on Tuesday January 17, 2017 @02:36PM (#13420417)
Working for a company like that, BUT they allowed me to completely rewrite 3 of the tools from scratch in a more modular fashion so that I could do these things without having to modify the old code bases. Now there are two other applications that I still have to support (and were written by a consulting company we no longer contract through). It's night and day. So this isn't really the worst thing if you're given the authority and power to take full control of an application and rebuild it and take ownership of it. Of course, this doesn't really apply to junior devs.
Re:Ask HN: Have you ever worked on a product that was killed... by lewisl9029 on Wednesday January 18, 2017 @02:29AM (#13424738)
This part in Rich Hickey's Simple Made Easy talk [1] had a lasting impression on me. It really drove home the point on how a build up of complexity (one of the most common forms of tech debt, and one of the hardest to avoid) can eventually "kill" a project in exactly the way you described, slowly and painfully:

    "But I have all this speed. I'm agile. I'm fast. You know, this easy stuff is making my life good because I have a lot of speed."

    What kind of runner can run as fast as they possibly can from the very start of a race?

    [Audience reply: Sprinter]

    Right, only somebody who runs really short races, okay?

    But of course, we are programmers, and we are smarter than runners, apparently, because we know how to fix that problem, right? 
    
    We just fire the starting pistol every hundred yards and call it a new sprint.

    ...It's my contention, based on experience, that if you ignore complexity, you will slow down. 
    
    You will invariably slow down over the long haul.

    ...if you focus on ease, you will be able to go as fast as possible from the beginning of the race. 

    But no matter what technology you use, or sprints or firing pistols, or whatever, the complexity will eventually kill you. 

    It will kill you in a way that will make every sprint accomplish less. 
    
    Most sprints will be about completely redoing things you've already done. 
    
    And the net effect is you're not moving forward in any significant way.
[1] https://github.com/matthiasn/talk-transcripts/blob/master/Hi...