News for hackers. Stuff that matters.
Re:Economists are now admitting that they were wrong about g... by ep103 on Friday October 25, 2019 @02:56PM (#21358076)
I read an article once, that claimed when a Scandinavian country joined the EU, they expected significant job distortion as a result of free trade. So they literally moved government agencies from their current locations, to locations that they expected would be hardest hit. The end result was the shifting of thousands of government jobs from one location to another. Highly trained people in the old government centers were still in really competitive markets with significant government opportunities. But those communities that were about to be devastated by free trade (usually smaller backwater communities) suddenly saw federal agencies appear that required thousands of jobs overnight, and whom had a mandate to hire those affected by free trade, thereby saving the economy for those workers in the area.

My point is that creative solutions are possible, if we dispense with the notion that the only solution possible is the free market.

Re:Economists are now admitting that they were wrong about g... by bryanlarsen on Friday October 25, 2019 @03:15PM (#21358265)
Such a strategy failed utterly in Canada. They moved a government department from Ottawa to Miramichi, New Brunswick for similar reasons. All the skilled bureaucrats used their reputations to get transfers to a different department so they wouldn't have to uproot their family, and the department was rebuilt around a core of incompetents. I'm sure the locals they hired weren't so incompetent, but rot starts from the top. That move caused the failure of the long-gun registry and a waste of $2B. After the long gun registry was cancelled they used the same department to rewrite the pay system (code name Phoenix) and have managed to waste about $5B so far, and growing.

That's about $50 million wasted per job.

Re:Economists are now admitting that they were wrong about g... by BenoitEssiambre on Friday October 25, 2019 @04:14PM (#21358799)
I don't think the good people of Miramichi are to blame for this. It's the people in Ottawa who wrote a blank check to Oracle/IBM for attempting to migrate a large part of the government software infrastructure to their incompatible system. Somehow, the contract was that billions would be disbursed to IBM/Oracle whether their system worked or not (it didn't).

Also I don't think Oracle should be allowed to hide behind the Phoenix name. This was Oracle PeopleSoft. Why would you pay billions for a piece of software when the maker isn't even willing to put it's name on it?

Re:Economists are now admitting that they were wrong about g... by brazzy on Friday October 25, 2019 @06:25PM (#21359859)
> Somehow, the contract was that billions would be disbursed to IBM/Oracle whether their system worked or not (it didn't).

Pretty sure it was simply a time and materials contract, as is standard. No competent software company will accept a fixed price contract without tightly specified and unchanging requirements, which is something very few customers are able to provide (especially not government agencies).

Re:Economists are now admitting that they were wrong about g... by Retric on Friday October 25, 2019 @07:05PM (#21360103)
I have worked on several flexible fixed cost contracts. It’s a more complex contract, but money gets handed out on a per deliverable basis with negotiation occurring during the contract period. They allow some back and forth but require designs to be finalized by the government at specific times.

The issue is it’s hard to scale that up to a multi year 2 billion dollar contract. However, I think individual large scale software projects are inherently a bad idea, which is probably a larger issue.

Re:Economists are now admitting that they were wrong about g... by pas on Friday October 25, 2019 @08:44PM (#21360710)
Eh, the problem is that any such project should be tied to efficiency. And it should be able to ramp up very slowly, and should be cancelable any time. Usually the problem is that these projects run into issues that need escalation, eg. a small change in scope, requirements, specs, budget, structure, milestones. They usually have to start by building bridges to other groups, and there's usually no mechanism to make good incremental agreements, that are needed to facilitate a great systems design. (So in the end a lot of thing hinges on random/arbitrary interpersonal relations and chance.)

Just delivering something for the sake of it leads to atrociously bad public infrastructure, be it software or a stretch of pavement.

Re:Economists are now admitting that they were wrong about g... by repolfx on Friday October 25, 2019 @04:47PM (#21359092)
The Phoenix failure wasn't really a software failure, if I recall correctly. It was more that when everything moved to Miramichi the people who understood the byzantine government pay systems basically didn't follow and the result was people with no clue of what they wanted or how to do it being heavily involved. No software firm can succeed in those conditions.
Re:Economists are now admitting that they were wrong about g... by generatorguy on Friday October 25, 2019 @05:54PM (#21359619)
Oracle / IBM had an existing working payroll system to copy. All they had to do was reimplement it in modern hardware and software. Some government employee in Miramichi might not have been happy because oracle didn’t listen to what they thought they wanted but if the contract has been to deliver a system that produced the exact same output as the old one oracle/ibm would have no excuse for not having a successful project.

It is astounding nobody was fired for this.

Re:Economists are now admitting that they were wrong about g... by jeffdavis on Friday October 25, 2019 @07:04PM (#21360093)
I'm not so sure it's easy to represent the exact behavior of a complex system.

What would your estimate be to: "rewrite facebook in language L, with the same behavior, bugs and all".

Re:Economists are now admitting that they were wrong about g... by pas on Friday October 25, 2019 @08:47PM (#21360734)
Doing an incremental approximation is very much possible. And it's up to the customer to say when to stop. And also to judge the sufficiency of the speed of convergence.
Re:Economists are now admitting that they were wrong about g... by nradov on Saturday October 26, 2019 @12:32AM (#21361734)
An incremental approximation is unacceptable for payroll. It legally has to be 100% accurate.
Re:Economists are now admitting that they were wrong about g... by pas on Sunday October 27, 2019 @10:42AM (#21369981)
No, you misunderstood. It means you have two systems, Old and New. You use Old and start development of New. And you do the payroll on both, and if there's a difference you debug that and modify New. After a while it's good enough. And you stop using Old.
Re:Economists are now admitting that they were wrong about g... by Mountain_Skies on Friday October 25, 2019 @08:42PM (#21360700)
Which in a way is the point. How many folks in DC want to move their family to rural West Virginia to work with a group of inexperienced locals who know little to nothing about how their agency operates? The interesting question is how did the Scandinavian country manage to avoid this pitfall?
Re:Economists are now admitting that they were wrong about g... by pas on Friday October 25, 2019 @08:45PM (#21360718)
Maybe they did it slowly? And the new site started with a new version?
Re:Economists are now admitting that they were wrong about g... by BenoitEssiambre on Friday October 25, 2019 @09:38PM (#21361029)
I think this was definitely a software failure. The people of Miramichi did not order or design the system, they were just users. Miramichi is a call center, a help desk essentially. In a new software system, the rules to run the relevant part of the organization should be well laid out and easy to use. With Oracle PeopleSoft, even when people knew there was a problem, no one was able to fix it because the software didn't allow it. People didn't get paid, some federal employees apparently lost their houses because they weren't getting payed. I personally know people who told me they were getting paid incorrect amounts for years an no one could fix it. The Government of Canada should never have tried to shoehorn an off the shelf Oracle system to run payroll for a whole country's employees. When you are that big and that complex of an organization, the system needs to be created and tailored to your need. This is almost an information theoretic truth. There is an exponential number of corner cases in such a large organization.

When people think of buying business software systems, they often imagine it's like buying a car or a an app on their phone. A better metaphor for software infrastructure is the renovation or replacement of floors in a skyscraper.

To function properly, business software usually needs to interact or interface with data, software and hardware infrastructure that is in countless existing systems.

The complexity in today's IT infrastructure is mind boggling. It is the result of decades of evolution. The data in existing systems is often held in tens of thousands of individually defined formats and schemas, it flows through thousands of specialized channels that have evolved over years with mechanism for propagation of errors, for dealing with exceptions, for ensuring constraints are in place for security, while allowing special cases when needed. There are rules to ensure redundancy, high availability, backups, to support different user interfaces, different types of computers and mobile devices. There are compatibility layers for different systems, hardware, operating systems, databases. In the case of Canadian government payroll, in the old code there were embedded rules about thousands of different positions negotiated over decades by a bunch of different unions. The business rules in the old code took into account, different programs created in different areas by different governments in different regions.

Skyscrapers can also seem simple from the outside, often being made of flat surfaces forming plain rectangular shapes. But a lot more lies under their skin. There are miles of electrical wires, of plumbing, heating and ventilation, security systems that have to connect and work together. There are stairwells, elevator shafts that have to be planned and positioned for safety.

When parts of skyscrapers get old and outdated, you never see anyone suggesting buying a pre-made piece of skyscraper and shoving it in place of the floors that are outdated. Yet this is what people try to do with software infrastructure.

It's as if an organization having a building with floor 20 to 30 needing updating decided to buy a 10 floor building to put in it's place. They sign the contract and then start working on the details. Putting one building inside another is not easy. You will have to renovate the five floors bellow the new floors and also above, so that the wiring, plumbing stairwell and elevator can connect. The elevators from the two buildings is a particularly difficult problem. They won't connect. As a workaround you might get people to take a detour and a stairwell for one floor to the old elevator, ah and add a two floor high elevator for handicap access next to the stairwell. After a few runs of sewage pipes on the outside wall of the building and running electrical wires in the air crossing from the building next door, your floor twenty to thirty now satisfy the contract and the company that sold you the ten floors considers the job done. Of course it works much worst than the old 10 floors and of course you also now have 20 barely functional floors instead of 10 outdated one. But what are you going to do? You already paid way over budget to hack this mess together. It is now very unstable, if you change anything the whole building might collapse and the company you contracted has pulled a trick. The blueprints to the building (aka. the source code) is proprietary so no other company can work on it.

Undoing the damage would mean completely rebuilding 20 floors (and the building needs to keep operating while this is happening and there is only one company that has access to the blueprints so they can charge anything they want and do a dismal job at it and leave you in a position where you have to perpetually give them more money to keep things minimally functional.

When you go to them because nothing is working, they will steer you towards replacing more of your floors with more of their buildings and break more floor above and bellow while taking away your access to the blueprints and securing their monopolistic position.

Successful businesses never allow themselves to be put in such a bad position for very long. Just recently Amazon announced that they got rid of all their Oracle databases. Governments should start that work as soon as possible. Yes it may require expensive rebuilding of parts of the infrastructure piece by piece, but in the long run it will be much less expensive.

Always renovate room by room, floor by floor while making sure the blueprints remain available so you can use different contractors when one turns out to be a lemon.

Re:Economists are now admitting that they were wrong about g... by ska on Friday October 25, 2019 @03:29PM (#21358414)
I'm not sure about the long gun registry, but the core issues around the failure of the Phoenix pay system are much more complicated that the above suggests.
Re:Economists are now admitting that they were wrong about g... by bryanlarsen on Friday October 25, 2019 @03:40PM (#21358510)
That's true; but that's where the problems started, IMO. For example, IBM deserves a rich share of the blame, but who hired and oversaw IBM?
Re:Economists are now admitting that they were wrong about g... by ep103 on Friday October 25, 2019 @03:52PM (#21358613)
All good plans can be executed badly, the devil is always in the details : D

I was not proposing the above example as a foolproof plan applicable to every situation, so much as an example of a type of plan that has worked in some scenarios in the past.

I should also point out that part of the plan for the Scandinavian plan wasn't the replacement of government workers with locals, as much as the expectation that by moving so many jobs into such small areas, they were guaranteed to majorly shift the local economies. Numerous jobs opened up overnight supporting all these well paid government employees moving into the area.

Nonetheless, I am happy to learn about the counter-example, thank you!

Re:Economists are now admitting that they were wrong about g... by distances on Friday October 25, 2019 @05:17PM (#21359330)
It would be nice if you could name the country and bureaucracy of the success story. I know of one such move; the experts made it known they'd rather resign and find new jobs than move to the periphery with their families. The move was cancelled as it was pointless without the experts.
Re:Economists are now admitting that they were wrong about g... by CharlesColeman on Friday October 25, 2019 @06:25PM (#21359858)
> It would be nice if you could name the country and bureaucracy of the success story. I know of one such move; the experts made it known they'd rather resign and find new jobs than move to the periphery with their families. The move was cancelled as it was pointless without the experts.

It would be nice if you could name the failure you cite, too.

Government experts will live in a lot of places. NASA has major operations in a metro area in Alabama with only ~500k people, for instance: https://en.wikipedia.org/wiki/Marshall_Space_Flight_Center. That's more periphery than center, in my mind.

Re:Economists are now admitting that they were wrong about g... by distances on Saturday October 26, 2019 @02:56AM (#21362174)
> It would be nice if you could name the failure you cite, too.

Sorry, should of course named it as that's what I was asking. It was the move of the Finnish Medicines Agency from Helsinki to Kuopio. Checking the latest status, they do now have presence in both cities so it wasn't cancelled in the end; I guess they pushed on but ended keeping the Helsinki office for the experts refusing to relocate.

Do you have the name of your example?

Re:Economists are now admitting that they were wrong about g... by pnutjam on Friday October 25, 2019 @04:02PM (#21358683)
More and more it seems like some sort of UBI or welfare system is the only real option. Give people an income floor and don't worry if they flourish above that, at least to a certain extent.
Re:Economists are now admitting that they were wrong about g... by CharlesColeman on Friday October 25, 2019 @06:57PM (#21360048)
> More and more it seems like some sort of UBI or welfare system is the only real option. Give people an income floor and don't worry if they flourish above that, at least to a certain extent.

Except: 1) UBI is unproven and 2) it strikes me as a bit of a band-aid solution designed mainly to avoid confronting certain ideological assumptions.

Re:Economists are now admitting that they were wrong about g... by andrekandre on Friday October 25, 2019 @08:23PM (#21360575)
also if it’s a fixed value (say $1000 a month), it

1. doesn’t cover the rising costs of medical care and insurance (in the us at least)

2. won’t keep up with inflation

3. sets up private markets to potentially inflate prices “because people have 1000 dollars extra to spend”

UBI in concert with price limits for basic goods and services, insurance reform, and medical costs limits might have a chance.... but then you are now confronted with the potential that it’s now the “rich and large corporations” who are subsidizing everyone, giving them extraordinary political power over the govt/people

i’m still skeptical of UBI

Re:Economists are now admitting that they were wrong about g... by CydeWeys on Friday October 25, 2019 @09:09PM (#21360859)
I'm skeptical of UBI too, but I think it would work best with the following combination:

1. UBI (including some fractional amount per child) 2. Free universal healthcare (i.e. Medicare is no longer age-limited) 3. Better education & free public universities 4. Some kind of higher tiers of UBI for disabled people who really need it (judged strictly)

And then get rid of every single other means-tested benefit (including Social Security), as well as tax-advantaged retirement plans (which overwhelmingly benefit the already well-off), and get rid of the favorable tax on LTCGs and carried interest; everything pays full-freight income tax. After this, benefits are either free to everyone (i.e. healthcare) or you pay full freight out of your UBI. And UBI is not scaled by CoL, because it doesn't make sense to subsidize landlords in expensive cities.

And even with all of that, it's not clear that it won't be vastly more expensive than the current system, making it effectively unaffordable. There's also the issue that some people will not spend their money correctly, e.g. they'll fritter it away on drugs/alcohol and not have enough to pay rent or buy food. So you'd need some kind of combination of food stamps and Section 8 housing vouchers, paid out of UBI, for people who need to be forced to allocate their money correctly (as there will no longer be any separate means-tested food stamps or housing assistance).

I could see something like this working in smaller, well-connected, yet independent communities, but I'm struggling to see how it could scale up to a country the size of the US. The rich would be paying so much more in taxes to essentially subisidize many people who might choose not to work at all, that I think it's inevitable they'd manage to overthrow it.

Like you, I think from a realpolitik view of things (if nothing else), that it can't work.

Re:Economists are now admitting that they were wrong about g... by danenania on Saturday October 26, 2019 @05:12AM (#21362647)
It seems to me that you are focusing on the costs of UBI (which are admittedly very large) and the edge cases where people might be lazy or irresponsible without also giving proper consideration to the massive and transformative benefits that it could bring.

How much would UBI reduce the crime rate? How much would it increase the rate of entrepreneurship? How much would it reduce anxiety and depression? How much would it increase average education levels? Upward mobility? Democratic participation and voter turnout? Volunteer work and charitable giving?

No one knows the answers to these and many other similar questions, but it seems plausible to me that the cumulative effect could produce drastically more wealth than it costs to implement.

Our country (not to mention our world) is facing many extremely severe and worsening problems, many of which are rooted in economic inequality. We are, in my opinion, highly unlikely to solve these problems by incrementally chipping away at them, and the prospects for leaving them unsolved look increasingly bleak. So I think we need to be willing to consider big solutions if the cost-benefit analysis is favorable, even if they do require huge investments. We know UBI is technically affordable based on the amount of wealth that exists in our country—the question is whether it would really work (something we can test), and then if it would, whether we can summon the political resolve to make it happen.

Re:Economists are now admitting that they were wrong about g... by wahern on Friday October 25, 2019 @03:53PM (#21358618)
Failure has to be an option.

Not attempting such things doesn't mean we avoid the risk of such wealth destruction; it just means we have nobody to a point a finger at when it happens. Politically this is easier because of how people think and the dynamics of our social discourse. See Appeal to Nature Fallacy (https://en.wikipedia.org/wiki/Appeal_to_nature). This is especially true the more cynical and ideological we become as we're more likely to pounce on failures of action, but excuse failures of inaction as inevitable natural events or limitations.

Re:Economists are now admitting that they were wrong about g... by DubiousPusher on Friday October 25, 2019 @04:13PM (#21358792)
But when we attempt them we should discard the assumption that people and therefore labor behaves like a fluid. In scales of hundreds of years it does but in scales of decades it behaves like Legos or the ice stuck at the bottom of your glass. All kinds of motivations affect people's stickiness to a place, a lifestyle or a career. It's hard to know what will dislodges them or how far you can tip the glass before they all rush forward at the same time and smack you in the face.
Re:Economists are now admitting that they were wrong about g... by barry-cotter on Friday October 25, 2019 @09:08PM (#21360856)
The long gun registry would have failed even if it had been delivered on time and under budget, to spec. They had less than 10% compliance with the law and putting 5-10% of the population in jail was never going to happen. Much like Prohibition in the states banning things that large portions of the population have no problem with doesn’t work, and the Canadian populace is plugged in to the US media enough to know that a gun registry is a prerequisite for any campaign of confiscation.
Re:Economists are now admitting that they were wrong about g... by CharlesColeman on Friday October 25, 2019 @06:17PM (#21359795)
>> they expected significant job distortion as a result of free trade. So they literally moved government agencies from their current locations, to locations that they expected would be hardest hit.

> Such a strategy failed utterly in Canada.

It's possible the strategy is good, they just utterly failed at executing it for other reasons.

Re:Economists are now admitting that they were wrong about g... by abakker on Friday October 25, 2019 @03:20PM (#21358321)
I like this - and, critically, there really is no reason why free market solutions can’t be creative or innovative.

A challenge is that many solutions to problems like unemployment have difficult to quantify primary effects - e.g. actual jobs created - while they have easy to quantify opportunity costs - expected return of investing capital in ETFs, or something.

My point is not the details, or to say that creative solutions can’t return more to the community or country than the financial costs of creative solutions - merely that those in the positions to propose these solutions are frequently unable to adequately model the return.

In another post a few months ago, there was a discussion that the government shouldn’t have to propose an ROI (in the context of building new infrastructure)- but it was pointed out that frequently these projects are financed with debt, and that lenders dictate a return.

If we want to move away from ROI calculations, and worrying about unquantifiable primary effects, a critical component IMO is that we can’t really pay for them with debt.

If you pay with debt, you are beholden to a real, quantifiable cost of capital. If you fund with cash, or equity, it gives you the freedom to pursue preference over return, or theory ahead of evidence. Startup funding works this way for a reason. Creative solutions require freedoms not always afforded by a time-bounded and certain cost of capital.

Re:Economists are now admitting that they were wrong about g... by pas on Friday October 25, 2019 @09:00PM (#21360808)
Cash or credit. Doesn't matter there's always opportunity/alternative cost. If you have a bag of resources you have to decide what to do with it, and for that usually you need to evaluate a bunch of possibilities. This is the same as ranking them by utility.

ROI is just one kind of utility function, but converting everything to said resource-equivalent works pretty well.

It's always a nasty burden to decide between hospitals and roads, but it's a neccesity also, because building just hospitals without roads doesn't help much, because ambulances can't get to them. And vice versa.

Sure, ROI in itself is a bad metric, and the problem is that developed nations are frequently get caught in an overly simplistic financial modelling situation. Because politically a more complex model is very hard to defend and the simple model gives simple answers, which are usually not optimal.

As you said, creative solutions are what's needed, but they are harder to quantify.

Re:Economists are now admitting that they were wrong about g... by aeternum on Friday October 25, 2019 @03:11PM (#21358226)
This seems like a great idea. It ensures that even if government efficiency is low, it is providing positive value. I'm surprised this concept isn't more widespread.
Re:Economists are now admitting that they were wrong about g... by wahern on Friday October 25, 2019 @04:24PM (#21358902)
Until the 1990s (at the latest) the U.S. had a policy of widely distributing government agency offices throughout the country. This 1) kept power (agencies, lobbyists, workers) from centralizing in D.C., and 2) spread government expenditures. There were other reasons for doing this, especially before the telecommunication era. But for the middle part of the 20th century this pattern held strong even as transportation and telecommunication exploded.

But there's always the risk of a pathological co-dependency on government employment. You can see this in many developing countries. So for partly legitimate reasons, the Civil Service has long been the boogeyman of Republican politics. Specifically, that civil servants are reliable "big government", Democratic voters. Better to 1) pack their voting power and 2) prefer private out-sourcing. This is one major reason (if not the major reason) why government agency activity and policy have migrated to D.C., and why the headquarters of so many corporations have moved to the D.C. metro area.

Re:Economists are now admitting that they were wrong about g... by repolfx on Friday October 25, 2019 @04:49PM (#21359109)
Usually it just means gutting the department that moves. The UK has been trying this with the BBC, forcibly relocating the organisation to the north of the country. It encodes a basic assumption that in government, skilled and experienced people are so unimportant you can just lose all of them (as very few people want to relocate to a place chosen specifically because it's fallen behind). Says a lot, really.
Re:Economists are now admitting that they were wrong about g... by aeternum on Friday October 25, 2019 @07:42PM (#21360330)
Many governmental organizations do not need to have the most skilled or experienced. Different people bring different ideas, in government especially diversity is important. Moving the department seems like a great way to do this.

Those that choose not to move can leverage their experience in private industry.

Re:Economists are now admitting that they were wrong about g... by bigfudge on Friday October 25, 2019 @05:41PM (#21359514)
The bbc move seems successful though.not just Manchester either... also to Wales