News for hackers. Stuff that matters.
Re:The mainframe is alive and thriving by monocasa on Thursday March 11, 2021 @11:35AM (#26425878)
Out of curiosity, given the nine figure migration costs you're throwing around, why bother? How is it hurting you day to day (to the tune of a billion dollars) enough to migrate. Obvs all else being equal there's no way you'd start on mainframe today, but now that you have it why jump off?
Re:The mainframe is alive and thriving by taylodl on Thursday March 11, 2021 @11:48AM (#26426066)
That's a good question!

The reason given is it's getting difficult to find COBOL programmers and the platform isn't as agile as other platforms. I have to admit that IBM is working to make the platform more agile and you can do more than run COBOL - you can run Java and Linux on Z. I've been in IBM training sessions where I've been running Linux on Z and then running Docker on top of that and unless you had told me otherwise the experience was normal: you're running bash, running Docker and everything runs as you'd expect.

BUT - the problem is the core of our system is written in COBOL. There's still CICS, JCL, Copybooks and DB/2 and those who can work with those technologies are now within 10 years of retiring and the new generation doesn't know them or have much of a desire to learn them. Heck, I'm part of the first generation of PC developers from the mid-1980's and I've never done any mainframe development!

The thinking then is we'd better jump off before all these people retire and you end up having to pay $300+/hr for resources capable of working with these legacy technologies. Pay now and buy yourself a new technology set and new capabilities or pay later and just keep the system running.

Re:The mainframe is alive and thriving by rbanffy on Thursday March 11, 2021 @12:25PM (#26426562)
> BUT - the problem is the core of our system is written in COBOL.

This is the key issue. You can migrate it off the mainframe or you can migrate it to sexier tech on the mainframe.

> and the new generation doesn't know them or have much of a desire to learn them.

One of the barriers is that these companies are not willing to pay the same money we (I think we are from the same generation - I was paid to write Apple II software) can get from working with anything that's not COBOL.

I'd love to spend some time with mainframes - they are the fastest Linux machines you can get - but don't want it enough to combine COBOL and JCL with a significant pay cut.

Re:The mainframe is alive and thriving by albroland on Thursday March 11, 2021 @12:46PM (#26426801)
>One of the barriers is that these companies are not willing to pay the same money we (I think we are from the same generation - I was paid to write Apple II software) can get from working with anything that's not COBOL.

As a younger person (graduated 2012) who entered the mainframe space for my first job then left after 2y, I can very much vouch that compensation for software devs working on zOS systems writing COBOL or HLASM is peanuts. You'd be looking at 1.5-2x'ing your income even if you took a job at a series A startup writing CRUD apps in Rails/etc.

Re:The mainframe is alive and thriving by azinman2 on Thursday March 11, 2021 @05:27PM (#26429788)
Perhaps you just need to wait 10 year for everyone to retire and then the market supply will jack up these rates!
Re:The mainframe is alive and thriving by gnu8 on Thursday March 11, 2021 @08:25PM (#26431242)
There's a good argument for unionizing here. There are few enough COBOL devs that they could demand what they are worth and support it with industrial action.
Re:The mainframe is alive and thriving by haimez on Thursday March 11, 2021 @10:47PM (#26432012)
This will be the fastest method of getting bank software rewritten in rails.
Re:The mainframe is alive and thriving by gnu8 on Friday March 12, 2021 @07:46PM (#26442799)
That sounds like the fastest method of getting fiat money replaced with cryptocurrency.
Re:The mainframe is alive and thriving by ghaff on Thursday March 11, 2021 @12:44PM (#26426771)
I think that's often the case with "skills shortages."

If banks routinely started paying Google salaries for good COBOL developers, you'd see those shortages disappear in a big hurry.

Re:The mainframe is alive and thriving by rbanffy on Thursday March 11, 2021 @01:03PM (#26426997)
Unfortunately, banks don't see mainframe-based applications as a competitive differential. If they did, they would invest more heavily on that.
Re:The mainframe is alive and thriving by hakfoo on Sunday March 14, 2021 @01:37AM (#26453280)
I've always wondered what exactly banks DO see as a competitive advantage. If I want to take my money somewhere, what's the single-slide pitch for why should I choose Chase or Bank of America versus a regional/local competitor?

It's not pricing. As a consumer, it always seemed like the largest banks tended to be relatively non-aggressive on their rates. Isn't "we have economies of scale and pass the savings to you" the classic competitive play?

It's barely, if at all, public facing apps/websites. Okay, you've all got a branded app, you've all started offering Zelle, and you all let me take a photo of the (average of) five paper cheques I recieve in a year to deposit them.

It feels like for a while it was the vague promise of "we've got the largest network so you don't need to worry about finding a machine." A concern largely mooted by smaller banks refunding out-of-network fees and credit union networks.

Re:The mainframe is alive and thriving by ripe on Sunday March 14, 2021 @03:06PM (#26457883)
A depositor is not the customer banks are chasing. It's the businesses who want loans and financial services like M&A and IPOs.

Their competitive advantage is not in their software at all. It's in their relationships. The software helps them scale to large numbers of depositors. That's all.

Re:The mainframe is alive and thriving by dralley on Thursday March 11, 2021 @12:44PM (#26426772)
Yeah, RHEL and SLES have supported mainframe for a long time. Tons of mainframe users are running "modern" software stacks on top of the hardware. You can even do it in parallel with running the legacy stuff (and they do).
Re:The mainframe is alive and thriving by OldHand2018 on Thursday March 11, 2021 @12:19PM (#26426473)
> the new generation doesn't know them or have much of a desire to learn them

On one hand, I'd say that this is true. But on the other, I'm not so sure.

15 years ago, I interviewed for a job that turned out to be for building software on OpenVMS running on Alpha.

I had honestly never heard of either thing.

The interviewer, who would be my manager, said that isn't a problem, it's just a computer that works a little different than others. Do you want to learn it? I said ok.

Over the years, the hiring process changed, and there is no way that someone like me would even be sitting at that interview where they could ask if I wanted to learn.

So companies can go ahead and spend all that money on legacy consultants and all that money on migrating their systems.

Re:The mainframe is alive and thriving by bluGill on Thursday March 11, 2021 @03:42PM (#26428771)
Companies that want to hire new people haven't change. If you want a standard web app you can demand someone with experience in the framework of your choice and get it. If you want someone to write in your custom language - you know they have to learn it so you hire people who can learn.
Re:The mainframe is alive and thriving by monocasa on Thursday March 11, 2021 @04:13PM (#26429077)
And not even a super custom language. Get out of the bay area and you'll see tons of job postings that ideally want Go or Scala experience, but will gladly teach you if you have the right fundamentals. That's the only way to get their hiring top of funnel large enough to fill seats.

I really think big iron's customer's problems are that they don't want to pay for quality engineers, but for some reason will pay those higher rates or more for some overpriced consultants. Literally just accepting that the outsourcing dream of 2000 was not a great move and using that money on internal engineering would go soooo far. You see even .gov getting the hint with 18F and the US Digital Service building and supporting non contractor government engineers.

Re:The mainframe is alive and thriving by ghshephard on Thursday March 11, 2021 @05:17PM (#26429697)
Re: The reason given is it's getting difficult to find COBOL programmers

Cobol programming is a skill that is trivially taught. Any student with a Cmpt. Science degree from a credible institution, given a curriculum, can learn any programming language in a month with a bit of focus/appropriate curriculum. Can pick up the necessary frameworks in a reasonable period of time. Then it's just a matter of teaching them the line of business, and the practices and procedures.

I would claim that, given twelve months, you could teach a cohort of recent Cmpt. Science graduates all the skills they needed to be successful in any Insurance/Banking/Finance programing environment.

And these are developers that you can then pay a very reasonable salary - say, $150K/year - which is $75/hour, not $300/hr, at the cost of 1 year of salary as they come on board, come up to speed (say at an out-of-college salary of $100K/year.) - You need 1,000 of those developers - that's an up-front cost of $100mm, at which point you have your developers.

Compared to a multi-billion dollar transition cost off of a mainframe, I know which one I would chose if I were the PHB.

Re:The mainframe is alive and thriving by throwawayboise on Thursday March 11, 2021 @06:00PM (#26430118)
> Cobol programming is a skill that is trivially taught.

And this used to be very common. My first job out of school in the early 1990s was with a "big consulting firm" they had a boot camp where they taught COBOL to batches of new hires. You did that for a month, and then were deployed to a client site writing COBOL about 50 hours a week.

Re:The mainframe is alive and thriving by strongai on Friday March 12, 2021 @06:15PM (#26442126)
AA?
Re:The mainframe is alive and thriving by hakfoo on Sunday March 14, 2021 @01:42AM (#26453302)
I wonder if it's less that COBOL is hard and more that there's a lot of design philosophies in legacy codebases that more recently trained developers are going to find frustrating/error prone.

I've done some work in the financial space. It's interesting to compare, for example, expressing a credit card transaction in an ISO 8583 message versus a modern JSON/REST API format. The same data might be there, but one of them is going to be much harder to debug without a lot of specialized tooling.

Re:The mainframe is alive and thriving by eb0la on Thursday March 11, 2021 @01:06PM (#26427028)
A lot of mission critical systems are Java on the mainframe. Not just Cobol.

Why don't people switch, then?

The mainframe gives you a predictible runtime. Long running jobs don't get rescheduled or hogged by other loads.

I know about a firm that uses a mainframe to control a factory line.

The problem with replacing stuff that works (and the mainframe does) is then your job is on the line if the transition fails, and there are a lot of business moving parts inside.

Re:The mainframe is alive and thriving by closeparen on Thursday March 11, 2021 @12:25PM (#26426559)
How hard is it, really, to learn? Big Tech is constantly hiring people to work in technologies they don't know yet. We were all in on Go before anybody off the street knew it. Facebook has its own language. I'm sure businesses would prefer instant productivity, but is the training expense really bigger than the migration expense?
Re:The mainframe is alive and thriving by tartoran on Thursday March 11, 2021 @01:21PM (#26427204)
The question isn’t how hard it is to learn but who is willing to embrace an old technology which for now it doesn’t even make financial sense. When $300/hour becomes the norm you’ll have plenty of resources. For now COBOL jobs aren’t very attractive
Re:The mainframe is alive and thriving by brendoelfrendo on Thursday March 11, 2021 @12:33PM (#26426647)
Yeah, but... can you hire for it? Plenty of forward-looking developers are willing to learn Go, or whatever new hotness the SV scene is cooking up. I think pitching mainframe development to that same crowd is a much harder proposition.
Re:The mainframe is alive and thriving by lotsofpulp on Thursday March 11, 2021 @12:37PM (#26426694)
A more expensive proposition. Dangle some high six figure salaries and it will also be the new hotness.
Re:The mainframe is alive and thriving by denimnerd42 on Thursday March 11, 2021 @01:19PM (#26427169)
nah, I think both ideas are wrong. that crowd would never want to work for a bank or insurance company in the first place unless desperate. due to their org structure they can never get any real value out of any 1 person, especially an engineer. so that salary will never exist in the first place.
Re:The mainframe is alive and thriving by guenthert on Thursday March 11, 2021 @01:07PM (#26427038)
Might not be the same crowd, but some of us wouldn't mind to learn COBOL and get our hands on a mainframe (while at the same time wondering whether the world really needed Go).
Re:The mainframe is alive and thriving by 908B64B197 on Thursday March 11, 2021 @12:51PM (#26426856)
> the new generation doesn't know them or have much of a desire to learn them

No top 50 CS program teaches these tech. No unicorn uses them. Not a single FAANG or FANNG+ if you include other large players.

Finally, no engineering-centric company uses these tech. That's the difference between learning Go vs COBOL.

Re:The mainframe is alive and thriving by pjmlp on Thursday March 11, 2021 @01:08PM (#26427053)
That is a very tiny employment market.

There are only a couple of FAANG+, with crazy hiring practices, and most businesses aren't engineering centric, the world is bigger than that.

Re:The mainframe is alive and thriving by 908B64B197 on Thursday March 11, 2021 @04:48PM (#26429430)
True, but it's the one that's getting the most attention.

It sets the trends and build what's next. RandomBigCo just follows.

Re:The mainframe is alive and thriving by pjmlp on Thursday March 11, 2021 @05:29PM (#26429807)
Most RandomBigCo just sees any kind of software development as a cost center, and eventually outsources it, to keep their focus on selling their actual products, while some else writes CRUD applications for stock management.
Re:The mainframe is alive and thriving by worker767424 on Thursday March 11, 2021 @07:38PM (#26430925)
None of the major cloud providers let you lease a mainframe, either.
Re:The mainframe is alive and thriving by varikin on Thursday March 11, 2021 @11:55AM (#26426172)
I worked for a large retail company that had mainframes, our own DCs, and a large cloud presence. There was and still is an ongoing project to retire the mainframes. From what I heard, the mainframes don't always solve the problems we have today, such as realtime information about all the stores and inventory. They are also harder and harder to get people that know and understand them to fix issue or work on integrating them into newer systems. Finally, there was a serious power outage at a DC after I left and the backup generators did not kick in properly. And the mainframes and other older hardware was not booting properly. That is a major risk that you don't have with the cloud, or even more modern application design with your own hardware. As long as you have the data, you can just provision new hardware and go. It would be expensive and time consuming, but this is a Fortune 50 company and they can pay the cost if it happens.
Re:The mainframe is alive and thriving by neverartful on Thursday March 11, 2021 @03:58PM (#26428933)
"harder and harder to get people that known and understand them"

This is not surprising. IBM could fix this overnight if it wanted to. How? By providing no-cost educational licenses for its mainframe software for use on Hercules. Why don't they do this? I believe that there are 2 reasons why: (1) they're terrified of people running their production mainframe workloads on a non-mainframe, and (2) I believe that some of IBM's existing mainframe customers keep pressure on IBM to prevent them from opening up the 'mainframe secrets to the world'. The second point is the belief in security through obscurity. I don't have any evidence to back up this belief, it's just my theory.

The other thing that IBM could do is provide low-cost (or even no-cost) options to real mainframe environment over the internet. I know that they have some of this, but it's too restrictive. I'm talking about opening it up like AWS did with free for 1 year. But that's expensive? It wasn't free for AWS to do it, and it wouldn't be free for IBM to do it. However, it would eliminate the biggest barrier to entry for new talent.

Getting back to my theory of security through obscurity, I believe that this is also in play with AIX and iSeries (AS/400). A number of years back, I bought a used RS/6000 workstation on eBay for the purpose of learning and I contacted IBM to get a licensed copy of AIX 4.3. It was as if I were speaking in tongues trying to get through to them.

IBM: "Sir, what's your IBM customer number?" Me: "Umm, I don't have one. I'm just an individual who bought a used RS/6000 on eBay." IBM: "We can't sell you an AIX license without a customer number." Me: "Ok, well give me one." IBM: "What's the name of the company?" Me: "There is no company. It's just me as an individual who wants to learn about the technology." IBM: "We have to have a company name." Me: "Put my name as the company name." ... ... ... Eventually, get assigned an IBM customer number and did finally get AIX CD-ROMs from IBM.

I can only imagine that it would be 10x worse to do something similar with their iSeries (AS/400). When you see this over and over, I'm left with the conclusion that IBM doesn't want individuals getting their hands on their hardware or their software.

Re:The mainframe is alive and thriving by pickle-wizard on Thursday March 11, 2021 @04:50PM (#26429454)
IBM does have the zPDT for running an emulated mainframe on Intel hardware for development, and education purposes. However it is not free. IIRC it is about $1K/year. Not a bad cost for a business, but too expensive for someone to go learn on their own.

You are absolutely right about how hard it is to do business with IBM. I worked for IBM for nearly 7 years, running a small datacenter. It was such a pain in the ass every time I needed to order something. IBM sales and support process is very high touch, and is designed for the large enterprise that has a team of IBM sales people supporting them. If you are that customer it is not a big deal because you have someone to navigate the process for you. If you are a smaller customer, they want you to go through a VAR. Which is still a pain in the ass.

Windows NT and the AS/400 are about the same age. This pain in the ass sales process is a big part of why Windows NT won. The IBM sales people didn't want to sell it because you didn't need to buy services with it and it was too hard to buy on your own. Where as if you wanted Windows NT, you just bought a copy of Windows NT and installed it on an easily available PC.

We won't even talk about the time I tried to use IBM Smart Cloud Enterprise.

Re:The mainframe is alive and thriving by unixhero on Friday March 12, 2021 @02:05AM (#26432944)
Thus exact thing happened to me also. Thet were unwilling to sell me a screen for my RS6000 system because I was not a company.nuo until that poiint I looked uo at IBM. Ever since that point I"ve never looked back.
Re:The mainframe is alive and thriving by goatinaboat on Thursday March 11, 2021 @12:01PM (#26426242)
They are also harder and harder to get people that know and understand them

Bootcamps saturating the market with webdevs armed with skills that barely last a year, when they could be training people with skills that would see them employed for a whole career.

Re:The mainframe is alive and thriving by lotsofpulp on Thursday March 11, 2021 @12:23PM (#26426523)
The pay for people who know and understand mainframes is insufficient to incentivize people to become knowledgeable and familiar with mainframes.

It has nothing to do with bootcamps. If the mainframe knowledge was in sufficient demand, then they would be selling mainframe training too since people would be wanting to buy it.

Re:The mainframe is alive and thriving by tablespoon on Thursday March 11, 2021 @12:30PM (#26426613)
> It has nothing to do with bootcamps. If the mainframe knowledge was in sufficient demand, then they would be selling mainframe training too since people would be wanting to buy it.

A large part of that is probably due to American management practices, where the preference is to skimp on maintenance until they find themselves in a crisis. They don't want to pay for what they need, they want to pay for whatever is cheap.

Re:The mainframe is alive and thriving by goatinaboat on Thursday March 11, 2021 @02:12PM (#26427784)
The pay for people who know and understand mainframes is insufficient to incentivize people to become knowledgeable and familiar with mainframes

Maybe, but it may also be true that people simply aren't aware that mainframes exist or these jobs exist.

Re:The mainframe is alive and thriving by wnevets on Thursday March 11, 2021 @12:18PM (#26426462)
Could you even have bootcamps for mainframes?
Re:The mainframe is alive and thriving by rbanffy on Thursday March 11, 2021 @12:27PM (#26426580)
There is a yearly Master The Mainframe competition for students (but anyone can participate, get an account and do the exercises and go through the materials). It's fun. z/OS is completely alien for someone who grew up in a Windows/Unix ecosystem.
Re:The mainframe is alive and thriving by JuanTono on Thursday March 11, 2021 @10:08PM (#26431844)
Also IBM is launching a new program for students called "IBM Z ambassadors" trying to reach students and evangelize about mainframes... I know it because Im currently an IBM Z ambassador. https://zambassador.com/
Re:The mainframe is alive and thriving by sedachv on Thursday March 11, 2021 @06:49PM (#26430533)
There were bootcamps for AS/400 in the 1990s.
Re:The mainframe is alive and thriving by rbanffy on Thursday March 11, 2021 @07:23PM (#26430797)
The AS/400 is a thing of beauty. It was ahead of its time and, in many aspects, it's still ahead of ours.
Re:The mainframe is alive and thriving by was8309 on Thursday March 11, 2021 @12:55PM (#26426901)
'Vendor Lock in' was also a problem. When it came time to renew leases/licenses, IBM could say whatever. There was no recourse but to pay. Funny/sad that we believed Oracle when they said they were the solution to 'Vendor Lock in'. The billion+ dollar grift was thick.
Re:The mainframe is alive and thriving by tannhaeuser on Thursday March 11, 2021 @12:33PM (#26426648)
It's also not very clear what target environment to migrate to with costs in that ballpark and expectations for longevity comparable to mainframes. Java? Cloud (lol)? Web (lol)? Just blinks of an eye compared to what these are supposed to replace. And last decade's post-standards rush hasn't exactly helped either so POSIX etc might not help much.
Re:The mainframe is alive and thriving by taylodl on Thursday March 11, 2021 @12:54PM (#26426892)
You're not wrong. Oracle is making a big play in the utility space and so they have a lot of solutions available that can be hosted on-prem or in their "cloud" - which really is somebody else's data center. Their solutions are all JEE based and run on WebLogic.

What gives me pause for concern is the JEE/WebLogic platform is now as old as COBOL was in the 1980's when we were calling it "dead" and we're still looking at 5-7 years of development and migration time to get to the new system. What will we think of JEE/WebLogic in 2030? My biggest concern is they're going to spend all this money to get onto another soon-to-be-legacy platform that they're going to realize on day 1 they need to start planning on getting away from. This is why mainframes have been so "sticky."