News for hackers. Stuff that matters.
Re:FedNow Is Live by aeyes on Thursday July 20, 2023 @05:34PM (#36807057)
Is there anything special about the IBM MQ implementation which makes it worth naming them? It looks like you can connect to it using AMQP so I wonder why they wouldn't just say something generic like "MQ" or "AMQP protocol".
Re:FedNow Is Live by smarx007 on Thursday July 20, 2023 @06:20PM (#36807547)
I assume IBM Message Queue Interface (MQI) is the only supported protocol in this installation. Don't know of any other compatible brokers to support MQI.

Edit: "The FedNow Service will initially leverage IBM® MQ MQi Client for the payment message flows." according to https://www.frbservices.org/financial-services/fednow/blog/a...

Re:FedNow Is Live by wslh on Thursday July 20, 2023 @06:23PM (#36807569)
Last time, a decade ago, I played with RabbitMQ and similar open source queue system they didn't handle congestion and rate limitation well (crashed). From my little experience with classical IBM systems like MQ they knew about that stuff.
Re:FedNow Is Live by sjdmdlakziggy on Thursday July 20, 2023 @06:49PM (#36807822)
I spent a couple years deploying and integrating IBM MQ, and I own a couple of services currently that interact with it. It was (just a couple years ago) and probably still is more robust than current open source solutions, as long as you weren't planning on forking the code for some very specific use case that requires heavy modification, or the more likely situation of just wanting to save money.

As far as message queues go for something like the federal reserve, IBM MQ is really the only option that wouldn't raise a lot of eyebrows in the industry. The Fed is not the kind of institution that I think people would be lenient on for being open and innovative with their software solutions, banks really need to know that this thing is going to work and they all run IBM MQ themselves already. Not to mention the integration possibilities with Db2 and IMS, which are both huge in finance.

My only complaint is that it is very expensive. That's the story with most of the kind of hardcore technical products IBM sells that are likely to wind up near mainframes. I'd imagine the Fed gets a sizeable discount though.

Re:FedNow Is Live by MBCook on Thursday July 20, 2023 @07:10PM (#36808035)
Being able to publicly claim your product as the one that underlies part of the federal reserve banking system has got to be worth some real money to IBM.
Re:FedNow Is Live by sjdmdlakziggy on Thursday July 20, 2023 @07:31PM (#36808214)
That's part of it I'm sure, but it's much more than just advertising. What bank is going to make a risky move to a new message queueing service to save a few bucks when all their connections with the Fed use IBM's? And the hook there goes even deeper, because all of this stuff is deeply integrated with your databases.
Re:FedNow Is Live by pas on Thursday July 20, 2023 @07:18PM (#36808102)
can you please compare this IBM mainframe plus MQ stack with distributed and sufficiently redundant Kafka, for example?
Re:FedNow Is Live by sjdmdlakziggy on Thursday July 20, 2023 @07:37PM (#36808262)
I can try, but the difficulty there is that Kafka is not really a traditional message queue system and the use cases are different. In short though, redundancy isn't sufficient to solve the reliability issues inherent in financial applications and transaction processing.

If you want throughout, Kafka is the better option. Use MQ for transaction processing.

Technically, Kafka is an event streaming solution, not a message queue. There's plenty of good literature out there if you want to dig deep into the difference.

Re:FedNow Is Live by pas on Sunday July 23, 2023 @01:26AM (#36832777)
thanks for the reply!

I'm aware that Kafka is low-level (and that there is kmq, which tries to implement a message queue on top of it https://github.com/softwaremill/kmq/ ), but the exactly-once semantics seems isomorphic to having the sender and the receiver doing a 2 phase commit using the log.

what are MQ's guarantees? how are they implemented?

Re:FedNow Is Live by rodgerd on Thursday July 20, 2023 @07:24PM (#36808157)
> My only complaint is that it is very expensive.

On the one hand, I guess. On the other hand, I have a pile of the WebSphere product stack in my life. The app server is ten times the cost of MQ. WPS is another ten times the cost of the app server. It looks cheap when you're buying the really expensive stuff!

Also if you're using MQ for things like guaranteed delivery and making use of clustering and security controls I suspect it's cheaper to pony up for the IBM software than it is to spend time messing about in the thickets of the free alternatives.

Re:FedNow Is Live by amluto on Thursday July 20, 2023 @11:18PM (#36809611)
There’s always FIX. </snark>

FIX is, at its core, a message queue, and it’s a free financial industry standard. And, for any serious use in which the message queueing ability is important, FIX is wildly unfit for purpose.

Seriously, a deliver-once [0] message queue between two parties is very simple, and it’s truly remarkable how severely it can be screwed up. I’ve never used IBM’s solution, but I assume it actually works.

[0] Yes, deliver-once is impossible. But arranging for a failure to result in all messages up to a point being delivered, subsequent messages not being delivered, and the fact that a failure occurred being obvious to both parties is straightforward.

Re:FedNow Is Live by rodgerd on Thursday July 20, 2023 @07:21PM (#36808126)
I mean it pre-dates probably every open source MQ implementation, for starters.
Re:FedNow Is Live by wredue on Thursday July 20, 2023 @07:31PM (#36808213)
It’s a little especially strange as IBM hasn’t exactly made a great reputation for themselves over the last several years. Name dropping IBM makes me think that the reserve is generally not confident and is ready to blame IBM for what they expect to happen.
Re:FedNow Is Live by brewdad on Thursday July 20, 2023 @08:52PM (#36808774)
More likely, everyone in charge of this project on the government side is over 55 and still think of IBM as a signal of quality and reliability.
Re:FedNow Is Live by Nemo_bis on Friday July 21, 2023 @01:49AM (#36810406)
Wasted opportunity though. The ECB is adopting Kafka. https://www.ecb.europa.eu/pub/pdf/other/ecb.prototype_summar...
Re:FedNow Is Live by wslh on Friday July 21, 2023 @04:01AM (#36811250)
Kafka is not the same of MQ.
Re:FedNow Is Live by dralley on Friday July 21, 2023 @02:05AM (#36810506)
There is a huge variation in "quality" across IBM's product line. There are still a few sectors where they are legitimately top-tier competitors, and there are others where they're a joke.

Half the banking sector runs on IBM and has been running on IBM for decades. They know the domain well and have legitimate credibility for being reliable. It's not comparable to some of their other markets.

Re:FedNow Is Live by ratg13 on Saturday July 22, 2023 @03:47AM (#36824276)
IBM MQ has been the standard for message queues for literal decades.

Hitching a horse to a different technology platform that has only been around for a few years to complete a project that should last for many more decades would be an architectural choice that would only lead to high costs and high risk of major changes in the future and puts the whole system at risk.

Re:FedNow Is Live by throwawayForMe2 on Friday July 21, 2023 @06:55AM (#36812293)
The Fed has been using IBM MQ for connectivity for over 20 years for their outward facing services such as Fedwire and National Net Settlement.