News for hackers. Stuff that matters.
Re:An Update from Robinhood’s Founders by jennyyang on Tuesday March 03, 2020 @09:00PM (#22480584)
I know quite a few people that were personally affected by this and lost money due to the two outages and they are all pulling their money from Robinhood. The fact that they can't offer any compensation might be a big problem for them, since they already have zero trading fees, which is what most brokerages offer as compensation.

Personally it doesn't pass the smell test for me. The load was much higher the previous week and load problems go away once the load disappears. They probably had a lot less load the rest of the day, so the fact they were down the entire day suggests it was something else. I would need a fully transparent post mortem before I believed anything they said.

Re:An Update from Robinhood’s Founders by solidasparagus on Tuesday March 03, 2020 @09:08PM (#22480620)
Failures due to high load can take a while to resolve - you often need to fix the broken infrastructure, process the backlog, and catch up to live.
Re:An Update from Robinhood’s Founders by hcknwscommenter on Wednesday March 04, 2020 @01:03AM (#22481550)
You can't process the backlog on a trading platform. If i put in a trade at 2:20 pm and the system goes down, I don't want my trade to execute next morning at market open. That's insane. Especially the RH flavor of YOLO infinite leverage call option nonsense.
Re:An Update from Robinhood’s Founders by radicaldreamer on Wednesday March 04, 2020 @01:16AM (#22481593)
Exactly, you have to default to fill or kill within the trading day. You just can’t treat certain products like a standard queue... sometimes time is the most important component
Re:An Update from Robinhood’s Founders by stiglitz on Wednesday March 04, 2020 @01:38AM (#22481661)
FYI, FillOrKill/ImmediateOrCancel are not the same as a day order.

FoK/IoC means “do not queue this order”. It’s immediately filled (or not) (or, for IoC, partially) based on whatever orders are already in the book, and then you’re done.

Whereas a day order is queued until the end of the day or until it’s filled, whichever comes first.

Re:An Update from Robinhood’s Founders by solidasparagus on Wednesday March 04, 2020 @02:07AM (#22481778)
True for RH trades but I'm sure there is a lot of other data being handled - such as market data.
Re:An Update from Robinhood’s Founders by afc on Wednesday March 04, 2020 @05:35AM (#22482642)
Load problems don't go away when the load disappears. If the system isn't engineered very carefully (this takes a lot of work!), you may have cascading failures that may take hours to resolve, especially if you have bad retry policies (their mention of thundering herd problem seems to indicate that they might).

We wrote a bit about this here: https://landing.google.com/sre/sre-book/chapters/addressing-...

I would strongly caution anyone who thinks this subject is trivial, just add a bit of load shedding and you're done. I wrote a bit about my team's work (including a simplified view of some of the considerations that go into how we do retries) here: https://landing.google.com/sre/sre-book/chapters/handling-ov...

Re:An Update from Robinhood’s Founders by jennyyang on Wednesday March 04, 2020 @01:09PM (#22486122)
They specifically said it lead to a DNS failure. They didn't mention anything else, like corrupt data, etc. Sure there are plenty of ways that outages, not just load problems, can cause significant outages, but what Robinhood specifically said was that they had load issues that lead to a DNS failure. They should be more forthcoming with exactly happened if they want people to trust them.
Re:An Update from Robinhood’s Founders by rpdillon on Tuesday March 03, 2020 @10:34PM (#22480999)
I'm not sure it's fair to assume that service gets automatically restored when load dissipates after failures due to high load.
Re:An Update from Robinhood’s Founders by driverdan on Tuesday March 03, 2020 @11:46PM (#22481280)
This isn't something new, downtime is the norm for Robinhood. Anyone trusting them with more than play money is foolish.
Re:An Update from Robinhood’s Founders by neuronic on Wednesday March 04, 2020 @03:58AM (#22482185)
This is the correct sentiment. People who put anything more than play money into Robinhood should not be surprised when their financial life is ruined.
Re:An Update from Robinhood’s Founders by balls187 on Tuesday March 03, 2020 @10:51PM (#22481068)
How did they lose money?
Re:An Update from Robinhood’s Founders by jiqiren on Tuesday March 03, 2020 @11:19PM (#22481164)
Quick example: They bought puts on Friday and couldn't unload them for a full day + following morning.

Monday morning puts were down - it was obvious the market was recovering in a big way. Instead of cutting losses at ~20% in the morning they lost ~99% of their position. Some lost 100% since the options expired EOD.

Re:An Update from Robinhood’s Founders by balls187 on Wednesday March 04, 2020 @12:22AM (#22481404)
Thank you for the explanation.
Re:An Update from Robinhood’s Founders by UncleMeat on Tuesday March 03, 2020 @11:27PM (#22481201)
> it was obvious the market was recovering in a big way

Was it? Markets started up today but ended way lower.

Re:An Update from Robinhood’s Founders by westpfelia on Wednesday March 04, 2020 @01:42AM (#22481682)
It was more then just that though. Robinhood was displaying incorrect market data for the few people who could see it. (at least on monday)

So now you also have people making decisions based on the wrong data.

Honestly I dont see how this doesnt turn into a lawsuit.

Re:An Update from Robinhood’s Founders by UncleMeat on Wednesday March 04, 2020 @10:32AM (#22484563)
I’ve observed very wrong prices on both vanguard and google finance several times over the last year.
Re:An Update from Robinhood’s Founders by akchin on Tuesday March 03, 2020 @11:44PM (#22481269)
He is talking about Monday not today, Tuesday. RH didn’t work on Monday either.
Re:An Update from Robinhood’s Founders by UncleMeat on Wednesday March 04, 2020 @12:42AM (#22481471)
Yes and the point is that today it looked the same as yesterday in the morning but it didn't turn out to be a bounce. It wasn't "obvious" that everything would rise on Monday. Only in retrospect.
Re:An Update from Robinhood’s Founders by kortilla on Wednesday March 04, 2020 @12:03AM (#22481340)
Yes, there was nothing “obvious” about the market on Monday morning. Saying otherwise implies the ability to predict the market.
Re:An Update from Robinhood’s Founders by harikb on Wednesday March 04, 2020 @12:16AM (#22481381)
I think they meant to say the “loss makes sense”, not that Friday/Monday’s move was predictable
Re:An Update from Robinhood’s Founders by rolltiide on Wednesday March 04, 2020 @12:57AM (#22481532)
> The fact that they can't offer any compensation might be a big problem for them, since they already have zero trading fees

Robinhood makes the most money than any known firm on Wall Street by getting paid specifically to leak user's trades to other traders.

SEC requires a periodic report on that which shows compensation.

Can't believe people are still buying Robinhood's pitch of misdirection.

Re:An Update from Robinhood’s Founders by LatteLazy on Wednesday March 04, 2020 @02:05AM (#22481770)
Is there a source you can cite for that? Why would anyone want retail investor order data? Especially since most of their orders execute immediately, so you can just get the trade data from the venue...
Re:An Update from Robinhood’s Founders by a2h on Wednesday March 04, 2020 @03:20AM (#22482034)
Rule 606 disclosure for the source. And it's not about the trade data it's the order itself. Second link is a very thorough explanation.

https://cdn.robinhood.com/assets/robinhood/legal/RHS%20SEC%2...

https://www.google.com/url?sa=t&source=web&rct=j&url=http://...

Re:An Update from Robinhood’s Founders by JumpCrisscross on Wednesday March 04, 2020 @03:09AM (#22481989)
> Why would anyone want retail investor order data?

Former market maker here.

Retail flow is low risk. If I buy $100mm of institutional flow, I could get a bunch of corporate hedging orders. Or I could make a single bet against George Soros. With retail, one tends to find lots of small orders. Even if there are some with high information, i.e. they're smart money and I'm going to lose money trading against them, they're small enough to be manageable.

Retail is also low information. At an old job, we bought a prominent retail broker's options flow. The number of in-the-money unexercised options that would come through that pipe was mind-blowing. (Today, whoever was buying Robinhood's flow likely got the same.)

Re:An Update from Robinhood’s Founders by SifJar on Wednesday March 04, 2020 @02:38AM (#22481874)
I think you may misunderstand the concept of "Payment for Order Flow"
Re:An Update from Robinhood’s Founders by rolltiide on Wednesday March 04, 2020 @11:31AM (#22485171)
In what way?

How would you describe it in a way everyone can understand in as few words?

Re:An Update from Robinhood’s Founders by SifJar on Thursday March 05, 2020 @08:23AM (#22493282)
It is not "leak user's trades to other traders", it is accepting payment from a third party in order to execute the trade via that third party.