News for hackers. Stuff that matters.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Saturday March 15, 2025 @09:48PM (#43376410)
I will eternally find it sad how much talent is wasted on trading. So much money, so much intelligence, so much time and effort, all the provide almost no tangible value to society.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by bblcla on Saturday March 15, 2025 @10:38PM (#43376594)
Tyler Cowen did an 'ask me anything' at Jane Street when I interned in 2016. One of the interns asked him exactly this: "What do you think of the fact that we all work here instead of, I don't know, curing cancer?"

He replied with, roughly, "Those of you who work here probably couldn't do anything else other than perhaps math research. Arguably, working here is the economically efficient use of your time."

I think about whenever I see a comment like this. Quant firms select for a very specific set of skills. In particular, I've found that many traders/software engineers in quant are very smart but not very self-directed. Places like Jane Street work well for people who can excel, but only when given a lot of structure and direction. I think this is not unrelated to why so many people 'accidentally' end up as traders after going to an Ivy League school!

Re:Finding Signal in the Noise: Machine Learning and the Mar... by Barrin92 on Saturday March 15, 2025 @11:02PM (#43376668)
General intelligence is overstated sometimes, but it is a thing. Someone who is smart enough to work for Jane Street probably could at least be an intelligence analyst or software developer at the NSA contributing to national security. (Jim Simmons literally was a code breaker during the Vietnam War)

I don't think there's a gene for playing esoteric minigames on the options market while you literally suck at everything else

Re:Finding Signal in the Noise: Machine Learning and the Mar... by pinkmuffinere on Saturday March 15, 2025 @11:54PM (#43376853)
Ya, I’m very surprised by the argument “you’re some of the best at numerical analysis and high frequency trading, and you’d be bad at anything else”, lol. That said, I think there are better reasons to work at such a place. Providing liquidity to the market is a good thing, and has real world value, it’s just hard for us to connect it to concrete outcomes. But as a simplified “toy” example, when they orchestrate a trade for/with a retirement fund, they help the fund improve its holdings at very low cost. That benefits everyone impacted by the retirement fund
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Nursie on Sunday March 16, 2025 @12:07AM (#43376877)
I think the amount of money that is creamed off for this service is disproportionate, and the amount of benefit to wider society a case of diminishing returns.

Allocation of capital, market liquidity etc are useful, but the size of the financial sector and the rewards it gives out for this shuffling of money are insane.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by FabHK on Sunday March 16, 2025 @12:20AM (#43376916)
I think the liquidity argument is overrated.

The market has two functions:

1. Incentivizing convergence of the price towards fundamental value, to support proper asset allocation decisions.

2. Supporting buying and selling (ie "liquidity") to shift consumption in time (and enable productive investments with the delayed consumption).

Suppose a retirement fund holds their investments over a 20 year period on average, growing at a modest 4%. A 1% wider spread would reduce the return from 119% to 118%. I'm not sure avoiding that is worth the financial sector constituting 30% of GDP.

What would happen if equity markets were only open a very short period a day? Say you have one auction a day, or maybe two, and no continuous trading?

Everyone whose advantage is speed would lose out (HFT, some prop traders). Their current gain would instead accrue to those on the other side of the trades.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by throwaway2037 on Sunday March 16, 2025 @06:53AM (#43378064)
This comment is weird to me. Are you saying that the "financial sector" (incredibly vague term) makes 30% of US GDP? Not even close. A trivial Google search proves that it is way off base.

According to this source: https://www.statista.com/statistics/248004/percentage-added-...

   > finance, insurance, real estate, rental, and leasing ... is 20.7% of US GDP.
Also, most of the GDP in the "financial sector" is in commercial banks and insurance companies. Yes, they take risk, but not the kind being discussed here.

Since the original article is about Jane Street's financial market making business, let's focus on investment banks. What percent of US GDP do you think that investment banks and trading hedge funds represent? It is tiny. I would be shocked if it is more than 5%.

    > What would happen if equity markets were only open a very short period a day? Say you have one auction a day, or maybe two, and no continuous trading?
This seems like a question from Econ 101. Let's expand that to all free markets in the US. What if homes could only be bought or sold once per month, instead of daily? How about agricultural products? Quickly this argument falls apart. Wholesale and financial markets with continuous trading have existed for centuries. The purpose of continuous trading (or very frequent auctions, like the agro auctions in the Netherlands) is price discovery. If you do it less frequently, then you have weaker price discovery and worse (less accurate) prices.

Finally, professional financial market makers have an important role to play in reducing the size of bid-ask spread. I recently bought some 1Y US Treasury bills using Interactive Brokers. I was stunned by how tight are the spreads, and I am a "Retail Normie/Nobody". Absolutely, this was not available to people like me 30 years ago. Who do you think is providing this liquidity that keeps bid-ask spreads so tight?

Re:Finding Signal in the Noise: Machine Learning and the Mar... by FabHK on Sunday March 16, 2025 @08:43AM (#43378580)
The finance sector contributes only 7% of GDP, correct. One of the sources I had in mind [0] cites 31%, but that was revenue as a proportion of GDP, which doesn't really make sense. However, the financial sector takes about 30% of US profits [1].

With respect to trading only once a day, I don't think your ad absurdum counterarguments hold water.

The HK stock exchange used to trade 4.5 hours a day, from 10 to 12, and then after a generous 2 hour lunch break from 2 to 4:30. How is trading 8 or 12 hours a day better for pension funds?

Price discovery with a limit order book that's cleared once a day might work just as fine as when it's spread out over hours, maybe even better.

Think about some major event affecting a company happening on the weekend. Then everyone can put in buy/sell orders with adjusted prices, and they'll be cleared during the morning auction. How is that worse than if the event happens intraday, and only the most switched on automatic HFT will pick off people still quoting at the old price, then the professional traders in hedge funds will pick off people?

As I said, the difference would be that the gains of the fast movers would instead be distributed among those on the "wrong side" of the news. Why should price discovery be worse?

Finally, what makes you think that liquidity and bid-ask spread concentrated in a minute a day would be worse than spread out over many hours a day?

[0] https://www.investopedia.com/ask/answers/030515/what-percent...

[1] https://conversableeconomist.com/2022/09/13/financial-servic...

Re:Finding Signal in the Noise: Machine Learning and the Mar... by throw-qqqqq on Sunday March 16, 2025 @06:55AM (#43378077)
> What would happen if equity markets were only open a very short period a day?

I think about it like this:

How stable are prices of low liquidity instruments compared to the most liquid instruments?

What happens in the first 10-15 mins after the markets open? EXTREME volatility.

Longer trading sessions, higher volume and more liquidity lowers volatility on average.

A hypothetical X percent worse spread on my mortgage bonds, means I have to borrow X% more to buy the house. That’s meaningful money for most people.

Market makers will still earn the spread. More trading just means it gets lowered because of competition and volume.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by andrepd on Sunday March 16, 2025 @08:12AM (#43378394)
I.e., they work to increase the return on capital. Since I believe one of the biggest problems in the world today is economic inequality stemming from an increasing gulf in the remuneration of labour and the remuneration of capital, I don't think this is a good thing. Let alone a good use of stupendous amounts of talent and money.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by rangestransform on Sunday March 16, 2025 @09:36AM (#43378982)
The only reason software engineers are able to be paid so much at all is because of “capitalism” and “free trade” I.e. vacuuming up money from the rest of the world, we sell them ads and “SaaS” and “intellectual property” while they sell us food and clothes. Would be a bad day for me personally and our profession in the US when that stops
Re:Finding Signal in the Noise: Machine Learning and the Mar... by andrepd on Sunday March 16, 2025 @02:57PM (#43381260)
My ethics is not defined by what is personally beneficial for me. I don't suddenly stop thinking something is wrong just because I benefit from it.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by rangestransform on Monday March 17, 2025 @10:15AM (#43388853)
We’ve seen what happens when the price of eggs goes up a little bit, never before seen levels of prosperity seems to be the only way to convince Americans to treat each other kindly, pick your poison I guess
Re:Finding Signal in the Noise: Machine Learning and the Mar... by rtpg on Sunday March 16, 2025 @12:39AM (#43376969)
While I’m sympathetic to the “people working hard to build out ad markets instead of cancer research” argument, I only believe in a weak version of this.

Why? I have met many “smart with computers” people. Many of them have terrible people skills, don’t show up to things on time, are unable to keep their workspace clean, don’t know how to explain anything, and cry about how they can absolutely never ever be interrupted because their workspace is so hard. There are also people who are “good at it all”, of course, but I have the impression that the math/computer people tend to be fairly unwilling to deal with even mild inconveniences.

People who can barely deal with the tyranny of daily standups probably would struggle a lot in a world where you need to write grant proposals continuously to justify your existence.

I’m being glib for effect, but there’s so much involved in getting work done beyond “being smart”!

Besides… it’s not like the reason we don’t do more cancer research is because smart people didn’t go into that. “Cancer research” is limited by funding for positions into that domain!

So “this quant should have been a cancer researcher” is saying “this person who decided to become a quant will be a better cancer researcher than a cancer researcher who went into that domain directly”. I don’t know the prestige vectors there but it’s a stretch in my book!

Re:Finding Signal in the Noise: Machine Learning and the Mar... by jampekka on Sunday March 16, 2025 @06:46AM (#43378043)
> People who can barely deal with the tyranny of daily standups probably would struggle a lot in a world where you need to write grant proposals continuously to justify your existence.

I'm continuously writing grant proposals to justify my existence, and have been quite successful (lucky) in it. But I do bitch about the pointless grant game and about the pointless meetings.

Perhaps the problem is that to survive in academia you have to be able and willing to waste your time on all the bullshit that is not research. And it selects for people who are good and willing at the grantwriting and politics game, which is not the same as being good at research.

Maybe there's some point in bitching about the tyranny. Having tech people to do sales and marketing on the side like researchers have to do probably isn't an ideal division of labor.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by elefanten on Sunday March 16, 2025 @01:32AM (#43377101)
I didn’t take that to be his point. I assume he says “economically efficient” because he means their strongest skillsets don’t have (m)any other uses and they wouldn’t be realizing their potential by leaving those skills unused.

He probably overstates that case, especially talking to early career interns that haven’t yet narrowed their specialization and could pivot to other highly quantitative roles that use other high level math.

He’s also probably flattering his audience, to whom “math research” is more likely to be status-bearing.

Doubt he’s saying they’d suck at anything else.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by alfiedotwtf on Sunday March 16, 2025 @08:39AM (#43378557)
I would rather people work in trading than for the NSA
Re:Finding Signal in the Noise: Machine Learning and the Mar... by lysecret on Sunday March 16, 2025 @03:05AM (#43377357)
Do you have a link to this talk by any chance?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by bblcla on Sunday March 16, 2025 @03:43AM (#43377475)
Unfortunately, no. It was a private talk.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by cinntaile on Sunday March 16, 2025 @04:55AM (#43377715)
It sounds like something you would say to not upset your host.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by ackbar03 on Sunday March 16, 2025 @03:37AM (#43377462)
Oof. Interesting take.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Grimblewald on Sunday March 16, 2025 @04:01AM (#43377520)
To build on / extend on this - quants / finance folks need to cultivate an image of only taking the very brightest, to justify the shit working conditions (even if pay is often decent) but honestly the brightest tend not to apply. Working in those environments is neither rewarding nor stimulating.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by jxjnskkzxxhx on Sunday March 16, 2025 @04:21AM (#43377580)
> He replied with, roughly, "Those of you who work here probably couldn't do anything else other than perhaps math research. Arguably, working here is the economically efficient use of your time."

Complete garbage. The same way that Jane Street hires smart people that don't know anything about trading and those people contribute, the same would be true if there was money in curing cancer.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by andrepd on Sunday March 16, 2025 @08:07AM (#43378371)
Plus, this post is about someone who quit being a doctor to work in trading!
Re:Finding Signal in the Noise: Machine Learning and the Mar... by arthurofbabylon on Sunday March 16, 2025 @05:00AM (#43377737)
Tyler Cowen, master of the ‘cum hoc ergo propter hoc’ fallacy. He frequently mistakes the occurrence of phenomena for causative proof of that phenomena. He particularly exhibits this inclination when his confidence rises amid scant data (like the rest of us).

This error seems to be a particularly common (and often lauded!) trait among those who work in high-conjecture low-evidence fields (eg, economics). The prominent thinkers become skillful at deploying this fallacy: “see, it’s there, therefore <insert-personal-belief> is certainly the cause!”, using their credentials and esteem to mask the error. Listeners think, “well he’s a smart, respected guy,” and nod along despite the missing logical link.

I greatly appreciate Cowen’s podcast, and I definitely respect him as a thinker and inquisitor – so I don’t mean to discard his work or opinions (in fact, I appreciate his occasional brashness because it exposes the underlying thought/principle). However, many of his aggressive-yet-speculative statements (like the one you roughly quoted) are best received with an understanding of the error.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by owl_vision on Sunday March 16, 2025 @11:56AM (#43380007)
I plus-one the last paragraph, well explained.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by madars on Saturday March 15, 2025 @11:20PM (#43376740)
Why would it be wasted? I like apples and I like being able to buy them any day of year, even out of season. The only reason I can do so is because there is an entire industry of people who manage the inventory, distribution, try to predict supply and demand, and take on a risk doing that. The principal reason why I can buy and sell equities at very small spreads any day of the year is similar: traders are competing to take the other side of the bet.

I also encourage everyone to read CFTC response to the Vatican's (!) Congregation for the Doctrine of the Faith https://www.cftc.gov/PressRoom/SpeechesTestimony/giancarlore... It talks about about the social utility of derivatives and refutes the narrative that they are basically tools of "speculation." Traders take on risks others can't bear, creating massive economic value that ripples through the entire system.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Saturday March 15, 2025 @11:47PM (#43376832)
There is an extreme case of diminishing returns at play here, and unfortunately the amount of money that flows through these markets is so incredible that it becomes worth it (more than worth it) to commission the top minds of society to push them limit as close to 1 as absolutely possible.

Derivatives have great value to industry. Derivatives that require the fuel of 15 math Phds to lock in fractions of a percentage pricing inefficiencies so their firm can pocket the difference do not have much value at all.

It's like employing Harvard Med surgeons to remove gold dust from jewelry market sidewalks, and calling it "gold market efficiency".

Re:Finding Signal in the Noise: Machine Learning and the Mar... by Infernal on Sunday March 16, 2025 @12:24AM (#43376927)
And yet if there was so much gold dust lying on the sidewalk that you could pay 15 Harvard med surgeons enough to pick it up and still have some left over, would you just not?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Sunday March 16, 2025 @01:14AM (#43377057)
That is the issue.

The amount of gold recovered by them as a function of the entire global gold market is a minuscule rounding error. A loss so small that when distributed across every market participant (as it would be if left alone on the ground), would amount to no practical discernible difference in anyone's life.

But having 15 less top notch surgeons not doing surgery? There stands to be many practical discernible differences in many people's lives.

Keep in mind, the surgeons are not the only ones out there. There are large armies of grunts combing those streets 24/7 picking up all the easy pieces. The surgeons are there to get the dust that everyone else misses. It's an enormous waste of talent.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by lotsofpulp on Sunday March 16, 2025 @06:08AM (#43377916)
Gold is not analogous to trading.

If you subscribe to the theory that markets allocating capital based on supply and demand is beneficial for society (even if detrimental sometimes in the short term), then traders provide the utility of contributing to the proper allocation of resources in society (which is constantly in flux).

The fact that smart people opt to go into trading (or selling advertising) rather than research is a consequence of government underpaying scientists (or the volatility is too high, or the path to quality of life at work is too low).

Either way, if the situation is that society needs more scientists or doctors or whatever, then the government should be paying more to incentivize those choices.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by albumen on Sunday March 16, 2025 @07:12AM (#43378131)
Markets influenced by traders can lead to misallocation of resources, as traders often prioritise short-term profits through speculation rather than investing in productive, long-term projects beneficial to society. Traders frequently increase market volatility, contributing little to meaningful innovation or economic growth.

Additionally, even if governments improved pay for essential roles like scientists or doctors, the outsized financial rewards from trading would still attract talent away from these critical areas. Therefore, depending on markets and government incentives alone ignores the negative impact traders’ profit-driven strategies can have on society’s overall well-being.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by FridgeSeal on Sunday March 16, 2025 @04:32AM (#43377627)
I think I’d rather have the surgeons saving peoples lives tbh.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by lotsofpulp on Sunday March 16, 2025 @06:12AM (#43377927)
Then make it so one does not have to sacrifice their 20s and harm their health to become one.

Expand the number of medical schools, the number of residency positions, etc. Reduce tuition or pay graduates and residents more. Reduce unnecessary learning requirements so that one can expect to have a life and become a surgeon. Reform tort law.

None of these are under the purview of trading firms or the people that work there.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by eadmund on Sunday March 16, 2025 @06:41AM (#43378027)
> Derivatives that require the fuel of 15 math Phds to lock in fractions of a percentage pricing inefficiencies so their firm can pocket the difference do not have much value at all.

They have at least as much value as the total compensation of 15 math PhDs, otherwise that work would not be done.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by andrepd on Sunday March 16, 2025 @08:14AM (#43378416)
It's remarkable how on every single discussion on this topic the Circular Argument is eventually brought up lol
Re:Finding Signal in the Noise: Machine Learning and the Mar... by daymanstep on Sunday March 16, 2025 @06:57AM (#43378084)
It is bizarre that people conflate money with value.

A scammer who makes $1m dollars a year does not generate any value, in fact he removes value from society.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by mhh__ on Sunday March 16, 2025 @12:10PM (#43380099)
That isn't really what the math people are doing. Pricing is easy.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by dietr1ch on Saturday March 15, 2025 @11:30PM (#43376764)
> I like apples and I like being able to buy them any day of year, even out of season. The only reason I can do so is because there is an entire industry of people who manage the inventory, distribution, try to predict supply and demand, and take on a risk doing that.

This has been the case for well over 200 years and is not done by the same kind of people that modern finance/fintech employs.

Imagine the world 150 years ago and imagine were you'd allocate the smart people that's the highest paid these days. They'd be doing science and developing technology instead of doing finance. Why is finance that much more important now? (is it just because it makes rich people richer?)

Re:Finding Signal in the Noise: Machine Learning and the Mar... by mlyle on Saturday March 15, 2025 @11:51PM (#43376846)
I do think finance is important in making markets more efficient, predictable, and liquid. In turn, this improves the amount of capital available and also improves the efficiency and availability of international trade.

It's also a sophisticated "export" product itself.

However, I think there's a point where, absent sufficient regulation, it overshoots and most of the effort goes to squeezing nickels out of everyone else in underhanded ways. I feel like we could get 90-95% of the benefits with a finance industry that's half the current size, and also avoid a whole lot of indirect costs that come with an oversized finance industry.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by achierius on Saturday March 15, 2025 @11:29PM (#43376762)
Everyone understands that there's a pricing utility to markets and market speculation. But consider that, like in all things, the free market has its 'biases': wouldn't you expect that something like trading, which directly produces profit with very little overhead and maximal ability to hedge against rush, would draw an inordinate amount of capital -- in the same way that things like infrastructure, sans government intervention, naturally repel it?

We have far, far too much of our economy sunk into a sector that fundamentally produces nothing of value, one that only shuffles value around and chooses to whom it will be allocated (coincidentally, often the people doing the allocating!).

Compare our economy and its woes to China. Do they spend nearly as much of their human capital figuring out how to get an extra bp on some statistical arb? Thethe origins of DeepSeek are illustrative in this regard.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by jfim on Saturday March 15, 2025 @11:44PM (#43376819)
> I like apples and I like being able to buy them any day of year, even out of season. The only reason I can do so is because there is an entire industry of people who manage the inventory, distribution, try to predict supply and demand, and take on a risk doing that.

In practice, if the availability of the apples you're eating is dependent on finance people, they're commodity grade, not specialty varieties.

I don't eat apples, but I'd rather have a good heirloom tomato from the farmer's market than the commodity grade stuff that's at the grocery store.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by pasc1878 on Sunday March 16, 2025 @06:26AM (#43377976)
How do you get to the farmers market? Walk? If not then how was your vehicle produced and powered and how were its components got to you?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by arduanika on Sunday March 16, 2025 @12:06AM (#43376875)
Amazing link. Including the car mechanic joke.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by thrance on Saturday March 15, 2025 @11:46PM (#43376825)
Ok, but what do high frequency trading bots possibly do to help me eat apples in winter (a deeply unecological mode of consumption, btw)?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by eadmund on Sunday March 16, 2025 @06:45AM (#43378041)
I believe that they provide liquidity. That’s a fancy way of saying that they ensure that any time someone wants to sell he can find a buyer, and every time someone wants to buy he can find a seller. That in turn means that folks are more confident of their ability to enter and exit a position, which means that they are more likely to enter and exit positions, which makes the market more efficient at finding prices.

And of course prices are hugely valuable: the market is a conversation about the relative value of everything, and the language it speaks is prices. So by enabling liquidity, high-frequency traders are enabling efficient allocation of resources towards those things which mankind most dearly needs and desires.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by FabHK on Sunday March 16, 2025 @12:29AM (#43376937)
Sure, some derivatives have some utility.

But, ok, Spread Networks spent $300m around 2010 to build a somewhat straighter glass fibre data connection between NY and Chicago. Other companies spent more to build a micro wave connection, since microwaves move faster through air than light through fibre.

Is that money really well spent? And I'm afraid a lot of what happens in finance is similarly private gain, without much social welfare increase.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by pclmulqdq on Sunday March 16, 2025 @12:36PM (#43380271)
That money is very well spent considering that the microwave network technologies developed for trading have huge applications for military and emergency response use. Similarly, millimeter wave technology built for trading firms in New Jersey could rightly be considered as one of the precursors to Starlink.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by MichaelRo on Sunday March 16, 2025 @03:32AM (#43377445)
It's fun to see how every time a finance topic pops up, discussion steers towards lamenting on how "talent is wasted" by doing this and not that.

See, if you're a fishmonger and someone comes to you and say "why don't you trade flowers instead", you ignore them because they are not your customer. They won't trade fish with you, and in fact they wouldn't trade flowers either. They're just useless relative to your trade and only yapping so just turn your back on them and leave them be. Tell them to fuck off and find a flower monger if they really want it or mong those those flowers themselves because you are sticking to monging fish.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by ustad on Sunday March 16, 2025 @06:33AM (#43378000)
At the end of the day, it’s fine to ignore the critics or people who don’t understand your work, but dismissing the conversation entirely without considering the underlying point might close off an opportunity for meaningful reflection. Just my two cents.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by MichaelRo on Sunday March 16, 2025 @09:18AM (#43378832)
Reflect on what? Some utopian cvasi-religious bullshit which has no real applicability except virtue-signalling? Why don't we all do nice things instead of being caught in the capitalistic rat race to make a living? (Not that other systems fared better). Why do we have to work shit, meaningless jobs instead of doing the grand things of life, engineering, arts, etc?

Well first of all because all those niches are already full beyond capacity. All the engineering, arts, cancer research, you name it, that the society can pay for is stuffed to bursting point and in no lack of pipelines of fresh wannabe recruits. Also cancer research is a deeply unprofitable enterprise overall, much in contrast to a domain like finance. One can labor a lifetime and get nothig, at least in finance they'll shovel some money from one pocket to the other and pocket the commission themselves.

Please leave people alone and stop suggesting alternate careers, that you yourselves did not choose. That's the uttermost hypocrisy. I don't wanna see anymore programmers with fat paychecks jumping on whatever latest fad like flies on a fresh laid turd doing AI and crypto and advertising and just bullshit pretend work at FAANG shedding crocodile tears on how the finance guys should be poor and suffering. Quit your high paying jobs yourselfes and go starve while doing biology PhDs then work as baristas while competing with the other 10,000 highly skilled Phds hoping to catch one of the 10 currently open positions in the world that pay a miserable salary with no stability in the future that does cancer research.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by achierius on Sunday March 16, 2025 @09:39AM (#43379015)
Nobody is saying finance people should be poor and starve. The same people critiquing the finance industry in this thread have been happy to critique ad tech as well, and I agree that they're both largely parasitic 'faux frais'. But regardless of which industries you choose to put in that category, the point isn't to make individuals choose to work in one or another -- that's not how serious change happens. It's to build support and hopefully eventually consensus on the idea that our economic system is broken and in serious need of change.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by ustad on Sunday March 16, 2025 @01:07PM (#43380491)
Your perspective is totally valid - people should do what works best for them. But dismissing the conversation out of hand could limit opportunities for a deeper understanding of what kind of work aligns with both personal fulfilment and societal good.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by mbac32768 on Tuesday March 18, 2025 @01:18PM (#43402005)
Yes this. There's no shortage of people working in quant finance who used to work in research who quit because they literally could not afford to start a family.

People imagine it's like prestigious professors at top research institutions leaving their posts because of the allure of money, when it's more like the 100x people just like them who were denied tenure and realized they chased a career in science like an inner city youth chases getting into the NBA: most people fail. Then what?

I even know people who worked in quant finance, struck it rich, quit to finish becoming doctors, and then came screaming back because of how horrible medicine was.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by leohonexus on Sunday March 16, 2025 @04:22AM (#43377591)
Thank you for the link, it was very insightful.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by ustad on Sunday March 16, 2025 @06:38AM (#43378015)
While it’s true that trading and financial markets provide value, the conversation around “wasted talent” isn’t necessarily about denying the value of these industries. It’s more about the broader context - are all forms of financial activity contributing to the greater good, or are some activities just enriching a small group of people without providing societal benefits?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by twoodfin on Saturday March 15, 2025 @10:22PM (#43376527)
If it didn’t provide value, nobody would pay for it.

The alternative to highly technical, agile quantitative trading is fat middle men, wide spreads, and capital sitting in 8%* stupider places than it would otherwise. That’s a pretty big deal even if the observable effects are extremely diffuse.

* Made up number, but if we woke up on Monday with nothing but the tech we used to trade in 1984 it would probably hit much worse.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by godelski on Saturday March 15, 2025 @11:37PM (#43376792)
Lots of things provide no value that people pay for.

The inverse is true too: lots of things provide value that no one pays for.

I find it shocking that anyone that programs would think this way considering how widespread and common open source tooling is. I don't know how you can get through your day without using OSS or even free websites like stack overflow.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by twoodfin on Saturday March 15, 2025 @11:47PM (#43376829)
Of course the inverse is true, and you don’t have to stick to software. Raising children produces value despite no one exchanging currency.

But generally nobody pays quants to lose money. They expect value over the other opportunities they have to use that same money.

Is this really controversial?

Re:Finding Signal in the Noise: Machine Learning and the Mar... by TeaBrain on Sunday March 16, 2025 @12:16AM (#43376903)
>But generally nobody pays quants to lose money. They expect value over the other opportunities they have to use that same money. Is this really controversial?

As with your other comment, this has nothing to do with what the original parent comment was remarking on. They didn't claim, nor did anyone else, that proprietary trading firms weren't making money and that people weren't well compensated due to helping firms make money. Their remark was that the value these firms are providing to society is questionable and that the highly intelligent employees could likely be providing greater value to society elsewhere.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by philosopher1234 on Sunday March 16, 2025 @01:00AM (#43377020)
Money and value are different things.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by godelski on Sunday March 16, 2025 @02:20AM (#43377228)
Your comment comes off as "people pay, therefore it has value." Which the inverse would need to be true in that case.

But you are conflating money and value. As you stated, raising children produces value, and as you imply, this is not generating revenue. Which you are also conflating exchanging money with generating value. Sure, liquidity can generate value but don't confuse these things.

People seem to be forgetting that money is a proxy and that a proxy is not the same as the thing you are proxying.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by TeaBrain on Sunday March 16, 2025 @12:06AM (#43376876)
>The alternative to highly technical, agile quantitative trading is fat middle men, wide spreads

No, this would be the alternative to securities and derivatives markets being electronic. Proprietary market making firms are mostly competing against each other.

>If it didn’t provide value, nobody would pay for it.

The parent was remarking on the value provided to society, not the value provided to the firms.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by zknow on Sunday March 16, 2025 @12:11AM (#43376888)
they make the mistake of paying for it unlike those who know what to do https://www.investopedia.com/articles/investing/030916/buffe...
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Sunday March 16, 2025 @01:27AM (#43377082)
My actual gripe is with where that value comes from, and what it's true cost to society is.

I'd argue that pulling these people out of moving society forward is just another form of externalized cost. The stanford guy who figured out how to halve the cost of solar in 2012 never got to realize it because $750k/yr to do stochastic modeling of cattle feed to (secretly) overcharge farmers for futures contracts was just too enticing.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by TheAlchemist on Sunday March 16, 2025 @03:10AM (#43377375)
The way I see HFT, is that previously this money was going to brokers and banks.

Now, most of this money is going to HFT shops, but you could also make an argument that some of it stays with the investors, since spreads are much smaller now.

There is 0 cost to society, maybe even a small gain.

As for moving society forward, I don't know. If not in finance, most of these guys would work for big tech companies trying to actively make kids and adults addicted to screens.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by thijson on Sunday March 16, 2025 @08:42AM (#43378574)
One benefit I've seen is that commission free trades wouldn't be possible without payment for order flow. I remember the old days when it cost a lot to do a trade. Also the stock price tick increments used to be higher. That's been steadily eroded.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Sunday March 16, 2025 @10:35AM (#43379386)
These are just first order effects. I'm talking about second and third order effects that I would argue make the value prop of tighter spreads enormously negative to society on the whole.

Liken it to the government deciding to spend 40% of the budget on roads. Suddenly the roads quickly get pot holes filled, the lines are seemingly always freshly painted, cracks are all filled, and even mildly uneven roads gets freshly paved.

The first order effects of this would all be positive. The transportation dept. could talk all day about benefits to everyone. Everyone would love the great roads.

But spending 40% of the budget on roads is insane, and the second and third order effects would be disastrous to that society.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by TheAlchemist on Sunday March 16, 2025 @04:53PM (#43382213)
If we're talking second and third order effects, then we should bring up the capitalism vs socialism debate.

In a separate single example, it's fairly easy to point out what's the right thing to do - as you do with your Stanford guy example. However, history show us that it usually turns out to be disastrous in the long term. Maybe this Stanford guy will make several millions $, and then go back to desiging how to produce those half price solars at scale.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by __cxa_throw on Saturday March 15, 2025 @11:10PM (#43376702)
Theres large portions of the tech industry that are pretty useless to society too while paying incredibly high salaries random examples include: - facebook/google ads teams - various SaaSLOP companies

Lots of smart engineers that work on making buttons pretty and A/B testing crap rather than pushing the boundaries of science.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by achierius on Saturday March 15, 2025 @11:30PM (#43376765)
This is also bad. Huge amounts of our human capital are invested in fundamentally anti social enterprises. This sort of market failure seems to be endemic to our system as it stands today, and the only answers I've seen are "well, but that other bunch are even less useful!"
Re:Finding Signal in the Noise: Machine Learning and the Mar... by lend000 on Saturday March 15, 2025 @11:41PM (#43376811)
From a technical challenge standpoint, trading is extremely difficult. But it provides high upside which only starting a business can exceed. However, starting a business has all the other uncertainty (regulatory, accounting, insurance, licensing, taxes, customers, branding, sales, product-market-fit), making it far more psychologically challenging overall. Startup founders need to learn and juggle a lot of things instead of hyper-fixating on markets. Basically, if you know you are sufficiently intelligent and talented as an engineer, your expected return is likely much higher in trading (especially via a big quant firm), with much lower risk.

If we want more talented traders to become founders building economic value (which we should all agree on), we need to make it less onerous to start a business.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by xrisk on Saturday March 15, 2025 @10:46PM (#43376622)
At least it’s arguably better than working for giant ad engines.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by czk on Saturday March 15, 2025 @10:56PM (#43376652)
This reminds me of Renaissance Technologies (Jim Simons, PhD in math from uc berkeley).

He started the company in 1982 after he left academia for finance and leveraged quant models for training, they mostly hire PhD mathematicians, physicists and scientists, working on algorithms.

They have a fund called Medallion that is closed off from outsiders (you have to be an employee I believe), and it averages 66% annual gross returns (39% net after fees). Generated hundreds of billions in profits.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by whiplash451 on Sunday March 16, 2025 @11:53AM (#43379985)
Well. Read about him all the way to the end, then.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by keyle on Saturday March 15, 2025 @10:12PM (#43376493)
I take the silver lining. Smart people getting rich is better than dumb people getting rich. Hopefully some day they'll do something good with that money.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by jwr on Saturday March 15, 2025 @10:50PM (#43376633)
The problem is that smart people are the ones being employed, not the ones getting rich.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by twoodfin on Saturday March 15, 2025 @10:52PM (#43376641)
I am pretty sure anyone who sticks around Jane Street for a while is getting “rich” by any popularly accepted measure.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by godelski on Saturday March 15, 2025 @11:39PM (#43376801)
I'm pretty sure the parent is implying that there is quite a disproportionate distribution.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by twoodfin on Saturday March 15, 2025 @11:51PM (#43376843)
Sorry, implying what? That Jane Street quants aren’t getting rich enough?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by godelski on Sunday March 16, 2025 @02:08AM (#43377191)
Read the comment again

  > The problem is that smart people are the ones being employed, not the ones getting rich.
Employed is a key word. Generalize the point beyond Jane Street if you're still having difficulties. Such general understanding will be necessary if you want to work somewhere like Jane Street.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Mistletoe on Saturday March 15, 2025 @11:21PM (#43376743)
Sam Bankman-Fried and Caroline Ellison did for a while…
Re:Finding Signal in the Noise: Machine Learning and the Mar... by memonkey on Saturday March 15, 2025 @11:47PM (#43376833)
I would prefer good people get rich and bad people don't.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Nursie on Sunday March 16, 2025 @12:00AM (#43376865)
I’m not sure that’s true either.

See for example “effective altruism”, which turns out to have been neither, but more of a self-deluded justification for insane greed, coupled with a god complex.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by in3d on Sunday March 16, 2025 @02:38AM (#43377279)
Ridiculous, uninformed comment. There is no question that Effective Altruism has done tremendous good overall by saving many, many lives. I say this as someone who disagrees with important aspects, such as valuing distant lives equally to local ones. They have also been more correct than anyone else about AI, pandemics, etc.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Nursie on Sunday March 16, 2025 @05:59AM (#43377886)
It’s also been used as a self-justification by the likes of Sam Bankman-Fried, who exemplifies the qualities I mentioned above.

It’s clearly a very flexible philosophy that “smart people” can use to justify pretty much whatever, and given the presence of such people as SBF and cronies, certainly doesn’t support the notion that it’s a great thing for “smart people” to get rich, or really that we should expect that to be any more than neutral.

“Smart People” can be scumbags, and some prominent EA folks were, all the while shouting about how good they were.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by LeroyRaz on Saturday March 15, 2025 @10:16PM (#43376508)
I agree, how dull and uninspired. I'm very much with Paul Graham, who believes in the creation of wealth (as opposed to the extraction of money).
Re:Finding Signal in the Noise: Machine Learning and the Mar... by anonym29 on Saturday March 15, 2025 @10:22PM (#43376533)
Can you codify the difference? I seem to be fundamentally misunderstanding the difference between wealth creation and wealth extraction if voluntary market activity constitutes extraction.

I'd definitionally describe all voluntary transactions free of coercion to imply the buyer values the utility of what they're buying (i.e. true wealth - piles of currency are not true wealth, they're what you exchange for true wealth) more than the currency they're trading for it, no?

Involuntary transactions featuring coercion on the other hand, like the government demanding you pay taxes under threat of imprisonment (enforced at gunpoint, if necessary) are clearly extractive, by my definition.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by LeroyRaz on Saturday March 15, 2025 @10:47PM (#43376625)
Money Extraction: fighting over a slice of pie.

Wealth Creation: creating new pie.

In practice, a lot of things that look extractive (e.g., designing better high frequency trading algorithms) potentially have some marginal utility (e.g., creating market liquidity), but the money these people make is likely larger than the utility they add to the system (because most of the money in having the best high frequency trading algorithm comes from beating other people's high frequency trading algorithms).

Re:Finding Signal in the Noise: Machine Learning and the Mar... by foobar10000 on Saturday March 15, 2025 @10:53PM (#43376645)
While there's many definitions, I'd concentrate on zero-sum vs non-zero-sum games. Lots of games in trading are effectively zero-sum games - if I make 100USD, you lose 100USD (there's details about transaction costs going to exchanges that make this more nuanced, but the principle applies). A chunk of financial engineering games are not : for example risk pooling games. A big part of finance for example is liquidity provisioning games - which kindof boil down to risk pooling games in the limit. But unfortunately - a _very_ big chunk of the financial markets is zero-sum.

Even in a purely digital world - most of the economy is not zero sum - i.e., it _creates_ wealth. I pay you 100USD for 1 million LLM tokens - a purely digital transaction - the net result of this is the 1 million tokes that I can consume and use - net of the transaction.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by YZF on Saturday March 15, 2025 @11:02PM (#43376672)
Financial markets are not zero sum. Wealth is created or destroyed in financial markets despite each trade having a buyer and a seller.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by foobar10000 on Sunday March 16, 2025 @12:37AM (#43376964)
I mean - of course the entirety of financial markets are not zero sum - it would indeed be almost lunacy to claim that :) My point is that there's a big part of the financial markets that _are_ zero-sum - not that all financial markets are. One can argue about EMH and that the zero-sum games are in fact injecting information into the market by providing better price discovery, and that is indeed an argument - but one is left with the intellectually unsatisfying statement of "Well, anything the market does is information extraction, and the market is an information extraction machine, so prima facie, it works" - which is basically restating the EMH axiom.

For example, the added value provided by sub-millisecond arbitrage between NY and Chicago - while making the prices converge a fraction of a millisecond faster, makes the overall set of people playing that game in excess of 1B USD in aggregate. I'd argue that such a ratio of profit vs value-added gain is very bad, bordering on 0 - thus making that effectively a zero-sum game.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by YZF on Sunday March 16, 2025 @02:10PM (#43380926)
Price discovery and liquidity. But yeah, I agree sub-millisecond arbitrage maybe less so.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by philosopher1234 on Sunday March 16, 2025 @01:05AM (#43377031)
Sorry but this is a shit definition.

You’ve defined scamming people, a totally voluntary error, as creative not extractive.

You’ve also defined building roads as extractive not creative.

I think you’re latching onto some very misguided principles.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by anonym29 on Sunday March 16, 2025 @09:28AM (#43378910)
Building toll roads is creation of value. People voluntarily pay to drive on them because they offer superior qualities to garbage public roads. If I could exclusively drive on toll roads, I would.

Public roads, OTOH, are extractive because someone is taking money from you to build them even if you don't consent to it and deliberately avoid them at every opportunity.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by thrance on Saturday March 15, 2025 @11:49PM (#43376839)
Did he really advocate for that? Then why did he support the GOP, a very-much pro-financialization party?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by tikhonj on Saturday March 15, 2025 @11:12PM (#43376707)
Eh, hard to say that when the main alternative (math, physics or CS research) requires jumping through a lot of selective hoops, barely has positions available, and absolutely no trouble filling all the positions they do have.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by thrance on Saturday March 15, 2025 @11:41PM (#43376813)
I'd argue it provides negative value even. The goal of these people is to extract money from the markets, without actually producing anything. In biology, we'd call that parasitism.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by objektif on Saturday March 15, 2025 @11:25PM (#43376758)
Would you rather people spend their time on centering divs? Or come up more ways to make people click on ads. I see this type of view often on HN from big tech employees. Get off your high horses people.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by abenga on Saturday March 15, 2025 @11:34PM (#43376780)
Are those the only other options to being a quant? That's a false dichotomy if I ever saw one.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by philosopher1234 on Sunday March 16, 2025 @01:07AM (#43377036)
You haven’t contested the substance of the argument at all. It’s as though you agree.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by objektif on Sunday March 16, 2025 @08:46AM (#43378601)
There is nothing to contest here. This is HN forum and there is wide held belief that capital markets tech work is somehow below what the folks are doing in SV.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by Workaccount2 on Sunday March 16, 2025 @11:15AM (#43379693)
Funny enough I don't work in tech, but rather manufacturing.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by dgfitz on Saturday March 15, 2025 @10:18PM (#43376515)
Smart people who grew up poor making their own way, isn’t that the idea? Or do we just assume they’re all rich, privileged folks?
Re:Finding Signal in the Noise: Machine Learning and the Mar... by anonym29 on Saturday March 15, 2025 @10:17PM (#43376510)
Are you proposing a universal hierarchy of value where the goals individuals set for themselves are inherently worth less than the goals you want to set for them, if the goal they want for themselves is prosperity?

Who elected you Supreme Leader?

Re:Finding Signal in the Noise: Machine Learning and the Mar... by EGreg on Sunday March 16, 2025 @12:32AM (#43376949)
It's a zero-sum game. People don't understand this: https://community.intercoin.app/t/intercoin-compared-to-the-...

I guess advertising is too, in the limit. So a lot of the business model on the web is also not much value to society.

Re:Finding Signal in the Noise: Machine Learning and the Mar... by laughingcurve on Sunday March 16, 2025 @01:27AM (#43377080)
Society has the problem, not the individuals.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by logicchains on Sunday March 16, 2025 @03:23AM (#43377413)
Please share what industry you work in? And if it's social media/ad tech or military, get off your high horse you smug hypocrite.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by vismit2000 on Sunday March 16, 2025 @04:52AM (#43377700)
This sentiment is also covered in 'Zero to One' by Peter Thiel.
Re:Finding Signal in the Noise: Machine Learning and the Mar... by whiplash451 on Sunday March 16, 2025 @11:50AM (#43379955)
I recommend you read the life of Jim Simons (through The Man who Solved the Market) as well as a recent HN thread on DeepSeek showing how their trading arm finances the whole company.

There is much more nuance in this world than your post implies.