News for hackers. Stuff that matters.
Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Thursday February 07, 2019 @08:15PM (#19110432)
I'm an ex algo trader (currencies and metals) myself, and found this article interesting and mostly accurate.

A key takeaway is:

"One of the fallacies that people have is the assumption that because the people who are working at certain firms are smart, they must be successful."

The number of times a new hotshot hedge fund moved in to office building where I rent, only to be gone without a trace in a month is staggering. Usually, they'll raise money from an unsuspecting family office or two, employ a techy and an admin person to do the heavy lifting, whilst the smooth talking CEO alt-tabs between Bloomberg and reddit all day. Most have terrible risk management strategies, and the majority are simply trend following (sorry, machine learning/AI). Some of these firms are also my clients, and I have often needed to write off money they owe because they've literally gone bankrupt overnight.

Re:Money Machines – An Interview with an Anonymous Algorithm... by lordnacho on Friday February 08, 2019 @05:47AM (#19113045)
Gone in a month? That sounds crazy fast. I'm an algo trading guy myself, and I can't imagine being up and running within a month of starting.

You have to code:

- Feed handlers

- Back office

- Research platform

- Strategy execution

- GUI

You need to have:

- PB agreements

- Network access (telco the world over suck as doing this in a reasonable time)

- Exchange memberships / ISDAs (depends what you're up to)

I guess you could have spun out from a larger group with some of this stuff, but then you'd probably not crash and burn that fast.

I do agree with the sentiment that fast talkers get more money than they can handle.

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Friday February 08, 2019 @11:34AM (#19115861)
There are a lot of firms that can get you up and running in a few weeks. They sell generic hedge fund formation packages, which give you all the tech/PB access. It's very rudimentary, but a lot of people do seem to opt for them, especially those that don't know what they're doing.
Re:Money Machines – An Interview with an Anonymous Algorithm... by xiphias2 on Thursday February 07, 2019 @09:12PM (#19110841)
Why are you ex algo trader? It still seems like a growing market, so it's interesting that you stopped doing it.

I'm right now working on optimizing my long term investment strategy, but the hardest thing is that there's nobody to talk to it about it (unlike when I have other coding problems), and I have no idea when I'm doing something totally stupid in my code base. Getting the right metrics to optimize is really hard, as mostly I'm just looking at numbers and graphs.

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Thursday February 07, 2019 @09:30PM (#19110953)
It's a crowded market, but not necessarily a lucrative one.

I worked for a large investment bank, was paid well, but was also rather unhappy. I'm not a fan of office politics and also hated the fact that what we were doing was actually quite unsophisticated, yet we dressed it up like the most complicated thing ever to clients.

We were using wavelets for analysing market micro-structure and using any generated signals to influence our trades. Wavelets were the topic of my thesis, so I was a good fit for the team. I know it sounds complicated, but if you looked at the signals we generated, they looked awfully similar to a rather basic trend-following style regression model. I believe we found a very complicated way to compute signals that a simple trend follower would compute in far fewer CPU cycles.

Anyway, I got a fairly decent bonus one year (because markets were trending nicely), and decided I want to set up my own tech company. I was always a nerdy guy, and I thought I could contribute more in the tech space. With hindsight it was a good move, and financially I believe I am now better off than most of my trading colleagues.

My advice to new guys joining our desk (maybe it helps you a bit): focus on your exit, more than your entry, and if you can help it, be really, really, really lucky :P

Re:Money Machines – An Interview with an Anonymous Algorithm... by _cs2017_ on Thursday February 07, 2019 @10:16PM (#19111212)
> what we were doing was actually quite unsophisticated, yet we dressed it up like the most complicated thing ever to clients.

Doesn't this describe nearly all of the financial industry? Do you happen to know of any exceptions?

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Thursday February 07, 2019 @10:42PM (#19111329)
Yep, and nope.
Re:Money Machines – An Interview with an Anonymous Algorithm... by dbancajas on Friday February 08, 2019 @10:54AM (#19115348)
how long did you work in that space and how much income you got over that span?
Re:Money Machines – An Interview with an Anonymous Algorithm... by rjf72 on Thursday February 07, 2019 @11:55PM (#19111663)
Perhaps the most important paragraph in the article: "Everyone is competing against everyone else. If one firm succeeds in making the market more efficient through quantitative techniques, then there’s less money left over for other people to make exceptional investment returns. There will be one or two firms that are good at innovation and recognizing things that other people haven’t recognized. But everyone else will be fighting over scraps."

The market is, in theory, not a zero sum game. Algorithmic systems, in practice, are. In theory the only way you can genuinely beat the market is when you find an inefficiency in it. And inefficiencies are generally based on a lack of knowledge. If everybody knows what you know, that inefficiency will no longer exist. And now pair this with the reality that most (and it's probably safe to say all) algorithmic systems are not really especially complex. That doesn't mean they're easy to make though. The 'secret sauce' is in exactly what data is used, how the pieces you have interoperate, the way inputs and outputs are massaged, and so on. But this drives a huge need for secrecy. Nobody who is successful is going to want to talk about how their system is designed largely because most would not be especially difficult to replicate if they provided more than very abstract details.

Re:Money Machines – An Interview with an Anonymous Algorithm... by awongh on Friday February 08, 2019 @03:53AM (#19112526)
Is this always true? One thing I wonder is, given that the amount of money needed to move the needle in a market could be actually quite large, how much money woyuld you need to make off a given inefficiency before it becomes a zero-sum game? Is it 10s of thousands? Hundreds of thusands? Millions?

And given some metric like trading volume how much does that affect that number?

I've heard of some hedge funds raising way less than they could have, maybe because their strategies would be killed much faster with 500mm than with 50mm ?

Re:Money Machines – An Interview with an Anonymous Algorithm... by blackflame7000 on Saturday February 09, 2019 @01:17AM (#19121070)
It's not a zero-sum game because debt is limitless. Imagine an extreme example where you rigged the game and literally won all the money in the world and then kept winning, what would happen next? People would find another form of payment via services and the money is worthless if you are the only one who has it. Therefore you might lend them money in exchange for a service so that they will keep playing your rigged game now accruing a credit of services in addition to money.
Re:Money Machines – An Interview with an Anonymous Algorithm... by benj111 on Friday February 08, 2019 @05:41AM (#19113012)
I'm trying to parse your comment. It sounds like you're basically trying to do part time what dozens of large companies spend large amounts of time and money trying to do, and then expecting them to discuss with you what they've done?

You know those books that show you how to get rich doing X? Those writers make far more money from the book than they do from X.

No doubt you can find corners of the investing internet that will discuss these things, but you'll probably find an awful lot of chaff in your wheat, because the successful ones won't be chatting about it on forums.

Now on a more constructive note, optimising your long term investment strategy is probably best achieved by getting a pension with some cheap trackers, and a savings account. If you're already doing that then great because that's 95% of your optimisations there.

I wont recommend any web sites, because the details will depend on the country where you live.

Re:Money Machines – An Interview with an Anonymous Algorithm... by inference on Thursday February 07, 2019 @09:19PM (#19110892)
I bet he/she.they either 1. made fuck-you-money and retired 2. burnt-out from the stress and decided to make slightly less large piles of money in return for less stress.
Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Thursday February 07, 2019 @09:31PM (#19110956)
Somewhere between 1 and 2, but very good guesses :)
Re:Money Machines – An Interview with an Anonymous Algorithm... by quietthrow on Thursday February 07, 2019 @09:13PM (#19110848)
Why did you quit ? (Assuming you did cos you said you are an ex alto trader).

How long did you do it? Is it possible to make a living as an algo trader?

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Thursday February 07, 2019 @09:36PM (#19111000)
See response above.

I was officially trading (i.e. coding the strategy) for just under 3 years, then got offered a senior non-trading role (but my pay was heavily linked to the desk's performance).

Can you make a living? Yes, if you're doing it as a salaried employee at a reputable institution. If you're going to try and algo trade with your 50k of savings, I would say "unlikely", and you might cause yourself a lot of anxiety.

Re:Money Machines – An Interview with an Anonymous Algorithm... by quietthrow on Friday February 08, 2019 @12:03AM (#19111696)
Thx for replying.

When you say yes to making a living but as an employee is that because of at an institution you are trading with much larger sum of money and hence there is enough return to pay for your salary bonus and then some or something else like getting a regular paycheck in a other wise very volatile return world? Essentially is the amount capital the key thing or something else.

Also how do traders typically come up with a strategy? Original insight or mostly copying the herd with their own variations?

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Friday February 08, 2019 @01:30AM (#19112019)
More capital is obviously better. But more importantly, what happens when you're not making money? How do you control your anxieties when your broker ac balance halves due to a trend reversing? Are you prepared to monitor your strategy 24/7? At a firm, there's probably someone there to do it for you - at home, it's just you. Trading is a casino and the emotions it imparts are similar - euphoria when you win, depression when you lose. If you have a job, you at least have a base salary that will bolster your living standard - without it, you're going to struggle in the bad times (unless, of course, you're already rich).

Regarding strategy generation, it's a mix. Quants like me almost always take the systematic, research like approach - analyse data, see if you can ascertain any predictable patterns and then paper trade them in the live market. If it makes money on paper, it might make money in the real market. Then just iterate and refine. Some guys do trade with their gut, but are rarely successful.

Re:Money Machines – An Interview with an Anonymous Algorithm... by quietthrow on Friday February 08, 2019 @10:42PM (#19120562)
How did you analyze data and results. Did you use a commercial backtesting service or it’s common business practice to use in house data that these firms are sitting on - data that they have acquired over the years?
Re:Money Machines – An Interview with an Anonymous Algorithm... by c2471 on Friday February 08, 2019 @04:17AM (#19112635)
The OP you asked worked at an Investment Bank. This is not exactly the pinnacle of algo trading (at least in US/Europe) as they are hampered by regulations about prop trading etc.

I work at a big quant/algo prop trading firm. The reason you can't compete is that most successful algorithmic trading relies on economy of scale.

Yes capital to trade with is one aspect, but more importantly is the amount of knowledge needed to carry this off. Building a safe, robust strategy is hard even if you have a working idea.

It requires probably top 1% knowledge in distributed systems, Linux admin, networking, database administration, security and more. The chance that any individual (or even team of less than 5 people) has those skills covered in addition to the quantitative know how to actually come up with a strategy is quite small.

There is a reason why algo trading is dominated by large firms. Working at somebody like Citadel or Optiver, if you say "oh damn, there's this weird effect on our server. When x happens I get a period of noticeable slowdown" they will turn around and say "Ok, well John here is a core dev on the Linux kernel, he'll come to your desk and help you figure it out".

Imagine that but with every problem pretty much. Running trading strategies you will hit problems. The level of work to overcome all of them satisfactorily whilst not degrading your edge is so much work for an individual I suspect you would burn out pretty sharply.

Re:Money Machines – An Interview with an Anonymous Algorithm... by osrec on Friday February 08, 2019 @11:31AM (#19115807)
OP here. While my division was in an investment bank, we were a prop desk that was eventually spun out of the bank, so we did have a "hedge-fund" vibe. I think what you're saying is spot on. The level of manual effort required to keep an automated system competitive and functional is often grossly underestimated by amateur traders.