News for hackers. Stuff that matters.
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by marktangotango on Saturday July 07, 2018 @03:40PM (#17480142)
Anyone who does algorithmic trading, what platform do you use? Do you roll your own? I’ve had a passing interest in this field for years but have not done anything myself.
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by Pissompons on Saturday July 07, 2018 @03:59PM (#17480236)
I've tried a few:

- Quantopian: Was good, has tons of data and makes things very easy. Unfortunately you can't easily live trade your algorithms anymore.

- QuantConnect: Open source, works okay, at the time I wanted it for options trading though and their support for options chains isn't so good.

- Zorro: Closed source, paid, uses a weird custom variant of C but works surprisingly well. Mainly focused on forex though.

- Others: There are others, like this one, that are mostly unusable because they miss something essential, like broker support or data.

QuantConnect is the only real packaged option these days I think but it's also not hard to roll your own. There are brokerages with _really_ easy to use APIs (Tradier is the first that comes to mind).

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by throwawaymath on Saturday July 07, 2018 @03:56PM (#17480229)
That depends on what you mean by "platform." Professional quantitative traders do not use services like this one. Virtually all of them - profitable and otherwise - work within firms that have separate teams for strategy research, strategy development, infrastructure, IT and internal software development. Typically there are sub-teams specializing in research and implementation (each) for risk management, execution, data processing and portfolio optimization.

So the most honest answer to your question, insofar as the question makes sense, is that algorithmic traders roll their own under the auspices of the firm employing them. In fact the way that this service structures their pricing is strange and unintuitive to me, and I can't imagine professional traders would agree with it.

While I have known people to trade on their own in a way that can be legitimately called "quantitative" (and even do so profitably), they all worked within a firm before doing that, and all of them targeted strategies that allowed them to capture a greater amount of the profit for an otherwise small total revenue that would generally be considered too illiquid and capacity constrained for institutional trading.

Quantitative trading in a solo capacity is basically a myth. Most of those who actually have a non-trivial attempt at it think they're doing it because they're working with a large amount of data and doing "backtesting", but that's well below table stakes. To put it in perspective, that's like saying you wrote and maintain an internet-wide search engine half as good as DuckDuckGo. It's a meteoric amount of work for one person to keep all aspects of an algorithmic trading strategy running smoothly.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by le-mark on Saturday July 07, 2018 @05:19PM (#17480646)
Most of those who actually have a non-trivial attempt at it think they're doing it because they're working with a large amount of data and doing "backtesting", but that's well below table stakes.

Can you define "table stakes" used here? The tone is a bit dismissive, but if there are individual investor doing algo trading with a few $100k and making some multiples of 10% gains annually, in bear and bull markets, seems like non a myth to me? Ie a couple of these people post here on occassion.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by throwawaymath on Saturday July 07, 2018 @06:35PM (#17481051)
Before I answer your larger question, I'm going to outright contest this particular claim:

> a couple of these people post here on occassion.

I'd be frankly shocked if there are more than five people active on HN who are "doing algo trading with a few $100k and making some multiples of 10% gains annually, in bear and bull markets" on their own, with no outside capital. There might be folks automating some kind of trading that relies on fundamental financial analysis empowered by information asymmetry, but that's not really the same thing (though it's also hard). The implicit idea of "algorithmic trading" is that an automated trading strategy can capitalize on an (empirically true) hypothesis about the world. That means it should be consistent; automating certain deployment, execution and risk management processes isn't sufficient for algorithmic trading. That's just empowering the trading process with software. You can't really deduce a rigorously defensible and profitable trading algorithm just by filtering a giant amount of data through a backtesting engine.

As for the larger question, table stakes for a quantitative trading outfit is typically 1) a strategy research team that identifies and analyzes opportunities primarily via mathematical modeling, 2) a strategy implementation team that develops and deploys the algorithms which capitalize on those opportunities and 3) an infrastructure team that develops the internal research, data processing and trading platforms used by the former two teams. More abstractly, these are three separate functions (research, implementation and maintenance) spanning several core competencies (advanced math/theory, software engineering and reliability). Backtesting and whatever flavor of the week definition of "big data" are generally involved, but they're a relatively smaller part of a much larger engine in the context of quantitative trading. Backtesting in particular is extremely sophisticated and, in some ways, largely automated in the context of professional funds.

Theoretically one person (or a very small team) could be competent at each of those functions, especially if they're working with a relatively small amount of capital and targeting market inefficiencies that are too small, niche or illiquid to be productive and profitable for institutional trading. But that kind of individual almost certainly cut their teeth in an actual firm before going solo, and if they are working solo then they're doing way more than just finding useful data, using it to deduce a trading strategy and backtesting that trading strategy across historical data. It's comparatively easy to develop an algorithm that takes advantage of information asymmetry using a combination of domain knowledge, intuition and some untapped data source. But insofar as quantitative trading means something other than a marketing term, that's an insufficient level of modeling and an orthogonal use of data to satisfy the bar.

The other obstacle is that the stars kind of have to align in a very strange and particular way for someone to be not only competent enough, but incentivized enough to crank this entire Rube Goldberg machine on their own and with their own capital. Assuming their skills are generalizable, a hypothetical person who can be profitable while doing all research, implementation and infrastructure work on their own can likely pull down mid 7 - low 8 figures in annual compensation at a number of different hedge funds with much better career stability, financial security, personal risk and work life balance. If nothing else they could probably scale up and hire 10 or so others to found their own fund, and it would be strictly irrational not to (unless they're already capacity constrained, in which case they can't).

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by marktangotango on Saturday July 07, 2018 @07:54PM (#17481345)
An example: https://news.ycombinator.com/item?id=16796028

To clarify; if you read this persons history, they have automated a strategy that’s been very profitable, according to them. Is this algorithmic trading in the same sense you mean?

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by Nostradedamus on Saturday July 07, 2018 @10:51PM (#17481925)
> The implicit idea of "algorithmic trading" is that an automated trading strategy can capitalize on an (empirically true) hypothesis about the world.

Bingo !

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by afinemonkey on Saturday July 07, 2018 @04:39PM (#17480449)
I do some algorithmic trading and automated investment in the crypto space. I trade intra-exchange and do arbitrage between pairs (tri-arb). I also occasionally rebalance into an index of coins I like. Note that I do this at a fairly small scale, so not sure if my answer really matters much.

Although there are a lot of platforms for trading crypto, when it comes to arb, I found that you need to have control over a lot of things, most importantly:

- which data center you host your code in - the way you get data from the exchange - not just prices and order books, but also current balances and orders - the way you push orders to the exchange

With "the way" I mean mostly which APIs you use and how, the last few milliseconds of optimization for me were usually gained by making multiple simultaneous connections to the exchange and trying to figure out the fastest one.

For my rebalanced index-like portfolio I made a little script initially and then turned it into a side project, plug: https://nazcabot.io

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by dclusin on Saturday July 07, 2018 @05:18PM (#17480640)
Don't the fees negate the profitability of this strategy? How often do you see the spread between the rates achieving profitability when factoring in taker fees?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by afinemonkey on Saturday July 07, 2018 @09:05PM (#17481599)
Trades are only triggered when profit is > fees. Depending on the market there can be fairly large opportunities popping up (on the thousands) a few times an hour. In a triangle, you only need 1 of the 3 pairs to have an inefficiency in the book to trigger a trade.

During the december craze: very profitable. Now: better than not trading.

If I were american and had to pay higher taxes on short term gains, it would probably not be worth it.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by chad_strategic on Saturday July 07, 2018 @06:23PM (#17480972)
Yes, I roll my own.

I'm unique hybrid as I have a MBA (finance) before the great depression and because of the great depression I couldn't find a job. So I taught myself how to code (~2010) and have been working in code ever since, while still doing some algorithmic trading on the side.

I build custom trading systems on the side. Interactive Brokers is the only firm that I have found that has a good API. TD ameritrade seems to be starting in that direction. As for Trader9, well best of luck. For a little self promotion...

http://www.strategic-options.com/insight/the-best-and-worst-...

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by pembrook on Saturday July 07, 2018 @06:54PM (#17481120)
>I have a MBA (finance) before the great depression and because of the great depression I couldn't find a job.

Since you've been alive for over 100 years, what's the key to a happy life?

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by chad_strategic on Sunday July 08, 2018 @01:13AM (#17482257)
I like to go to Hawaii every two years or so. Seems to help...
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by Schweigi on Sunday July 08, 2018 @02:36AM (#17482453)
I built my own platform too after discovering that most public platforms dont’t support Options, are slow on backtests or have bugs.

Thank you for the api list! In general the IB api is great to work with but it has some smaller annoying bugs. For example the market data api suddenly stops sending updates for the VIX and requires a re-subscribe.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by AznHisoka on Saturday July 07, 2018 @06:50PM (#17481105)
What is your annual return rate since you started algorithmic trading?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by hueving on Sunday July 08, 2018 @01:49AM (#17482342)
Great recession
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by SEJeff on Saturday July 07, 2018 @04:55PM (#17480515)
Most roll their own and use C / C++ / custom hardware for bare metal performance.

Disclaimer: I've worked for two of the largest HFT firms in the US over the course of the past 11 years.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by le-mark on Saturday July 07, 2018 @05:17PM (#17480632)
Note that algorithmic isn't just HFT.
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by SEJeff on Sunday July 08, 2018 @11:33PM (#17487802)
Absolutely! A lot of hedge funds are algorithmic. Statistical arbitrage is fundamentally not HFT (not always at least).
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by bitcoinmoney on Sunday July 08, 2018 @08:07PM (#17487044)
Can you share compensation info and work life balance? Ive always wanted to break in on this industry? Also, what types of skill set they are looking for?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by SEJeff on Sunday July 08, 2018 @11:39PM (#17487831)
Work life balance depends on the firm. If you're talking say Virtu or Citadel (two of the best equities players), you have no life, but you're payed a king's ransom. I was single and hungry to be the best technologist possible and it was great before I got married. I worked for Madison Tyler (Virtu's original trading company which finally merged with it for almost 5 years). Others are more amenable to a sensible work/life balance, but it really just depends. DRW and Jump Trading are generally known to have pretty solid work/life balances, but again it just depends on the team and what you do.

The way to break into finance, besides some luck or a recruiter, is being exceptional at what you do. If you write C++, be the best C++ developer you can be. If you tune Linux servers, you better know every sysctl knob literally in and out AND where in the kernel those are actually applied. If the knob doesn't work, perhaps you'll need to write your own (kernel patch) to toggle a specific tcp/ip tunable. I breathe Linux in my sleep because I've always found it fascinating and got lucky when a random recruiter found me while I was working on the Core Systems backend Linux team at Ticketmaster. Then it is simply a matter of putting your resume out and/or finding a recruiter who works with those firms. Some of them are more niche. Jane Street Trading, as an example, requires every employee to write Erlang. Being good at erlang isn't super common so that might be an "in". Two Sigma does a lot of open source work (they have a github and have contributed a lot of stuff to both the Mesos and Kubernetes communities). Honestly man, just do some research, find something you want to learn, and strive to be the best.

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by DuDoan on Monday July 09, 2018 @12:21AM (#17487950)
Hi Jeff, thank you for sharing man! I'd like to be a quant researcher because I think I have an edge on math and statistics. Can you tell me a bit about the quant team at Jump? Do they have Phds, know machine learning?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by hackandtrip on Saturday July 07, 2018 @06:02PM (#17480842)
Another question to who does algorithmic trading, is a software / engineering education with a strong math and data analysis useful to get into that? Do you have some particular resource where someone can start to approach it?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by fma on Saturday July 07, 2018 @10:29PM (#17481853)
You can get a degree in it. I've considered applying,(i live in Atlanta) but I have a family to feed and can't just quit my job for a new degree. Also most of the big money is in NYC so you'll likely move...but you'd retire in 10 years because you either made a lot of money, or have a lot of stress.

https://www.scheller.gatech.edu/degree-programs/interdiscipl...

Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by tcbawo on Sunday July 08, 2018 @01:50AM (#17482347)
Algorithmic trading is the epitome of a meritocracy. I'm highly skeptical of anyone offering a degree in algorithmic trading other than as a historical perspectives. It's an evolving field and extremely cutthroat. I would liken it to going to film school and trying to become Steven Spielberg.
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by hackandtrip on Sunday July 08, 2018 @12:24PM (#17484559)
How is the correlation between "epitome of a meritocracy" and "higly skeptical of a degree"? Is that for it being an evolving field?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by tcbawo on Tuesday July 10, 2018 @09:28PM (#17503731)
The industry has no customers to win over, no sales pitches, no marketing. You either make money or not. I'm skeptical of a degree for several reasons: * Knowledge of what works this year may not work next year. * Teaching people increases competition and dilutes any edge you might have. * If they could earn a living doing this, why wouldn't they be doing that instead of teaching classes?
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by ToddPanai on Monday July 09, 2018 @10:18AM (#17490323)
I use the Tradier API for Trading and data for my algo program. I tried to do it with Interactive Brokers before and did not get too far
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by eucitizen on Saturday July 07, 2018 @05:15PM (#17480620)
flask + postgres + keras - it’s rather easy to train models based of arxiv research papers. eg i trained a model using this method (https://arxiv.org/abs/1601.01987) and trade fairly frequently on minuscule amounts using the kraken (cryptocurrency exchange) api.
Re:Cloud9Trader – Simple, powerful platform for algorithmic ... by bitcoinmoney on Sunday July 08, 2018 @08:08PM (#17487047)
Roi? And risk of ruin? Sharpe ratio?