News for hackers. Stuff that matters.
Re:Python For Finance: Algorithmic Trading by lowpro on Friday June 02, 2017 @05:14PM (#14473359)
The main issue I found in algo and financial aspects of programming is that the market is a zero sum game, and my intro knowledge of finance and algorithms, even when I know python, are no match for MIT PHD Quants who does it full time. There's no real way to compete with that, and therefore I would lose money, even if the data showed it might be successful in the future, firms and full time workers on algo trading would simply be faster, more focused, have more funding, and be able to quickly and constantly adapt at the scale an individual could not.

So despite the fact that the subject is interesting, I'd consider it a waste of time to try and gain anything but a basic understanding of the industry and how algo trading works.

Re:Python For Finance: Algorithmic Trading by milcron on Friday June 02, 2017 @06:40PM (#14473807)
An economist and a normal person are walking down the street together. The normal person says “Hey, look, there’s a $20 bill on the sidewalk!” The economist replies by saying “That’s impossible- if it were really a $20 bill, it would have been picked up by now.”
Re:Python For Finance: Algorithmic Trading by Berobero on Friday June 02, 2017 @08:00PM (#14474099)
This quiq seems to support the original posters thesis, though, no? No one's going to make a living wandering the streets in search of $20 bills.
Re:Python For Finance: Algorithmic Trading by rxhernandez on Friday June 02, 2017 @11:45PM (#14474910)
I think you might be extending this model beyond its boundaries of usefulness.
Re:Python For Finance: Algorithmic Trading by candiodari on Sunday June 04, 2017 @09:26PM (#14484731)
Well it's a theoretical economics concept. The $20 bill is an opportunity, nothing more. A pretty good deal of course, but if you are pedantic you could defend the standpoint that you did have to do something to get it: first, get lucky enough to be there, notice it, then bend over and maybe clean it. So it's not "free", just a pretty good deal.

The same thing applies to getting a job for instance. Take job X. If job X was available and worth doing at wage $, someone would be doing it. So why bother applying ?

So what it really means is that the semi-strong and strong form of the efficient market hypothesis is bullshit: there are plenty of opportunities in the market, you're just not seeing most of them.

I would argue that nearly everyone doesn't even try to see opportunities.

Re:Python For Finance: Algorithmic Trading by _e on Friday June 02, 2017 @09:52PM (#14474521)
This is why models are just for starting a conversation and not for predicting the future. Life has too many variables.
Re:Python For Finance: Algorithmic Trading by cwyers on Friday June 02, 2017 @11:52PM (#14474924)
Wall Street isn't paying all those quants to start conversations.
Re:Python For Finance: Algorithmic Trading by _e on Saturday June 03, 2017 @06:06AM (#14475685)
Try writing out a business plan and see how well everything comes true step by step.

My point is that models will never accurately predict the future.

Re:Python For Finance: Algorithmic Trading by edanm on Saturday June 03, 2017 @01:04PM (#14477269)
My favorite response to this:

"OK, how many times have you seen a $20 bill on the sidewalk???"

Re:Python For Finance: Algorithmic Trading by smcl on Saturday June 03, 2017 @01:15PM (#14477334)
My answer would be "heaps of times". Different currency (GBP not USD) but still I saw £20s and £10s a lot
Re:Python For Finance: Algorithmic Trading by edanm on Saturday June 03, 2017 @03:02PM (#14477883)
I can't say the same, but fair enough :)

(I actually heard this response with a $100 bill as the example, which would make it even less common).

Re:Python For Finance: Algorithmic Trading by dsacco on Friday June 02, 2017 @05:29PM (#14473460)
I agree with most of what you're saying in principle, but it is very possible to identify alpha or acquire an edge that institutional market participants don't have. If you have access to data that most of the market does not, you can effectively trade on it. You can also effectively trade on a novel insight on a combination of data sources.

There is a lot of information asymmetry, and an individual is capable of capturing that without requiring a PhD or the resources of a large firm. That's not to say it's easy per se, but it's not hopeless. It requires special expertise or an unconventional approach.

Otherwise I agree that most people probably shouldn't attempt it (for risk tolerance reasons).

Re:Python For Finance: Algorithmic Trading by gnaritas on Sunday June 04, 2017 @01:03PM (#14482386)
> If you have access to data that most of the market does not, you can effectively trade on it.

Yes, but you aren't going to have any such data. If the information is available to you, it's available to other participants of the market as well and you're not the only one trading on it.

Re:Python For Finance: Algorithmic Trading by jjeaff on Monday June 05, 2017 @04:16AM (#14486034)
There is still a lot of opportunity out there. The thing is, as smart and loaded with resources the quants on wall street are, they have to work on opportunities that can provide returns with very large amounts of capital. Smaller opportunities that could bring in a few tens of thousands a month would not even make it on their radar. They need opportunities that can provide a return on hundreds of millions in capital.
Re:Python For Finance: Algorithmic Trading by dsacco on Sunday June 04, 2017 @01:46PM (#14482565)
I used to believe that as well. But it's fully possible to have data no one else does if you source it yourself (and I do). Furthermore, it's alright if a small number of other participants have the data as long as it's not yet priced in to market consensus.
Re:Python For Finance: Algorithmic Trading by gnaritas on Sunday June 04, 2017 @03:06PM (#14482962)
If you can source it, so can others, what makes you think only you have thought about trading on that data which must necessarily be public for you to have it legally?
Re:Python For Finance: Algorithmic Trading by dsacco on Sunday June 04, 2017 @03:43PM (#14483141)
> If you can source it, so can others

Yes, agreed: the longer the data is available, the more likely it is that others catch and start using it. That's a constant battle of course - continually coming up with new sources of data and new ways of getting it before most of the market.

> what makes you think only you have thought about trading on that data which must necessarily be public for you to have it legally?

I don't think I'm the only one who has thought about trading on it; on the contrary, I know there are many parties interested in trading on material information that is only technically public, but very obscure. However, after consistently profiting on this data, I can be fairly well assured that there are relatively few parties with the same informational edge, because the market consensus clearly doesn't price it in until it becomes explicitly widely known.

As I said, I don't need to have certainty that I am literally the only party with the information, so long as it is known by so few parties that the market consensus doesn't price in the sentiment. All material data has a half-life, which decays with time and market awareness. In some cases, the nature of the data or the methodology for sourcing it is so novel that it is conceivable to be the sole party with the information for a short and meaningful time period (where information means the exact same dataset acquired in a categorically similar way, not the downstream sentiment derived from the dataset). But that is a much higher bar, and it's completely unnecessary for profit. It's nice for pride though.

You'll have to forgive me for not going into any greater detail than that, both because any more than this is strictly a trade secret, and because I'd rather not have a competitor for my personal trading operations (or have someone turn around and sell this data, ruining my alpha in the process). The best I can tell you is to look into the analysis of satellite imagery, but with greater human ingenuity and a more specialized approach. That's not going to get you all the way there, but at least that much of the methodology is publicly known thanks to the old article about Walmart parking lots. You can't collect actual information about a company, but there is a lot of room for human creativity in finding strong proxies for that data that the rest of the market is mostly ignoring.

Re:Python For Finance: Algorithmic Trading by gnaritas on Monday June 05, 2017 @11:52AM (#14488472)
No no, good explanation.
Re:Python For Finance: Algorithmic Trading by SirLJ on Friday June 02, 2017 @05:48PM (#14473562)
Dsacco, I really like your way of thinking, too bad we cannot agree on the cheap data sources :-) My hope is that one day you can see the world trough my glasses :-)
Re:Python For Finance: Algorithmic Trading by sumedh on Saturday June 03, 2017 @06:21AM (#14475719)
> My hope is that one day you can see the world trough my glasses :-)

Why?

Re:Python For Finance: Algorithmic Trading by jlg23 on Friday June 02, 2017 @07:29PM (#14473975)
You are oversimplifying and overcomplicating at the same time. If it was an easy/obvious zero-sum game, we'd not have people going into finance at all.

MIT does not teach "HFT", those "MIT PHD Quants" are just as untrained in finance as you are. The rest is math, something that requires time to study but not necessarily a certificate. And creativity. I've only seen a single HFT-algo that made me say "wow, that's creative"; all others were just straight implementations of finance "wisdom".

Re:Python For Finance: Algorithmic Trading by _e on Friday June 02, 2017 @10:03PM (#14474574)
1.) Bet what you can afford to lose

2.) The less you know the better

Re:Python For Finance: Algorithmic Trading by osrec on Friday June 02, 2017 @08:49PM (#14474288)
Why do you say it's a zero sum game? If I've learnt anything from my time in finance, it's that the market is definitely not zero sum. The prices you see represent sentiment, not a hard valuation, and someone isn't necessarily losing when you gain. If you really think about it, even entire economies aren't really zero sum as our method of valuation is intrinsically subjective!
Re:Python For Finance: Algorithmic Trading by legolas2412 on Friday June 02, 2017 @11:28PM (#14474863)
If you aren't changing the sentiment, then it is a zero sum game based on the current sentiment.

Adjusted to average growth of stock market (and inflation), it is a zero sum game. You aren't creating value by predicting the future. Just like you don't create value when you predict which lottery ticket will win.

Re:Python For Finance: Algorithmic Trading by lrem on Saturday June 03, 2017 @05:29PM (#14478592)
As it turns out, there are at least 2 ways you can create value to society here:

1) Reduce spreads.

2) Stabilise prices.

Now, whether it makes any sense to put to work all those bright minds for these purposes, is a question the society should have asked some time ago...

Re:Python For Finance: Algorithmic Trading by danmaz74 on Saturday June 03, 2017 @06:46AM (#14475783)
I think that the OP meant that the speculation part (trying to buy low and sell high to beat the market) is a zero-sum game.

On the other hand, this zero-sum game helps companies raise capital to make real investments with real returns, and that part isn't zero-sum.

Re:Python For Finance: Algorithmic Trading by lowpro on Saturday June 03, 2017 @11:32AM (#14476836)
What I meant was HFT as I (and how I think the 'common person') understands it is that trading is basically a zero sum game since trading doesn't really help a company raise money over very short time periods, but investing is not a zero sum game where you're looking for stocks to go up over the long term.

Where I think HFT is zero sum is your competing against other HFT people to more accurately and quickly predict the future in the very near term, then buy & sell in a very short period. And since the market changes all the time, these algos must change to stay profitable over time as the competition improves their algos to beat you. Algo trading might work in markets where HFT isn't big yet, but most people won't know which markets that is or how to actually trade there, and if you get good enough to make successful models, you're basically in the industry, it's probably way more than a hobby at that point.

Re:Python For Finance: Algorithmic Trading by cocoablazing on Saturday June 03, 2017 @08:44AM (#14476143)
You are painting with an extremely broad brush. Before you give up on this idea, just try this exercise: enumerate the markets and financial instruments that you could potentially trade in, and characterize the current trading environment in that market.

An ultra-HFT liquidity provider being profitable has little bearing on the potential profitability of quantitative trading on significantly larger timescales. There isn't sufficient volatility in most products for these actors to eat the lunch of actors who have alpha on trades that can hold for significant periods.

Re:Python For Finance: Algorithmic Trading by yonkshi on Friday June 02, 2017 @05:49PM (#14473570)
Even if it's a zero sum game (which it's not), most participants are not quant/algo based. As long as you can beat 50% percentile, you can make a profit.

Sure you may not be as profitable as top quant companies, but do you really mind that much?

Re:Python For Finance: Algorithmic Trading by tryitnow on Friday June 02, 2017 @06:26PM (#14473748)
Why on earth do you think the top quant companies will leave alpha on the table for you to snatch up?

That sounds too much like wishful thinking to me. Furthermore, if someone is really smart enough to beat the market consistently why on earth would they trade just on their own personal account? Work for a hedge fund and use other people's money to leverage your bets.

Re:Python For Finance: Algorithmic Trading by dsacco on Friday June 02, 2017 @06:37PM (#14473799)
> Furthermore, if someone is really smart enough to beat the market consistently why on earth would they trade just on their own personal account?

Alternatively, if you have a strategy that empirically works, and a strategy for identifying such strategies, why take on investors to share the risk? You can scale up your own investment and leverage yourself with less regulatory oversight.

Why on earth do you think the top quant companies will leave alpha on the table for you to snatch up?

It's not so much that they leave alpha on the table, rather that there is so much alpha available, and the capacity constraints and reward profiles are so different for many of them, that individuals can prosper outside of a firm. They just normally don't, because they lack the same training (and because it's very competitive).

Re:Python For Finance: Algorithmic Trading by SomeStupidPoint on Friday June 02, 2017 @09:54PM (#14474528)
Some strategies only work with small investment sizes or require a lot of effort, so don't scale well.

Big firms leave tons of (for them) small opportunities on the table, because it's not worth their time.

Similarly, there are people who can regularly beat the market that don't have much to offer large funds because their methods don't scale.

Re:Python For Finance: Algorithmic Trading by ant6n on Friday June 02, 2017 @11:59PM (#14474938)
Like Buffet who said it's easy to invest even you only have a couple million, and much harder when you have billions.
Re:Python For Finance: Algorithmic Trading by ozi on Saturday June 03, 2017 @08:50PM (#14479331)
Strategies have varying degrees of scalability. It's possible to find consistent returns on a personal scale that would be unfeasible to scale to $100M+ portfolios
Re:Python For Finance: Algorithmic Trading by branchless on Friday June 02, 2017 @10:42PM (#14474712)
Trading is a zero sum game. You are making nothing. You win, someone else loses.
Re:Python For Finance: Algorithmic Trading by jtoll on Saturday June 03, 2017 @09:18PM (#14479428)
Trading is not a zero sum game. It doesn't matter if nothing's being made, that's not the point. It's an important service providing pricing and liquidity which facilitates capital allocation, diversification, and risk management. Trading is an absolutely essential part of the economy.

As a simple example, a farmer hedges his wheat crop selling wheat futures. That allows him to reduce some of his risk, thereby allowing him to plant more (i.e. growing the economy). The market marker who bought the wheat futures may be trading multiple commodities. This trade diversifies his risk, allowing him to trade more of other commodities, allowing other farmers to offset more of their risks (i.e. growing the economy). Investment companies or hedge funds enter the market purchasing futures, to diversify their risks, allowing them to invest more in equity markets, which fund companies (i.e. growing the economy).

If my point isn't already clear, markets and trading facilitate the diversification and allocation of risk capital to market participants thereby growing the economy. It's the conduit for capital which does make something.

Re:Python For Finance: Algorithmic Trading by SirLJ on Friday June 02, 2017 @05:20PM (#14473403)
Sorry, but this is like saying those CalTech PHD in Computers Science are the best, so no point for me to go into that field... This is like everything in life, not easy, but if you work on it it'll pay out in the end
Re:Python For Finance: Algorithmic Trading by zootam on Friday June 02, 2017 @08:21PM (#14474182)
>but if you work on it it'll pay out in the end

unless its one of the many things in your life that don't

Re:Python For Finance: Algorithmic Trading by martinko on Saturday June 03, 2017 @04:05AM (#14475483)
Not really, since trading is a winner take all game, whereas work in other fields does not have to be.
Re:Python For Finance: Algorithmic Trading by empath75 on Friday June 02, 2017 @05:53PM (#14473584)
You can get an advantage if you focus on smaller markets or industries where it's not worth the time for the big quants to play in.
Re:Python For Finance: Algorithmic Trading by danieltillett on Saturday June 03, 2017 @06:27AM (#14475735)
The is the only place the small guy can get alpha. Too small for the big guys to worry about and lots of fun to boot. The downside is the insider trading problem is really bad.
Re:Python For Finance: Algorithmic Trading by etep on Friday June 02, 2017 @05:28PM (#14473449)
If the market is a zero sum game, then for every winning trade, there must be a losing trade. Obviously some teams must be winning consistently, which implies that some are losing consistently. This says that the consistent losers go out of business. So who are the winners going to trade with? By contradiction, it is not zero sum.
Re:Python For Finance: Algorithmic Trading by vageli on Friday June 02, 2017 @05:53PM (#14473587)
> Obviously some teams must be winning consistently, which implies that some are losing consistently.

That does not necessarily follow; markets are not static and players are free to enter and leave.

Re:Python For Finance: Algorithmic Trading by etep on Friday June 02, 2017 @06:03PM (#14473635)
People like to say the market is a zero sum game, but I have always been suspicious of this truism.

Its fair to say that participants can leave the market, but in practice that isn't what we see. In practice there are firms doing this trading, and they are staying in business, and obviously making money.

Are they fleecing the little guy then? This explanation falls flat for me, i.e. for the amount of money they seem to be making, it would take a lot of small time participants losing everything every day. Most people I know aren't even active traders.

So why is it an accepted truism that the market is zero sum?

Re:Python For Finance: Algorithmic Trading by jacobr1 on Friday June 02, 2017 @06:28PM (#14473762)
The missing puzzle piece here are dividends. Sure some people buy high and sell low and thus take a loss. But the market as whole can increase in value due to the external growth and profit.
Re:Python For Finance: Algorithmic Trading by sidlls on Friday June 02, 2017 @06:07PM (#14473656)
>Are they fleecing the little guy then?

Yes, more or less (although that's just one way they make money, and probably not the most lucrative) And fortunately for them there are plenty of "little guys" ready to enter the market on a regular basis.

Re:Python For Finance: Algorithmic Trading by etep on Friday June 02, 2017 @06:13PM (#14473686)
My point exactly, not the most lucrative. So what remains is the implicit assertion they are fleecing the big time guys. And somehow the big time guys remain in business... so what's going on?
Re:Python For Finance: Algorithmic Trading by MR4D on Monday June 05, 2017 @12:43AM (#14485298)
Not quite. You need money to enter. Which was the parent poster's point - eventually, the losers will all be gone and there will be nobody left to trade with.
Re:Python For Finance: Algorithmic Trading by branchless on Friday June 02, 2017 @10:44PM (#14474724)
New suckers. Also a zero sum game doesn't mean one side always winning.
Re:Python For Finance: Algorithmic Trading by neximo64 on Friday June 02, 2017 @07:48PM (#14474057)
I'm curious to know who the loser was with the cryptocurrency rally this year?

You've forgotten you can introduce new units of whatever is being traded and quite often is & there are additional complications such as dividends, stock options, etc which makes your oversimplification lacking substance.

Re:Python For Finance: Algorithmic Trading by keithalewis on Saturday June 03, 2017 @09:21AM (#14476260)
This. But it does give python weenies an excuse to fool themselves into believing they are "programmers."