Machine Learning Algo for Trading

You design them for clients? Why would you do that if they performed so well and were robust. That already makes very little to no sense. It's like a trading mentor claiming he can trade. Why would he then not trade for himself?

Sorry that I come across as being harsh but I have worked in the front office and hedge fund industry more than a dozen years, and half of which in Quant prop trading. I never ever heard of a shop who would sell highly profitable strategies to clients. It's an oxymoron.
No, we do not sell strategies. I also use that old "It can't work, otherwise you would trade it yourself and not sell it" argument sometimes, but in fact this statement is nonsense in most cases. We're paid for developing a system from client's specifications. He still owns it. We could not even trade it unchanged for ourselves without violating the contract.
 
Last edited:
....
Generally, systems based on some financial model seem to have still better performance than machine learning systems.

This is the key take away from this thread
Like
Setup a financial mode that makes sense *then* automate
IT / Quants don't become traders
Traders instruct IT / Quant to automate / optimise stuff that already makes sense
Different mind set.
 
I am testing patterns in 1 min and find many statistically significant patterns that predict future volume and return but when I have tested in lower frequency time frames...they're not statistically significant...I guess that's why high frequency traders use automated system in 1 minute timeframe...

When I make a trade, I am predicting for positive outcome. I have done much back testing on one minute ES and many other instruments, I got same results as you in the beginning, I didn't break down price enough, first I found best times to trade, volume controls markets and lack of volume is noise, and noise takes one type of pattern and can make it useless. Then I broke down Swings=pivot lows to pivot highs to pivot lows and found that there is an average and have to use variances above and below. SO you have trend and counter-trend. Where each signal falls within a Swing will give different probabilities of success, so I test for Swing ave on each hour, some hours are seldom traded as risk must expand on light volume and targets must get smaller. Eventually I broke down Swings into waves, so I ended up with mountain of stats and by defining signals and backtesting and optimizing smallest changes, get clearer idea of what can be 60% or better pattern, but where the money is in risk management of the patterns as this will even say whether pattern can be taken based on chart patterns to left of now.

I believe HFTs do so well as they know they are like a casino and have the odds on their sides, they know 95% don't have well back tested Trading Plan and often emotions plays on them, They know emotions, signals and where stops are kept from their back testing, lack of volume they see as opportunities, markets goes higher and higher then less volume, BAMM slam it on down after they feed the last to retail going on up.
 
oh please, I have been in this industry way too long to trust a firm sticks to contracts when a lot of money is involved. Not accusing your specific firm but nobody in their right mind would entrust someone with developing a strategy unless it is developed in-house and unless we talk retail accounts. Contracts unfortunately mean nothing when much money is involved. We have seen uncountable number of cases where contracts were violated or code stolen outright.

And it does not change anything about the fact that your former statements re input data being more important and more complex than the underlying algorithms is simply wrong.

Otherwise why do you think the world's top AI researchers are battling each other in high profile competitions where everyone starts off with the same identical data sets that are 100% clean and free of any errors? It is because they differentiate themselves by the underlying algorithms they develop and how they optimize their deep learning networks. This alone complete disproves your case.

Listen, I am not participating in this thread to deny you or disprove anyone for the fun of it, but when someone is factually wrong I think it should be pointed out and I proved sufficient arguments and proof that your line of argumentation is factually incorrect

https://www.kaggle.com/c/digit-recognizer
http://karpathy.github.io/2014/09/02/what-i-learned-from-competing-against-a-convnet-on-imagenet/



No, we do not sell strategies. I also use that old "It can't work, otherwise you would trade it yourself and not sell it" argument sometimes, but in fact this statement is nonsense in most cases. We're paid for developing a system from client's specifications. He still owns it. We could not even trade it unchanged for ourselves without violating the contract.
 
When I make a trade, I am predicting for positive outcome. I have done much back testing on one minute ES and many other instruments, I got same results as you in the beginning, I didn't break down price enough, first I found best times to trade, volume controls markets and lack of volume is noise, and noise takes one type of pattern and can make it useless. Then I broke down Swings=pivot lows to pivot highs to pivot lows and found that there is an average and have to use variances above and below. SO you have trend and counter-trend. Where each signal falls within a Swing will give different probabilities of success, so I test for Swing ave on each hour, some hours are seldom traded as risk must expand on light volume and targets must get smaller. Eventually I broke down Swings into waves, so I ended up with mountain of stats and by defining signals and backtesting and optimizing smallest changes, get clearer idea of what can be 60% or better pattern, but where the money is in risk management of the patterns as this will even say whether pattern can be taken based on chart patterns to left of now.

I believe HFTs do so well as they know they are like a casino and have the odds on their sides, they know 95% don't have well back tested Trading Plan and often emotions plays on them, They know emotions, signals and where stops are kept from their back testing, lack of volume they see as opportunities, markets goes higher and higher then less volume, BAMM slam it on down after they feed the last to retail going on up.


I was also planning to break down prices using moving average but now thank you so much for sharing your invaluable knowledge Handle123, surely, I will take the more sophisticated approach you described to me. I am currently testing GBPUSD but surely I will expand my research to other currency pairs as well as other assets in the future. Even with GBPUSD, I think it will take at least next 6 months to come up with convincing evidence but once I build sounding algo, then testing other assets will not take so long.

You told me you're a scalper but you sound more like a HFT, and to be a HFT, I am sure you have to have a concrete knowledge of statistics, implying that you're a researcher. Are you an academic?

Once again, thank you Handle123.
 
Last edited:
I was also planning to break down prices using moving average but now thank you so much for sharing your invaluable knowledge Handle123, surely, I will take the more sophisticated approach you described to me. I am currently testing GBPUSD but surely I will expand my research to other currency pairs as well as other assets in the future. Even with GBPUSD, I think it will take at least next 6 months to come up with convincing evidence but once I build sounding algo, then testing other assets will not take so long.

You told me you're a scalper but you sound more like a HFT, and to be a HFT, I am sure you have to have a concrete knowledge of statistics, implying that you're a researcher. Are you an academic?

Once again, thank you Handle123.

LOL, academic, far from it, have few college degrees-we all have quests of becoming something when young but then learn, WTF was I thinking moment. Am more of a hands on Mister Fix it individual, love to tinker till I accomplish, so love more of the research than the doing in trading. Love to have automation than having to sit there all day. Two years ago, by error, found two separate patterns within week of each. It is the closest thing to HFT I have tinkered, but both base themselves not on the small trader, don't really want to say more than that, but I don't do heavy size contracts, I want to remain like a ghost but automation does run 23 hours a day.
 
For generic ML algos, data feed and setup is key.
For raw data, transformation and ML algos are key.

For trading, I believe in human learning!
(Sorry, couldn't resist! :p)
 
Last edited:
Not to forget, the learning objective is also key. The return at the next bar is not always the best objective since it's strongly affected by noise. Better is a more distant prediction horizon, or something entirely different such as a Zigzag leg, or the presence or absence of a market inefficiency. The objective is even the most important key for supervised learning since it affects what the best inputs to the ML algo are. So, objective first, inputs is second, and third is selecting the best suited ML algo for processing them.
 
Last edited:
Back
Top