Neural Networks Revisited

for what it's worth, I employ a convolutional network in order to predict co-integration properties of financial time series. I am disincentivized to go into details but I can tell you that every hedge fund, every bank, every buy side firm that I have friends working at is at the very least researching and experimenting with deep learning networks. Some are making serious inroads into utilizing every last bit of academic research in this space as well as pushing the limits further. Deep learning networks will revolutionize most every area of our lives in the next 10 years.

Never yet known a consistently profitable NN. But given time ? Lots of time imho
 
Well there's your problem. You'd need a linear activation function like the identity to learn, well, the identity function, with a single neuron. Matrix multiplication is a linear transformation. What linear transformation do you think you could apply to the output of the sigmoid function to turn it into a linear function (the identity)? There isn't one.

Try doing the math by hand rather than by your NN library, and you'll pretty quickly prove this to yourself.

Actually I found the issue. I had my input as 5 days delta, but output was 5 day delta OFFSET by 1. Since I corrected it, the NN now very closely matches solution to output as I was expecting.

The reason for doing this (seemingly silly) test of same inputs as outputs was to CHECK that NN actually gave the correct result!
 
for what it's worth, I employ a convolutional network in order to predict co-integration properties of financial time series. I am disincentivized to go into details but I can tell you that every hedge fund, every bank, every buy side firm that I have friends working at is at the very least researching and experimenting with deep learning networks. Some are making serious inroads into utilizing every last bit of academic research in this space as well as pushing the limits further. Deep learning networks will revolutionize most every area of our lives in the next 10 years.

Hey Conduit, are able to say whether you approach works on FX? I am from FX background, but I have data for FX and Equities.
 
Lot's of confusion and misunderstanding in the deep learning network space. I highly recommend all beginners to study and fully understand the following before heading to more complex models:

(Exercise on classifying handwritten digits)
http://neuralnetworksanddeeplearning.com/chap1.html

I recommend to start with Chapter 1 but to then read all other chapters as well, I found this author to best describe the underlying basics to absolute beginners in this space. A lot of guys wanna sound educated and scholarly but lack many fundamentals.
Thanks for the intro.
If you can steer me towards a profitable NN I would be grateful.
 
for what it's worth, I employ a convolutional network in order to predict co-integration properties of financial time series. I am disincentivized to go into details but I can tell you that every hedge fund, every bank, every buy side firm that I have friends working at is at the very least researching and experimenting with deep learning networks. Some are making serious inroads into utilizing every last bit of academic research in this space as well as pushing the limits further. Deep learning networks will revolutionize most every area of our lives in the next 10 years.

I've suspected this for awhile. thanks for the post.
 
Actually I found the issue. I had my input as 5 days delta, but output was 5 day delta OFFSET by 1. Since I corrected it, the NN now very closely matches solution to output as I was expecting.

The reason for doing this (seemingly silly) test of same inputs as outputs was to CHECK that NN actually gave the correct result!
Yeah, also my bad. I neglected to remember the bias unit, which could cause the activation to always fire at 1 :-) also if the input is always >> 1, the activation could always fire full.
 
I am working with some daily FX data. I have created 5 inputs: deltas, averages, RSIs etc. And I am trying to predict the "Forward" delta i.e. the price change 1,5 or 20 days ahead.

I have normalised all data between the min and max of a fixed period and mapped that to range 0-1.

I am looking at how to structure the layers. The simplest is 5-5-1 (Input neurons, hidden neurons, output neuron).

Now I could try 5-10-1 or 5-5-5-1. i.e. add 5 neurons to hidden layer, or add another hidden layer with 5 neurons. Obviously, I am going to test the difference empirically, BUT I would welcome any thoughts on what structure is likely to prove fruitful
 
Thanks for the intro.
If you can steer me towards a profitable NN I would be grateful.

I'm working on this subject for a while, experimenting with different architectures and models.
When I started to obtain more or less satisfying results, I've tested them on my own account, rather successfully.
After that I decided to publish predictions using website - http://stocksneural.net.

As you can see, there are some instruments on which models produce stable and profitable predictions, but there are also a lot of models with lower quality. So there's a lot of work to be done, and I'm constantly busy with experimenting with new models and trying to incorporate bleeding edge academic findings.
Also there are some glitches with the representation of information, especially with recommendations, I'm working on it also.
 
I'm working on this subject for a while, experimenting with different architectures and models.
When I started to obtain more or less satisfying results, I've tested them on my own account, rather successfully.
After that I decided to publish predictions using website - http://stocksneural.net.

As you can see, there are some instruments on which models produce stable and profitable predictions, but there are also a lot of models with lower quality. So there's a lot of work to be done, and I'm constantly busy with experimenting with new models and trying to incorporate bleeding edge academic findings.
Also there are some glitches with the representation of information, especially with recommendations, I'm working on it also.

Dmitry, do you show VAMI or equity curves for individual stocks anywhere?
 
Dmitry, do you show VAMI or equity curves for individual stocks anywhere?

Not yet, do you think it's worth adding? Does it have a great sense for individual stocks or is it better to let's say construct some portfolios and track VAMI for them?
Your opinion is greatly appreciated.
 
Back
Top