Overfitted? Please help take a look at my PNL curve...

Thanks for your comments.

When and how can I judge it's overfitted or not?

I hope I can find a way to convince my collaborator that it is overfitted and we should shut it down.

We've lost a lot of money recently...
 
Quote from mizhael:

Thanks for your comments.

When and how can I judge it's overfitted or not?

I hope I can find a way to convince my collaborator that it is overfitted and we should shut it down.

We've lost a lot of money recently...
More...

It depends on how you developed the model.

1. Did you have a conceptual idea of what your were looking for in terms of market dynamic? Was it a well known market dynamic?

2. Did you create a "simple stupid" backtest with no fitted parameters to test the initial concept for validity?

3. Did the "simple stupid" model produce ok results on similar products?

4. Did you properly simulate costs and fills?

5. Do you understand why the model went into drawdown during certain periods in the backtest?

All the above points matter quite a bit and any flaws in any one of the steps above will cause inconsistent results going forward.

If you did 1-4 correctly and then did some optimization, what exactly did you optimize and how?

Mike
 
You must log in or register to reply here.
Back
Top