This is where knowledge of the strategy becomes very important. Please note I'm not even talking about the "unknown unknowns" associated with a black swan event. I'm talking about the known unknowns.Quote from Pekelo:
....
1. What number of years is statisfying for you? LTCM had 4 good years and Matador had the same, before blowing up. Did they have real skill or see point #2...
I personally would never invest in an option-based strategy where I didn't understand the theoretical return distribution. I'm not talking about sharing enough information that I can replicate it, but at least speaking on the record about probable outcomes if we assume a fat-tail log-normal distribution.
Put it this way. If you're consistently selling options 2 standard deviations away (not at all uncommon), then assuming simplest normally distributed outcome you will be profitable 95% of the time.
Five years of performance is equivalent to 60 monthly samples... the strategy would be *expected* to be profitable 57 of those months. Even if a manager with a 5-year track record showed all 60 monthly samples were profitable, that isn't necessarily statistically significant.