This data is not representative of retail as a whole. This does not represent positions on the S&P 500. The "US 500" chart and data that you are showing is from one of IG's CFD products. There are no pro-traders within that sample because no hedge funds are taking speculative or hedging positions in a CFD. Even if "pro-traders" were in the mix, I don't think IG crosses orders, they are a dealing desk right? So the "pros" would never be directly competing with the "amateurs" at least from a counterparty perspective.
To top it off, the sample size is very limited at around 2400 traders. Either that or this market is really small with 2400 traders total. In that case it is not a sample but instead showing the entire population for that product. The majority of retail equities holders are long only/buy & hold. Either directly as a holder of an S&P 500 tracking etf or via a long only mutual funds that track the S&P.
I'm not saying that this data is worthless. Maybe it could offer some value by fading the crowd? The main problem you would face trying to trade this information in an automated fashion would be sideways periods of sentiment flip flopping. Take a look on your chart at October to mid November, you would be flipping positions from long to short and short to long multiple times during that period. All of that chop would eat you up and really put a dent in the gains you would realize from late December to now. My guess is, the returns of this signal would be similar to that of trading based on a 200 day moving average. Better look elsewhere for alpha.
some good points... let me reply..
I use this data to demonstrate how amateurs think and get slaughtered

as a side note check how they also pile onto bitcoin and gold... amateurs love to pick up dead garbage, and short the strong stuff going upwards.
the sample size - do you know how many stocks you need to mimic the sp500 performance? about 30... 2400 traders is more than enough to represent how amateurs think.
buy and hold - true, this portion is what the pros can NOT shake (for the most part), so this game is really the pros against the amateur speculators... and this data is perfect!
I don't use it directly as trading signals... I do longer term accumulating/investing, so this data is really a guidance for how aggressive I accumulate and how much I need to prepare for corrections.... shorter term traders may use it differently... e.g. if the ration is around 1:1 and market sells down hard from the top, the likelihood is high for a bigger correction hence shorting can be good for a few days.... but e.g. right now we are around 8:2 short long, therefore any big down day is unlikely to have follow thru.. that type of thing.. But for me, the shift from 9:1 to 1:1 takes a long time so there is now whipsaw.
The other purpose, as food for thought, is how we should approach the market mentally... do you think it's you against the market? or be in sync with the market? whatever, that seems mainstream.. but I think the easier way is - this is a game of the hunter and the hunted... the hunter has the fire power and the news media...what if you wake up everyday, and think - I am a hunter, how do I hunt 'them' down today (or this month, this year etc).... because there is a clear division of the predators and the prays.... in other words you figure out what the pros are doing, what the amateurs are doing, and you just play on the right team
