The long side is essentially no alpha playing. The alpha is played when he turns to the short side, so what matter are the stats of the short trades. The mean of short trades, their variance, win/loss ratio, profit/loss factor, and the drawdown would help assess it.