NEVER?! It happens sometimes.
Just like VIX can go up with significant upside volatility (ie VIX up, SPX up, surprising to some), it can also go down with insufficient downside volatility (ie VIX down, SPX down, surprising to some, including you, it seems). All four combinations can and DO...