That is only 1/2 the story. If you look at what happens if you miss the few days of the largest drops you do much better.
According to data from Ned Davis Research. From 1979 to mid-April of 2020, the S&P 500 Total Return Index gained 11.23% per annum. Sure, if you missed the best 40 days...