Quote from NTB:
One could make a strong case that "..the greatest risk of all is not taking risk" (AIG Commercial). In other words attempting to be overly prepared for a black swan event, or in fact prepared at all, could and in fact has lead to imminent disaster quicker than had an actual black swan event occurred.
In a black and white world:
By preparing for a black swan you're taking on as much, if not more, risk than if you were preparing for a "white swan". If that's what you meant, then I agree.
However, if there is some gray in the world, then there (to some extent) exists the option of avoiding all swans completely. If so, then the above becomes invalid and the greatest risk is no longer not taking risk.