Decompose the covar matrix into a corr matrix and a vol vector. Discard the vol vector (or use it as an input to your own estimated vol vector) and replace it with your own IV-dominated estimated vol vector. Then shrink the corr matrix, estimated vol vector, and the mean vector separately. Shrink the estimated vol and mean vectors towards their global and sector/factor means. Shrink the mean vector by much more than you think you should. Then combine the shrunken corr matrix and shrunken estimated vol vector to get your estimated covar matrix. Fit tangency portfolio using the [now shrunken] estimated covar matrix and the very-shrunken mean vector.LOL. I pitched to him the idea of shrinking the covar matrix
If you've done it right, it will almost certainly beat the naive equal-weight 1/n portfolio and even the min-variance portfolio. The only red flag that I see is that using implied vol implies a short lookback period (max expiry in my options database is 20221216). MV-optimal portfolios using recent covar and means are usually mean-vector dominated and tend to resemble standard 12-minus-1 momentum portfolios, which could be disastrous if the market turns or rotates out of current leaders.