Yes, you are.
Vega is the option premiums' sensitivity to changes in volatility (at the current volatility). Vega is a function of IV (among other things). Vega has nothing to do with IV being at 10%, 50%, or 100%.
IV is based on the current option price, the strike, the stock price...