You can take realized price data, and solve for the IV figure at a given past date, that if bought/sold and hedged, would have realized PnL of zero. So you can construct a vol surface where every IV figure is “fair value”, only in hindsight of course.
Depending on where you are in strike...