Correct, but there is good proxy data for temps before that including tree rings, ice pack analysis etc. The following chart shows these various reconsructions.
The "hockey stick" describes a reconstruction of past temperature over the past 1000 to 2000 years using tree-rings, ice cores...