You're partly right, except maybe splitting hair and giving an appearance of defending the guy.
According to wikipedia,
So, although strictly speaking, another term (ephebophilia) should be used in this case, that term is much more recent. Pedophilia, OTOH, is an acceptible use in this case...