If you want to pin the blame for what became anti-Semitism on someone, I think the Roman Empire is the most culpable candidate.
Think politically. By the time of Constantine's "conversion" in 313, Christianity was growing like wildfire in the Mediterranean, the Roman Empire was in decline...