You are missing the point.
No, it is not wrong to expose an affair, if it is true. The NYT did a FRONT PAGE hit piece on John McCain during the 2008 election that was false.
The NYT apparently has a story on Boehner (whether true or not, TBD) that they are planning on releasing in...