I don't think you'll find one person dealing in the financial markets that doesn't share your concerns, or have that thought every once in a while - its always in the back of everyone's mind, even if they won't admit it.
Marty Schwartz had some funny stories about those concerns (well, not...