How you are perceived would depend to a large degree on how you're living. If you live like an average person then people will question why you don't work a normal job. Is it because you want to be at home alone all day? Anti-social? Mad scientist type?
But if you're living large it would be different. No one will laugh at you or give you crap for being a trader if you drive around in a Ferrari.
The question is: is there anyone out there living large off nothing more than raw capital gains year after year after year after year?
Maybe. Maybe not. I think it depends on the general political orientation of the individuals social circle(s). Up here in Canada, most people are socialist/left-wing, who have no understanding of economics, are decidedly anti-capitalist (despite earning their living from capitalism), and hold a general disdain for 'making money' as a selfish or parasitical pursuit. America is different, in that regard. The almighty dollar reigns supreme and if you're getting paid, you get respect.
