Quote from caementarius:
I wouldn't get too caught up in what language.
Amen. Start with something, anything. Hell, I'd say start with Google Spreadsheets, all the GoogleFinance functions that is. You can trick some things out.
Then learn a language with low entry barriers. Preferably one that is used by a friend of yours so he can show you some tips. Perl is good (and more finance calcs are done in Perl than you'd think. It's great at crawling text files with a million lines.) It's free too, and you can use it on windows. Same with Python.
You'll see alot of things are very similar - if then statements, while loops, outputs and inputs, objects, etc. The principles are the same anywhere.
If you have a knack for it, you'll be able to move to another language easily and quickly (C#, VB, Java, etc etc). The talent of the developer for finding and automating simple but complete solutions to unique problems is much more important than what language they start in.If you demonstrate that knack, then you'll get hired, and they'll give you OJT to learn the language. And you will, quick.
If you don't have a knack for it, then look elsewhere. You'll burn out in no time cause for the really talented, developing is a lifestyle. They don't stop when they get home, and consider an all nighter before a deadline fun or a badge of honor or something. It's sick really.
Developer's do have great porn collections though. You'll always find the best porn in the IT dept.