Yahoo Historical Data - Did they change the URL recently?

just21 said:
Change to https
More...
With https -

Did you try it before posting your reply ?

Because suggesting a fix that hasn't been tested is kind of douchy :-P
 

Attachments

  • Screenshot_20170517-163636.png
    Screenshot_20170517-163636.png
    178.8 KB · Views: 126
Last edited:
Rationalize said:
I've been downloading yahoo historical data for a long time using a URL like this:

http://ichart.finance.yahoo.com/table.csv?s=^VIX&a=0&b=1&c=2010&d=4&e=17&f=2017&g=d&ignore=.csv

Seems Merissa, her empowered baby, and the other geniuses at yahoo have monkeying around "improving" (ruining) things.

Anyone knowing the new URL format pls send through.
More...
Wow, this affects me also somewhat. It looks like the new URI structure requires a cookie "https://query1.finance.yahoo.com/v7/finance/download/COF?period1=1492408787&period2=1495000787&interval=1d&events=history&crumb=(cookie goes here)/Q"

They also have a new date format which is not making things any easier. This "update" was designed to stop people from downloading and scraping data. You can still manually download the data by visiting each symbol's page and clicking "Download Data".

If you tried to scrape the data directly from the html then you still have to deal with this new cryptic date format that does not make any sense at first glance. This was designed to keep people from scraping without a doubt.

WTF is this date format? edit: Update I think it is the Unix Date Format?
{"date":1492435800,"open":36.349998474121094,"high":36.4900016784668,"low":36.0099983215332,"close":36.25,"volume":1825100,"unadjclose":36.25},
 
Last edited:
Rationalize said:
Hmm. Looks a bit different. You see the same structure?
More...
The new URI structure I gave you is correct. The old one that you posted wont work anymore. The data in the html is a JSON object. It can be scrapped. You will just need to recode your downloader/scraper to convert a regular date to a Unix Timestamp. You won't be able to just plug in a URL into your browser anymore and have it automatically download. You will need automated tools to use the new URI structure and scrape/format the JSON objects.
 
Rationalize said:
Previous was 15 years of daily history in csv format - looks like i have some work to do.

Thx for the info. Appreciated.
More...
You can still get a .csv, I think the date format will be different. The only way to get a .csv is to download it manually from the yahoo Historic Data Page located within the same page for whatever symbol you are downloading for. Parsing the JSON is no big deal, I am sure there is code online to convert a Unix Timestamp to YYYY-MM-DD.

I'm going to rewrite my downloader for a different site. I'm done with yahoo.
 
You must log in or register to reply here.
Back
Top