Data Scraping Barchart.com

Actually, Barchart is giving away data for free if you sign up for their free API,
http://www.barchartondemand.com/free

There are a limited amount of daily queries but it will do the job for most things for me. The only bad news is that they don't have data for ICE products. I will still have to scrape that.

I want to thank someone who messaged me on how to scrape with the new URI structure as well as how to receive the data via JSON. I won't name the person since they do not have a single public post. Thanks, I owe you one.
 
MoneyMatthew said:
I wrote some software myself to data scrape intraday data from barchart.com. On November 1st data will no longer be contained in the html. There is a totally new build of the site coming soon.

I wrote a program to scrape the new site but it is slow as hell and crude to say the least. I guess I should just be happy that I have a solution.

I was wondering if anyone could tell me a better way to scrape https://beta.barchart.com ????

All of my methods were proprietary, I have no knowledge of the more mainstream ways to data scrape with Beautiful Soup, Selenium,Mapit.PY ect..ect..

I am just curious if any of you wizards out there can pull data from it? Thanks.
More...
 

upload_2016-11-25_13-23-30.png
 
You must log in or register to reply here.
Back
Top