I am incorporating news into my Rust based bot, and to source articles I scrape once per second the "latest news" page of several news providers (eg GlobeNewsWire). Despite expecting minimal (<1min) delay, I've found that articles are consistently arriving around 300 seconds late compared to their official publication times. I've confirmed that it's not an implementation issue by manually recreating the delay--if you sit there refreshing the page, articles still show up late.
I was wondering why this happens and if there are workarounds. I've tried financial news APIs, but they all seem to focus on general market or large company news, whereas I need press releases distributed by small/mid cap companies.
I was wondering why this happens and if there are workarounds. I've tried financial news APIs, but they all seem to focus on general market or large company news, whereas I need press releases distributed by small/mid cap companies.