News scraper?

[SweetMoney]

What are you going to do that I cannot already do with Inoreader, which is a great RSS-reader, news-letter reader, twitter-filter ++ ?

If I follow your logic then I don't need any newspapers because of inoreader.

First not all news sources have RSS.
Second, many rss don't update very quickly. By the time you read your RSS I have opened and closed positions. When you are just entering.

Third, can you filter by topic, stock symbol, entities extracted by AI?

Forth, everything is organized in one place. You control the markets OPINION, not trading with news which usually out late.

Fifth, will it provide an API so you can seamlessly integrate the JSON feed from my system into your inhouse analytics?

Many more.

I appreciate your response.

 

[SweetMoney]

So in prop setting, they can subscribe to all the news feeds and distribute it to all their traders for no or minimal fee. If I subscribe to your service, do I need to subscribe to all these news/letters?

99% of sources are open. Only a few like dealreporter and wsj are closed by subscription. Even this can be negotiable with them once I sign an agreement.

 

[ZBZB]

99% of sources are open. Only a few like dealreporter and wsj are closed by subscription. Even this can be negotiable with them once I sign an agreement.

Ask @Robert Morse on this site about his friends news feed. I cannot remember what it is called but it is similar to what you are describing.

 

[SweetMoney]

Ask @robert on this site about his friends news feed. I cannot remember what it is called but it is similar to what you are describing.

Thank you very much

 

[Bad_Badness]

Hey buddy thanks for your answer. What kind of software engineering you've done? What tech stack ?

Ancient stuff. Adobe Illustrator 1.0, Photoshop 1.0, Windows 3.1. Word for Windows 2.0 Last project was what became MSFT's web server. I was a Test Manager, so I designed stuff that was robust and worked in all expected conditions.

Funny story, I have a friend who, might be able to claim to have visited every site on the internet, AT THE TIME. Of course, impossible now. He did it when there were 255 sites!

PM me if you want to chat directly.

 

[Bad_Badness]

Thank you very much for such great answers! They are all very valuable to me.

I'll try to explain more what I meant.

From my experience working with professional traders they read tons of news articles, experts etc,, so they can infer their conclusions. One good case from top of my head was Muddy Waters report. So I was a witness for many traders who were short Luckin coffee hours or days before news became headlines.

There are a few hundred sources like that Citron, DealReporter, Nikkei, wsj, business insider, Barron's, FT etc.

So my value would be to deliver in almost real time analytical pieces about your interests.

Let's say you have interest in oil or gas:
1. You would create a topic of interest, then for that topic enter keywords, entity names or stock symbols.
2. System is scanning all really important sources and gives you information about articles it found in near real-time.
3. You read/skim articles and then make decisions should you continue holding that position or not.

Basically it saves you ton of time. You don't have to switch back and forth between CNBC, wsj, nyt, Bloomberg, Twitter etc. You have everything in front of you. You know what's going on with your underlying companies/markets. You know what real market movers say. Basically it does for you the same stuff you do now. but now you do it manually, unsystematically and probably with confirmation bias.

I know it's needed because I was previously an author of such systems in very top prop trading firms in NYC.

But again I am just asking your fair opinion here.

Thank you very much again

An aggregator. It is almost as if a UI element could be a slider that immediately, widens or narrows the results. Of course that "slider" could do a ton of smart things. I do like those multidimensional spider web style search UIs, but they need to be less "down the worm hole" in their usage.

 

[SweetMoney]

An aggregator. It is almost as if a UI element could be a slider that immediately, widens or narrows the results. Of course that "slider" could do a ton of smart things. I do like those multidimensional spider web style search UIs, but they need to be less "down the worm hole" in their usage.

It can be a slider or a popup window for particular topic. With time you just see what topic's window popping up so you know intuitively that something is going on with that group of interest.
Again, I am basing it on my experience working with professional traders. They all have Bloomberg/Thomson on their desktops.

P.s. not just an aggregator. The system will be almost real-time (I have my prop tech to have max delay of 5 seconds). Moreover many websites use CDNs and sometimes you can actually see news shown in my software BEFORE it appears on the website of the source. It's not a lie or my fantasy. It's truth that depending on your location on the planet you have different cdn nodes which are Not updated at the same time. Because their purpose is not to be real-time. The same story with RSS feeds...

 

[SweetMoney]

Ancient stuff. Adobe Illustrator 1.0, Photoshop 1.0, Windows 3.1. Word for Windows 2.0 Last project was what became MSFT's web server. I was a Test Manager, so I designed stuff that was robust and worked in all expected conditions.

Funny story, I have a friend who, might be able to claim to have visited every site on the internet, AT THE TIME. Of course, impossible now. He did it when there were 255 sites!

PM me if you want to chat directly.

It's a pretty amazing story about your friend.

I'm always open to new connections and friends so definitely will PM you!)))

 

[Bad_Badness]

It can be a slider or a popup window for particular topic. With time you just see what topic's window popping up so you know intuitively that something is going on with that group of interest.
Again, I am basing it on my experience working with professional traders. They all have Bloomberg/Thomson on their desktops.

P.s. not just an aggregator. The system will be almost real-time (I have my prop tech to have max delay of 5 seconds). Moreover many websites use CDNs and sometimes you can actually see news shown in my software BEFORE it appears on the website of the source. It's not a lie or my fantasy. It's truth that depending on your location on the planet you have different cdn nodes which are Not updated at the same time. Because their purpose is not to be real-time. The same story with RSS feeds...

Very cool about the CDNs. Critical piece.

 

[SweetMoney]

Very cool about the CDNs. Critical piece.

Because I have done that for props. Unfortunately I can't name them but it was not my idea. I was an architect and developer. It's still being used.

What I want to do is to implement a new version which can be used by internet users not only insiders at prop trading firms with deep pockets. Also all code will be cloud based and distributed.

I'm looking for criticism and guidance from you guys. Because if I can prove to myself that it is really needed by retail traders I'll make it happen.