Guys, NxCore is not a multicast. I'm looking to build a raw feed handler.
anybody know how to write a feed handler?
- Thread starter fareastcoast
- Start date
Just to understand what you need for feed handler to work, read UTP data feed spec (and similar feed specs)
http://www.nasdaqtrader.com/content/technicalsupport/specifications/utp/utdfspecification.pdf
Generate fake data from those specs in your data producer code multicast it and consume data in your feed handler code, that's it.
Good luck
http://www.nasdaqtrader.com/content/technicalsupport/specifications/utp/utdfspecification.pdf
Generate fake data from those specs in your data producer code multicast it and consume data in your feed handler code, that's it.
Good luck
Actually it is. NxCore supports multicast distribution.
It still is not what you likely want. That said - think what you really want.
* If you colocate at the exchange and do NOT get into the game of direct feed you are fater than 99.9% of the people. Get a decent high performance profiver, done.
* If you try to win the speed race, this is NOT about "writing a feedhandler" as in programming. Seen some HFT project let me tell you - software losses. The game now is FPGA for decoding. Hardware. Latency is not measured in 0.x miliseconds - more 0.050.
So, this is not necessarily "next level", it is a totally different ball game. Be prepared to spend a lot more.
Or just try to stay smart, not fast (most HFT work on speed alone) and if you manage to avoid the HFT rat race, then colocating and a decent provider will be good enough.
Btw., NxCore is good to test this stuff - they hit you with a lot of symbols. I get the whole CME from them, and that are about a quarter million symbols.
Basically, I want to receive the CTS/CQS/UTP multicast from the exchanges. To do that, I need to develop a feed handler to handle that type of data stream. But it costs $6k/month to get access to that multicast. So instead of spending $6/month while I am developing, I would like to simulate that stream, for instance, using a past day's tape, to develop my feed handler. I'm wondering if NYSE/Nasdaq provides a service like this and whether anybody on here is sophisticated enough to know about it.
So yes, it is possible to generate fake data, and then receive it. We already have a setup that does that. However, I want something more realistic to test on, not some contrived setup. Only by getting an actual sample from the exchange can I really ensure that we have correctly taken into account all message types and possible exceptions.
Have a buddy use wireshark to capture the packets [for a day]. Then replay it in your own network. A little clumsy but would work.
http://wiki.wireshark.org/CaptureSetup/Ethernet
nitro is right, network friends could help, just be prepared to change your feed handler based on exchange message changes (announced in advance and tested before changes pushed to prod) as well as to handle a back up line if primary is down, there are not too many app teams out there who can do it right (with hundred of thousands of messages per sec like OPRA and low latency), be prepared to handle slow consumers of data (algo code) flowing from your feed handler, have fun...
Ah, this is a great suggestion, this is exactly the sort of thing I am looking for. So I can be in the production environment for a little bit, capture packets for a day, and then use the replay for development.
I think I will start down this route first, just have to find somebody who's willing to help capture packets for me.