Super fast trading - all automatic

Quote from nitro:

You were doing great until you said this. _No_one_, not one person that I know that would be willing to back a system, would allow such a thing to run anywhere but within the confines of their office walls with a human being sitting in front of the machine monitoring it carefully and all supporting systems. They have contigencies for and rules of when to disengage the automated software and take over.
You sound fearful of new technology, like those who were once afraid of mechanical/programmed trading, or trading over the internet. Technology makes new things possible and reliable all the time. My original point was merely that colocation can supplement or replace the need for a PTP T1 for the purpose of receiving data, analysis and issuing orders. It’s great that you have such high standards for quality and reliability. Lets hope it doesn’t impede development of novel system ideas because you make things out to be too expensive, and not scalable or clean enough for your tastes.
Further, what is the love affair you have with colocation, no less with a colocation that has 60ms of latency? LOL!
I still don’t understand why you search for ways to blow stuff out of proportion. The collocation and latency issues are unrelated. So what if MY colocation has a high latency? Only latency jitter affects my systems… and this is well under control. For systems that need lower overall latencies, there are better server farms, some much closer to the exchanges or data providers. My network reliability is excellent. And that’s between IB’s servers and a server farm in San Antonio TX!
Players that are in this game give about as much thought to spending $1500/M on a PTP T1 connection to their broker/exchange as to when to get their next haircut. It simply is not an issue. Further, I have tried repeatedly to make you understand that the colocation solution, for the kind of trading that is being discussed, will almost certainly _wont_cut_it_ for reasons now given about five times. But you keep trying to bring in about how it works with your ten roundtrips a day to IB and I keep saying that yes there it doesn't matter and then you bring it up here yet again.
If my talk about colocation offends you so much, then don’t reply. I find it more offensive that you keep bringing up my 10 trade/day or 60ms latency figures, or “big players won’t do this” as if these are reasons why collocation won’t work for the task described. Again you insult our intelligence by (1) arguing that only big players with deep pockets can afford the connectivity to develop ultra-fast systems, (2) not following a logical argument, (3) assuming I’m ignorant about everything, and (4) using heavily condescending language like “make you understand”. All I’m saying is that collocation is a LOW COST tool for distributed acquisition and processing of high frequency data. It’s an entry-level solution for those that can’t afford PTP T1s, or who want to supplement their PTP connections. How many times do I have to repeat myself for you to see the point?
Well, I value your experience, I even congratulated you on it. But if you had said, "I know that this post does not relate to high frequency systems" instead of trying to "defend" the colocation idea and remotely monitoring a system on a cable connection that takes 1000+ rountrips a day, or even your ten roundtrips, I just do not know what to think. .

There you go again mincing separate issues. I was arguing for collocation and talking about the reliability and speed of MS Remote Desktop over unreliable networks. I never said that unreliable networks were adequate for monitoring systems, even though it is tolerable in my situation. You took two things I said and twisted them to use against me. My systems operate at low frequency, 1 to 10 trades/day, 30 minute to 8 hour long positions, trading constant size fully mechanically with no variable sizes. Provided appropriate leverage, stop losses aren’t necessary. In fact they hurt performance because most strong moves against the systems are highly mean reverting. Of course, OTM straddles are always sound insurance for major unpredictable events. Basically, I do not need second-by-second monitoring. Comcast had a few outages last week because they were upgrading some equipment. My 56K dialup backup was more than enough to monitor my systems. Comcast is now reliable again.
I understood this the _first_ time. It is you who have not heeded my warning. _ONE_DAY_, you are going to regret this setup. The fault tolerance of any engineered systems is as strong as it's weakest link.
Redundancy mitigates the engineering concerns. The main risks are operator induced, say if I were to over leverage the systems and end up on the wrong side of a 9/11 magnitude move without a hedge.
I never got that idea? Where do I say that you enter trades by hand?
On page 8 of this thread. You characterize my idea as using manual executions when I never said that. Maybe you were just being sarcastic.
You may go years without a hitch, and one day, a fat finger event sends the ES or NQ or whatever you are trading spiraling 40 handles in five minutes and God help you that your program has taken _ALL_POSSIBLE_CONTIGENCIES_ at boundary conditions into account, or that this kind of event does not expose a bug in your program, or perhaps expose a bug in your datafeeds programs that cause data to lag, or on and on. But it is not for the reasons that I can think of that your setup scares me, it scares me for the things that may come up that I _cannot_ think of.
I appreciate your concern. My systems monitor data integrity and take the appropriate actions if a data feed is lost, gaps or if the feed acts unusual.
Add to any of those unfortunate events a network glitch on your end at the same time, causing your "monitoring" connection to go down, and in 30 seconds, if you have any kind of a position on, could cause you to wipe out your entire account, or more.
Have _you_ ever tested yourself in a situation where you are losing $10,000 every ten seconds….
It depends on account size and leverage. To be as fearful as you appear suggests you are using a great deal of leverage and require ultra reliable executions. You have a right to trade dangerously. However, you can’t legitimately characterize my systems as dangerous when you know nothing about them.

For clarification, I agree a 1000 trade/day system is potentially dangerous and needs ultra reliable executions, redundant feeds and networks. However, in your last post you were clearly saying MY system setup is dangerous. Lets keep these issues separate.
I am not trying to be condenscending. It seems that what I say goes "in one ear and out the other," so I try to say things in a different way each time hoping each time that a light will go on.
But you are condescending all the time. You seem to assume I don’t understand technical and market risks.
 
Quote from prophet:

You sound fearful of new technology, like those who were once afraid of mechanical/programmed trading, or trading over the internet. Technology makes new things possible and reliable all the time.
Pffffffffffffffft. If you only knew... :D

My original point was merely that colocation can supplement or replace the need for a PTP T1 for the purpose of receiving data, analysis and issuing orders.
Now your point is that it can supplement? Well, I may grant you that, but replace? No it can't - not today...

It’s great that you have such high standards for quality and reliability. Lets hope it doesn’t impede development of novel system ideas because you make things out to be too expensive, and not scalable or clean enough for your tastes.
No problem there...Again, if you only knew :D

I still don’t understand why you search for ways to blow stuff out of proportion. The collocation and latency issues are unrelated.
They are? Explain that one to me?

So what if MY colocation has a high latency?
I just thought you said they weren't related? Make up your mind :eek:

Only latency jitter affects my systems… and this is well under control. For systems that need lower overall latencies, there are better server farms, some much closer to the exchanges or data providers. My network reliability is excellent. And that’s between IB’s servers and a server farm in San Antonio TX!
If you say so...

If my talk about colocation offends you so much, then don’t reply. I find it more offensive that you keep bringing up my 10 trade/day or 60ms latency figures, or “big players won’t do this” as if these are reasons why collocation won’t work for the task described. Again you insult our intelligence by (1) arguing that only big players with deep pockets can afford the connectivity to develop ultra-fast systems, (2) not following a logical argument, (3) assuming I’m ignorant about everything, and (4) using heavily condescending language like “make you understand”.
I agree with everything you said! Oops, I said all those things. Ugh, back to square one with you.

BTW, who is "our"? You don't have like 50 handles on ET and have multiple personalities by any chance do you?

All I’m saying is that collocation is a LOW COST tool for distributed acquisition and processing of high frequency data. It’s an entry-level solution for those that can’t afford PTP T1s, or who want to supplement their PTP connections. How many times do I have to repeat myself for you to see the point?
You don't know what you are talking about, but look, you seem really intent on convincing me that you know what you are talking about, when I know for a fact that you don't. So stop trying.

There you go again mincing separate issues. I was arguing for collocation and talking about the reliability and speed of MS Remote Desktop over unreliable networks. I never said that unreliable networks were adequate for monitoring systems, even though it is tolerable in my situation. You took two things I said and twisted them to use against me.
Uuuuuuhhhm, I am "using things against you" :confused: :eek: See the last line of this post.

My systems operate at low frequency, 1 to 10 trades/day, 30 minute to 8 hour long positions, trading constant size fully mechanically with no variable sizes. Provided appropriate leverage, stop losses aren’t necessary. In fact they hurt performance because most strong moves against the systems are highly mean reverting. Of course, OTM straddles are always sound insurance for major unpredictable events. Basically, I do not need second-by-second monitoring. Comcast had a few outages last week because they were upgrading some equipment. My 56K dialup backup was more than enough to monitor my systems. Comcast is now reliable again.
Uh, I don't care?

Redundancy mitigates the engineering concerns. The main risks are operator induced, say if I were to over leverage the systems and end up on the wrong side of a 9/11 magnitude move without a hedge.
LOL. How would there be more "operator" induced if you had the computer systems in house automatically trading as opposed to at some remote location trading? This is getting funny.

On page 8 of this thread. You characterize my idea as using manual executions when I never said that. Maybe you were just being sarcastic.
Whoops - I see it. My bad. Doesn't change the issues...

I appreciate your concern. My systems monitor data integrity and take the appropriate actions if a data feed is lost, gaps or if the feed acts unusual.
I doubt it. Again, it is what may happen that you have not thought of of that is scarry...

It depends on account size and leverage. To be as fearful as you appear suggests you are using a great deal of leverage and require ultra reliable executions. You have a right to trade dangerously. However, you can’t legitimately characterize my systems as dangerous when you know nothing about them.
I need to know nothing of your systems. If you are running this at a colocated farm using IB as your datafeed, that is enough to know that you are either trading peanuts, ergo your misplaced courage, or the reason for the colocation is misplaced in the first place.

For clarification, I agree a 1000 trade/day system is potentially dangerous and needs ultra reliable executions, redundant feeds and networks.
If you had started that way, this would have been all academic.

However, in your last post you were clearly saying MY system setup is dangerous. Lets keep these issues separate.
I do not belive they are seperate, why should I keep them seperate? There is nothing that _you_ are doing at a colocation using IB that I could not do at home from a business quality DSL line. The colocation adds nothing to the mix. If you need fast systems, then going to a colocation site that has 60ms of latency is a joke. If you don't need fast executions, then why go to a colocated farm?

But you are condescending all the time. You seem to assume I don’t understand technical and market risks.
I am nearly 100% sure that you do not. Most likely, you read a couple of books at Borders and now consider yourself an expert on high risk, hard Realtime systems. Go and work as a CCNA at a job for a year, then go and work for a hedge fund for another as a programmer, and then come back and see if your point of view changes. Maybe go to a local nuclear reactor site and see if they want to colocate their systems that monitor the reactor...

The "condescending" part that you keep accusing me of is something you need to work out with your therapist. Probably father/son issues...

nitro
 
Quote from nitro:

There is nothing that you are doing at a colocation that I could not do at home from a DSL line. The colocation adds nothing to the mix. If you need fast systems, then going to a colocation site that has 60ms of latency is a joke. If you don't need fast executions, then why go to a colocated farm?

I am considering a colocated farm because I would expect it to have a better internet connection than my office DSL line. Don't you think the internet uptime would be an advantage of a colocated farm versus DSL?

My DSL goes down on occasion. It's not a problem for manual trading, but if my future automated system is unable to use a dialup backup or phone the broker, it would be a problem.
 
Aaron,

Don't do it. Contact me offline if you want my input...

nitro
Quote from Aaron:

I am considering a colocated farm because I would expect it to have a better internet connection than my office DSL line. Don't you think the internet uptime would be an advantage of a colocated farm versus DSL?

My DSL goes down on occasion. It's not a problem for manual trading, but if my future automated system is unable to use a dialup backup or phone the broker, it would be a problem.
 
Quote from nitro:

Aaron,

Don't do it. Contact me offline if you want my input...

nitro

Thanks, Nitro. Your PM mailbox is full and you don't have emailing enabled. Here's what I wrote to you, please PM or email me...

Hi Nitro,

Yes, I'd like to get your input. Thanks for offering.

In automating my trading, a big risk that I'd like to minimize is that my internet connection (Earthlink DSL) goes down. I am considering a server farm to reduce the internet connection worries. What would you recommend?
 
Quote from nitro:
Pffffffffffffffft. If you only knew... :D
Well, first you are critical about a technological tool …
Now your point is that it can supplement? Well, I may grant you that, but replace? No it can't - not today...
…then you admit it is useful, albeit only as a supplemental technology. Which is it? Useful or not?
They are? Explain that one to me?
Why does my 66ms latency generalize to mean that ALL colocation is inadequate? It’s easy to find colos with 30ms. Why is 30ms round trip delay detrimental to ultra fast systems? You never answer these question with any technical arguments.
I just thought you said they weren't related? Make up your mind :eek:
They aren’t related. Somehow you still refuse to explain why they are.
BTW, who is "our"? You don't have like 50 handles on ET and have multiple personalities by any chance do you?
Other readers on ET.
You don't know what you are talking about, but look, you seem really intent on convincing me that you know what you are talking about, when I know for a fact that you don't. So stop trying.
I don’t want to convince you of anything. I’m just defending the things I’ve said, against your deliberate distortions.
LOL. How would there be more "operator" induced if you had the computer systems in house automatically trading as opposed to at some remote location trading? This is getting funny.
It is irrelevant where the systems operate. The concern is the “operator” using safe leverage, hedging, and using simple coding safeguards to avoid mechanical overtrading or over leveraging. Losses are therefore controlled even if the systems, broker or exchange crash, of if there is another terrorist attack.
I doubt it. Again, it is what may happen that you have not thought of of that is scarry...
I’ve detailed most of my safeguards. If you’re so much smarter in these regards as you claim to be, then tell me specifically what I’ve missed.
I need to know nothing of your systems. If you are running this at a colocated farm, that is enough to know that you are either trading peanuts, or the reason for the colocation is misplaced in the first place.
Again you claim to know everything but won’t give specific reasons why this won’t work. If you do reply to this challenge, please don’t ignore the following safeguards and aspects regarding my systems, including:

6 non correlated, similar performing systems
0.5 to 8 hour intraday position lengths
low slippage
multiple server site redundancy
multiple feed redundancy
data integrity monitoring
overtrading limits
fixed position size
full hedging with OTM straddles
composite historical max drawdown set at 6% of capital.
I do not belive they are seperate, why should I keep them seperate? There is nothing that you are doing at a colocation that I could not do at home from a DSL line. The colocation adds nothing to the mix. If you need fast systems, then going to a colocation site that has 60ms of latency is a joke. If you don't need fast executions, then why go to a colocated farm?
There is a huge difference. You obviously don’t understand quality of service for TCP/IP networks. Average latency says very little about connection reliability, especially for server farms with redundant routes. Try comparing packet statistics between a collocated server on 100 Mbit/sec ethernet to DSL/cable.

I don’t need fast executions. I use a collocated server to obtain high quality data. As I’ve said, I have compared it to data collected on lower latency networks and found no major differences.
I am nearly 100% sure that you do not.
Such blanket statements suggest you have a paranoia that you are wrong and someone else is right. Why don’t you try arguing your points in an academic way?
The "condescending" part that you keep accusing me of is something you need to work out with your therapist. Probably father/son issues...
Just come to an academic level for once.
 
Oy vey,

Round and around we go. You are still trying to get my approval. I don't think you know what you are talking about, no matter how much you cry and I don't have time to educate you, certainly not for free.

But keep advertising yourself, maybe you'll find some sucker on ET.

nitro
Quote from prophet:

Well, first you are critical about a technological tool …

…then you admit it is useful, albeit only as a supplemental technology. Which is it? Useful or not?

Why does my 66ms latency generalize to mean that ALL colocation is inadequate? It’s easy to find colos with 30ms. Why is 30ms round trip delay detrimental to ultra fast systems? You never answer these question with any technical arguments.

They aren’t related. Somehow you still refuse to explain why they are.

Other readers on ET.

I don’t want to convince you of anything. I’m just defending the things I’ve said, against your deliberate distortions.

It is irrelevant where the systems operate. The concern is the “operator” using safe leverage, hedging, and using simple coding safeguards to avoid mechanical overtrading or over leveraging. Losses are therefore controlled even if the systems, broker or exchange crash, of if there is another terrorist attack.

I’ve detailed most of my safeguards. If you’re so much smarter in these regards as you claim to be, then tell me specifically what I’ve missed.

Again you claim to know everything but won’t give specific reasons why this won’t work. If you do reply to this challenge, please don’t ignore the following safeguards and aspects regarding my systems, including:

6 non correlated, similar performing systems
0.5 to 8 hour intraday position lengths
low slippage
multiple server site redundancy
multiple feed redundancy
data integrity monitoring
overtrading limits
fixed position size
full hedging with OTM straddles
composite historical max drawdown set at 6% of capital.

There is a huge difference. You obviously don’t understand quality of service for TCP/IP networks. Average latency says very little about connection reliability, especially for server farms with redundant routes. Try comparing packet statistics between a collocated server on 100 Mbit/sec ethernet to DSL/cable.

I don’t need fast executions. I use a collocated server to obtain high quality data. As I’ve said, I have compared it to data collected on lower latency networks and found no major differences.

Such blanket statements suggest you have a paranoia that you are wrong and someone else is right. Why don’t you try arguing your points in an academic way?

Just come to an academic level for once.
 
Hi guys:
Attached is the block diagram of the Robotic system that we are running in our office. It might answer some of your questions. Each robot executes around 2,500 trades a day.
Cheers,
 

Attachments

Nitro,

I don’t want your approval in the slightest. I’m just defending my statements against your distortions and unprofessional remarks... nothing more.

If you want, we can drop this.
 
Back
Top