Latency- it can be in a number of places. When you are saying these brokers can be better are you referring to quotes or orders. Any good broker can give you multiple options to decrease the latency. If it is quotes are you referring to NYSE, INET, ARCA, BRUT- all should have different latencies, and if your broker isn't sourcing the quotes directly that could be part of the problem.
-m