The IB API isn't providing anywhere near under 1 ms trade executions for me and I have almost the identical setup as you (polygon, IB, Java, Linux, 1 Gbps). You can try directed orders as opposed to SMART routed orders and you would think orders sent straight to NASDAQ would execute faster but...