Does your big download slow down too?
If so, you're probably getting throttled.
If not, your big download is probably choking out the other computers' bandwidth.
Getting a router with QoS would help.
I doubt your ISP is dumb enough to allocate bandwidth per IP, but you can always try...