I presume you have an ADSL modem/router. See if you can ping it from any of the connected PCs. If you can the router bit at least should be OK. If you can't, connect your PCs via a switch if you have one, or x-over cable if you have one. If they can all ping each other, everything should be OK...