I have Comcast cable internet, a linksys wireless-g router, and four computers all connected. You don't need any extra IP addresses. In fact, you may never even need to know the first IP address they assign you.
If you get a router, you should set up the router for DHCP (and assign fixed...