Oh, okay yeah you can use a hub if you purchased multiple IP addresses from your ISP (hehe it's been a while since I've encountered someoen that did that however so it escaped my mind). So yes, if you have multiple IP addresses, then yah a hub or switch will work. However, I still recommend using a router, since the price differential is minimal (if at all).
The difference between a switch and a hub is that a switch is capable of handling multiple communications between the computers, whereas a hub can only handle one packet at any given time. Like i said, its hard to tell the difference, but there is a slight performance hit. A router is specifically designed to function as a bridge between the internet and a LAN (which is your lil home network). You do not need multiple IP addresses with a router (the fact that you have them is no problem, and with some programs that absolutely demand a sole IP address I guess that its a bonus, however I can think of very few circumstances where that will be a significant advantage, as most new routers can handle VPNs and anyhting else. on top of that, routers come equipped with security stuff like firewalls and the like that help protect ur network.
But if you want a switch then that should work, a hub will work but i really would not recommend using a hub, and a router will work also. The price differnces between all three is small however.