Depending on which video card it is, it may have audio codec's on it as well (for MPEG for instance). Try to see if there is any audio on your video card you can disable. Alternatively, if there is a good Audio codec on your video card, you may be able to eliminate your sound card.
finally...