I know this thread has been talking silver, but if you're looking to actually own the physical, not paper, I'd assume you'd also be looking at gold as well.
If so, have you looked into BullionVault? It's a pretty interesting concept and the overhead costs of ownership they offer seems pretty...