my data's stored in flat files (csv) indexed sensible for fast(ish) reads. my analysis is done with python, kicking out data parameters for use daily with excel. in excel, i run on tick events, have watch "it" run tens of millions of times a trading session, but governed down to 10-20k runs...