Added four 10KRPM Western Digital 150GB RAPTOR SATA drives to the DFI motherboard machine that I built on the post right above this one. Using RAID 0+1.
This machine is a research machine for both computation on GPUs, and now as a test machine for SATA RAID arrays for the hosting of real-time tickbase datastore. Currently just using flat file to capture real-time tick data, but time-enabling, I hope to test several "database" systems for the performance and expressive power in real-time, of financial time-series acquisition and query. This includes using binary flat file, MySQL, MSFT SQL Server in-memory, Oracle 10G in-memory (TimesTen), SQL Lite + MySQL used together, and HDF5. All of these systems have a download trial, and some are open source.
I have written a simulator that continuously multicasts prices on my network for hundreds of instruments (ES, NQ equities, etc) at a very high rate - difference in price updates less than 10 milliseconds. That is on the order of 100 messages per second per asset. These should model extremely busy markets. Should be interesting to see which databases keeps up...
BTW, I found the following software really useful for benchmarking the whole
I/O hardware subsystem:
http://www.iometer.org/
Highly recommended.
The 10K RAPTOR drives are blaaazingly fast...
nitro