I've got to do a little project where I need to parse about 11 billion line items in a text file and do some analysis with a few SQL queries where I populate a table with the final results. The total size of the text file is about 950 gig so a few terabytes should do me as the text file can go away once I'm done.
I can safely run about 10k queries per second on one machine so sure I can get a few machines to do this everyday but I'm wondering if any one here has used SAN Array and MySQL and how was the performance? Thanks.
JAG