The good and bad of storage benchmarking


Become An Insider

Sign up now and get free access to hundreds of Insider articles, guides, reviews, interviews, blogs, and other premium content from the best tech brands on the Internet: CIO, CSO, Computerworld, InfoWorld, IT World and Network World Learn more.

SPC-1 and SPC-2 benchmarks are often quoted in press releases, but what good are they in real life?

In my post last week, I talked about new record-breaking SPC-1 performance benchmark results for TMS's new RamSan-630. Judging by the email response, that lead many of you to wonder exactly what the Storage Performance Council is and what makes those results any more interesting than other third-party storage benchmarks.

In a field as complex as enterprise storage, building testing mechanisms that accurately reflect real life and provide any real value to end-users is fantastically difficult. With such an incredibly wide range of enterprise storage workloads and products, it's impossible to build a benchmark that has any hope of resembling all of them.

That said, the testing mechanisms used by the SPC are among the best -- not only due to the thoroughness of the tests themselves, but because the documentation and auditing required to submit a public result is quite elaborate. In fact, the documentation is often more interesting to a prospective storage buyer than the performance results themselves.

Who is the SPC?

You're viewing Insider content

You Might Like
Join the discussion
Be the first to comment on this article. Our Commenting Policies