April 14, 2008

Cross-generational Windows/Office preformance: About OfficeBench

Designed from the beginning to be a "run anywhere" benchmark, OfficeBench uses OLE automation and a variety of Office tasks to assess system performance

I created the OfficeBench test script back in 1999/2000 while my company, Competitive Systems Analysis (CSA), was under contract to Intel's Desktop Architecture Labs (DAL). CSA was responsible for a great deal of internal benchmarking and white paper development surrounding the Pentium III and Pentium 4 CPU launches.

OfficeBench was designed from the beginning to be a "run anywhere" benchmark. By "run anywhere" I mean that the script will execute reliably under almost any Windows runtime environment. At the time it was being developed, this meant Windows 2000 and Terminal Server. As Windows evolved, so did OfficeBench. Today it supports every version of Windows since 2000, including XP, Vista, Server 2003, Server 2008, all flavors of Terminal Server, and all known application and desktop virtualization environments.

OfficeBench is also version independent. That is, it's designed to work with any version of Microsoft Office. When it was originally conceived, the state of the art was Office 2000. Since then, Microsoft has rolled out three additional versions: XP, 2003, and, most recently, 2007. OfficeBench runs unmodified across all four versions. Combined with the support for the various Windows platform releases, OfficeBench is the only test script of its kind that allows you to compare performance across multiple generations of Windows and Office.

OfficeBench uses OLE automation to drive the applications. This is different from most test scripts, which use window messages or keystroke and mouse click simulation. Using OLE automation has numerous benefits, including allowing test scripts to run unmodified across the four Office versions. It also factors out any input-related anomalies while eliminating the chance that a UI change or third party modification will somehow break the script.

Key OfficeBench tasks include the following:

  • Reformat all section headers and subheads in Word. 
  • Generate multiple chart objects in Excel. 
  • Generate complete multi-slide presentation in PowerPoint. 
  • Multi-page scroll w/copy paste of chart objects into Word. 
  • Slide sort/apply multiple templates in PowerPoint. 
  • Multi-page scroll/print preview/print-to-file in Word. 
  • Multi-chart print preview/print-to-file in Excel 
  • Global search/replace in word (multiple). 
  • Multi-slide preview/print-to-file in PowerPoint. 
  • Navigate simulated research Web site in IE (multiple).

The above are just some highlights. There's a lot more going on than meets the eye, and the key is that it's the exact same set of tasks executing across all versions of Office.

additional resources
White Paper - How to Improve Delivery of Advanced Web Applications

White Paper

Virtual Workforce: The Key to Expanding The Business While Cutting Costs

Get the independent advice and expertise you need to support a virtual workforce.

Go inside:
The three-step approach to making a virtual workforce a reality.
The four flavors of client virtualization technologies.
The three key initiatives that solve IT challenges.
Download now »
White Paper: Successfully Secure Your Wireless LAN With Wi-Fi firewalls.

White Paper

Addressing Linux Threats Leveraging Fewer Resources

The increase in Linux popularity has increased the frequency and sophistication of malware attacks. Read this 2 page white paper now to learn how you can protect your Linux environment with real-time protection that is certified by all major Linux vendors.

Download now »
White Paper - The 2009 Handbook of Application Delivery

White Paper

The 2009 Handbook of Application Delivery

Ensuring acceptable application delivery will become even more difficult over the next few years. As a result, IT organizations need to ensure that the approach that they take to resolving the current application delivery challenges can scale to support the emerging challenges. This handbook elaborates on the key tasks associated with planning, optimization, management and control and provides decision criteria to help IT organizations choose appropriate solutions.

Download now »
White Paper - Is Your Backup System Outdated?

White Paper

Mid-range Storage Considerations

A common misconception is that mid-range storage requirements are dramatically different than that of a larger enterprise. Mid-range storage users may require less capacity, but they have similar functionality and management requirements. This ESG paper examines mid-range storage needs and reviews a new solution that adjusts size while retaining value, performance and functionality.

Download now »
Dan Aquinas 2-Jul-09 8:33am
So would OfficeBench do enough "real world" work such that it would be a good test to prove (or at least provide some insight as to ) whether certain performance claims by disk optimization software are worth the price one would pay for the product?

Sign up to receive InfoWorld Resource Alerts

Subscribe to the Today's Headlines: First Look Newsletter

Find out what will be news for the day, with our first-thing-in-the-morning briefing.

©1994-2010 Infoworld, Inc.