Free Newsletters
Technology & Business Daily

InfoWorld
Log-in | Register

Prep your Web apps for stellar performances

Load testers prove a valuable part of your development strategy

By Maggie Biggs
November 21, 2005
 

High-performance Web sites and apps don't happen accidentally. A detailed performance and scalability testing strategy is needed throughout the development lifecycle -- and that requires a good load-testing solution.

Free IT resource

Open Source Business Conference (OSBC) May 22-23, 2007

Sponsored by OSBC

Free IT resource

Virtualization Insights from Top Experts - Learn how virtualization gets real!

Sponsored by Dell

The rewards are clear: Strong, ongoing emphasis on performance testing can keep budgets in check and reduce production issues. With the plethora of performance and scalability tools available today, however, choosing the right one for your shop can prove challenging.

I recently examined three Web load-testing solutions: OpenSTA 1.4.3, Ingenieurbüro David Fischer's Proxy Sniffer Professional Edition 3.7, and Minq's PureLoad Enterprise Edition 3.3.1. The three solutions represent the low-, middle-, and higher-end price points of the load-testing tools market; and for basic HTTP and HTTPS testing, any of these three solutions more than meets the need. The way each solution is implemented differs, however, as does the functionality they offer.

OpenSTA 1.4.3

OpenSTA is an open source Web load-testing tool that's easy to install and use. Setting up baseline and scalability types of load tests using either a single or multiple machines is a snap. Platform support, however, is surprisingly limited to Windows only.

Nonetheless, after registering all of my test machines with an OpenSTA repository on a central machine, I was executing distributed load tests in no time. Heavy OpenSTA load tests may also require developers to adjust the maximum number of sockets on each load client to reduce the occurrence of socket errors.

Script creation, execution, and analysis are all accessible via OpenSTA's Commander interface, which is a native Windows application. After creating a new script definition and clicking on it, the OpenSTA Script Modeler opened. The Script Modeler has three panes: one for script creation; a diagnostic window for script compilation and playback; and a third view that allows developers to see the HTML, site structure, and header information.

OpenSTA scripts are written using SCL (Script Control Language) -- a built-in compiled scripting language that has influences from Fortran and Digital's Digital Command Language. Reference documentation is provided to get developers going. Developers also might find it easy to learn SCL by first using the built-in capture facility.

After capturing interactive browser sessions with several test Web sites and apps, I read through the code and began quickly to grasp the language constructs. For most basic testing, you can simply capture, compile, and execute the script using the Commander.

For more productionlike load tests, you can use a variety of variable-based inputs. For example, I used ODBC to provide script input of customer information that I had on hand in a database. Likewise, you can input data into scripts from variables, a list of values, and files, such as Excel spreadsheets.


Continued
1 | 2 | 3 | 4 | Next Page » 



OpenSTA 1.4.3

OpenSTA, opensta.org

Very Good  8.3
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 7 20%
Scalability 8 20%
Developer tools 7 10%
Value 10 10%

Cost:
Free

Platforms:
Windows 9x/NT/2000/XP

Bottom Line:
OpenSTA is a solid, easy-to-use open source Web load-testing tool. It does a nice job of answering how well a particular Web site or app might scale. Its proprietary scripting language may slow some developers down a bit, however, and its basic reporting and lack of certain features (for example, built-in comparison tools) may prompt some IT departments to look elsewhere.

About our Reviews and Scoring Methodology



Ingenieurbüro David Fischer Proxy Sniffer Professional Edition 3.7

Ingenieurbüro David Fischer, proxy-sniffer.com

Excellent  9.0
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 9 20%
Scalability 9 20%
Developer tools 9 10%
Value 9 10%

Cost:
$699 for unlimited concurrent users

Platforms:
Linux, Solaris, Windows

Bottom Line:
Proxy Sniffer offers a lot of features for the money and delivers them in the comfort of a Web browser. It can distribute load clients across multiple Unix, Linux, and Windows machines. Load-test setup is a breeze using the built-in tools, and the real-time monitoring and in-depth reporting tools — such as PDF output and comparison facilities — are quite useful.

About our Reviews and Scoring Methodology



Minq PureLoad Enterprise Edition 3.3.1

Minq Software, minq.se

Excellent  8.7
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 8 20%
Scalability 9 20%
Developer tools 9 10%
Value 8 10%

Cost:
Web Edition, $8,990 for unlimited virtual users; Enterprise Edition starts at $9,990 for 50 virtual users

Platforms:
Any platform supporting Java 2 Standard Edition 1.4.2 or later

Bottom Line:
Sites that need to test both Web protocols and enterprise applications will find PureLoad Enterprise Edition up to the task. Although its reporting is not as extensive as that of some competitors, PureLoad is very easy to set up and use for single- and multiple-machine load tests. A Web Edition that supports HTTP and HTTPS testing is also available.

About our Reviews and Scoring Methodology



 


 
Maggie Biggs is a senior contributing editor for the InfoWorld Test Center.
 

TOP NEWS:


»  You don't know tech: The InfoWorld news quiz
Match your weekly tech news wits against our snarky quiz master

»  Spinning off fabs would be risky for AMD, analysts say
AMD has expressed a desire to control chip-manufacturing costs, which has created speculation that the company might sell off its chip fabrication plants

»  Hackers find a new place to hide rootkits
A pair of security researchers has developed a new kind of rootkit, called an SSM, that hides in an obscure part of the processor that is invisible to antivirus apps

»  Top 10: Microsoft-Yahoo, XP SP3 woes, Sprint-Clearwire WiMax deal
This week's roundup of the top tech stories of the week include the demise of the Microsoft-Yahoo deal, Sun's JavaOne announcements, the Intel-OLPC beef, and more

»  Easing network congestion caused by virtual servers
Better I/O capability is an important and often overlooked aspect of getting the most out of server virtualization

»  Sun exec ponders OpenSolaris, Linux
In an interview, Ian Murdock, formerly with the Linux Foundation and now with Sun, discusses the company's open-source efforts and how to monetize them




BRINGING PERFORMANCE VALIDATION "INTO THE LIFECYCLE"
Today's enterprise apps are complex and ever-changing, which makes delivering high performance difficult. By virtualizing the behavior of application services and data in a VSE, teams can answer this challenge with validation best practices and test tools to ensure solid performance throughout the lifecycle. Register now to attend this webcast! Sponsor: ITKO

»  Click here to view this Webcast
  The Data Protection You've Been Looking For
Enterprise data is of supreme importance. If you can't find it quickly, it's worthless. If you lose it, it's a crisis. This IT Strategy Guide explores how to keep your data safe.

»  Click here to download now

- Special Advertising Partners -
WHITE PAPERS
 

» Technology White Papers Library

Technology White Papers by Topic

Technology White Papers E-mail Alert

Find out when the latest white paper is available:
 
 
INFOWORLD MARKETPLACE
 
» BUY A LINK NOW
 

FIND PRODUCTS AND COMPANIES
» COMPLETE PRODUCT GUIDE



TECHNOLOGY INDEX
• Applications
• Application Development
• Security
• Networking
• Wireless
• Platforms
• Hardware
• Data Management
• Storage
• Web Services
• Business
• Telecom
• Professional Services
• Standards

TECH WATCH 


What's the 411 on GOOG-411?
Just as Google has become synonymous with "performing a Web search," 411 is understood to mean "information" -- as in "what's the 411?" I was thus surprised to discover, from a billboard, no less, that the king of search is taking on the ...

Apple HTML source reveals 'iPhone Extreme'
"This one's a stretch..." reports AppleInsider. Um, yeah. Reporting on HTML code sightings of product names could be called a stretch, but iPhone Extreme has a ring to it. Now, that sounds like the product Apple should have released first, rather ...

COLUMNISTS

Unified under law
Ephraim Schwartz's Column and Blog (InfoWorld) - In the litigious world we live in, deploying a unified communications platform in your enterprise could...
» MORE COLUMNISTS

MORE INFOWORLD BLOGS


Open Sources 
Product Management
When I joined MySQL four years ago, there was quite a lot of debate about product management. We didn't actually have ...

Zero Day 
Botnet herders tending smaller flocks
New research backs up the theory that botnet operators are keeping their networks smaller in a continued effort to keep ...



• Advice Line
• Database Underground
• The Deep End
• Enterprise Mac
• Geeks in Paradise
• Grid Meter
• The Gripe Line
• InfoWorld Daily
• Inside IT
• IT Troubleshooter
• ITXtreme
• Open Sources
• ProdBlog
• Real World SOA
• Reality Check
• Security Adviser
• SMB IT
• The Storage Network
• Tech Watch
• Virtualization Report
• Zero Day

ADVERTISEMENT


RESOURCE CENTERadvertisement 

GOVERNMENT IT & POLICY
'If you don't go after the network, you're never going to stop these guys. Never.'
From the State Department, All the News for Inquiring Minds
TechPresident, the Internet Citizenry's New Consensus Taker



Sponsored Technology Links

 
 
 HOME  NEWS  BLOGS  PODCASTS  VIDEOS  TECHNOLOGIES  TEST CENTER  EVENTS  CAREERS  IT EXEC-CONNECT   About | Advertise | Awards | RSS | Contact Us 

Copyright © 2008, Reprints, Permissions, Licensing, IDG Network, Privacy Policy, Terms of Service.
All Rights reserved. InfoWorld is a leading publisher of technology information and product reviews on topics including viruses,
phishing, worms, firewalls, security, servers, storage, networking, wireless, databases, and web services.

CIO :: ComputerWorld :: CSO :: Demo :: GamePro :: Games.net :: IDG Connect :: IDG World Expo
Industry Standard :: IT World :: JavaWorld :: LinuxWorld :: MacUser :: Macworld :: Network World :: PC World :: Playlist