Free Newsletters
Technology & Business Daily

InfoWorld
Log-in | Register

Prep your Web apps for stellar performances

Load testers prove a valuable part of your development strategy

By Maggie Biggs
November 21, 2005
 

High-performance Web sites and apps don't happen accidentally. A detailed performance and scalability testing strategy is needed throughout the development lifecycle -- and that requires a good load-testing solution.

Free IT resource

Open Source Business Conference (OSBC) May 22-23, 2007

Sponsored by OSBC

Free IT resource

Virtualization Insights from Top Experts - Learn how virtualization gets real!

Sponsored by Dell

The rewards are clear: Strong, ongoing emphasis on performance testing can keep budgets in check and reduce production issues. With the plethora of performance and scalability tools available today, however, choosing the right one for your shop can prove challenging.

I recently examined three Web load-testing solutions: OpenSTA 1.4.3, Ingenieurbüro David Fischer's Proxy Sniffer Professional Edition 3.7, and Minq's PureLoad Enterprise Edition 3.3.1. The three solutions represent the low-, middle-, and higher-end price points of the load-testing tools market; and for basic HTTP and HTTPS testing, any of these three solutions more than meets the need. The way each solution is implemented differs, however, as does the functionality they offer.

OpenSTA 1.4.3

OpenSTA is an open source Web load-testing tool that's easy to install and use. Setting up baseline and scalability types of load tests using either a single or multiple machines is a snap. Platform support, however, is surprisingly limited to Windows only.

Nonetheless, after registering all of my test machines with an OpenSTA repository on a central machine, I was executing distributed load tests in no time. Heavy OpenSTA load tests may also require developers to adjust the maximum number of sockets on each load client to reduce the occurrence of socket errors.

Script creation, execution, and analysis are all accessible via OpenSTA's Commander interface, which is a native Windows application. After creating a new script definition and clicking on it, the OpenSTA Script Modeler opened. The Script Modeler has three panes: one for script creation; a diagnostic window for script compilation and playback; and a third view that allows developers to see the HTML, site structure, and header information.

OpenSTA scripts are written using SCL (Script Control Language) -- a built-in compiled scripting language that has influences from Fortran and Digital's Digital Command Language. Reference documentation is provided to get developers going. Developers also might find it easy to learn SCL by first using the built-in capture facility.

After capturing interactive browser sessions with several test Web sites and apps, I read through the code and began quickly to grasp the language constructs. For most basic testing, you can simply capture, compile, and execute the script using the Commander.

For more productionlike load tests, you can use a variety of variable-based inputs. For example, I used ODBC to provide script input of customer information that I had on hand in a database. Likewise, you can input data into scripts from variables, a list of values, and files, such as Excel spreadsheets.


Continued
1 | 2 | 3 | 4 | Next Page » 



OpenSTA 1.4.3

OpenSTA, opensta.org

Very Good  8.3
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 7 20%
Scalability 8 20%
Developer tools 7 10%
Value 10 10%

Cost:
Free

Platforms:
Windows 9x/NT/2000/XP

Bottom Line:
OpenSTA is a solid, easy-to-use open source Web load-testing tool. It does a nice job of answering how well a particular Web site or app might scale. Its proprietary scripting language may slow some developers down a bit, however, and its basic reporting and lack of certain features (for example, built-in comparison tools) may prompt some IT departments to look elsewhere.

About our Reviews and Scoring Methodology



Ingenieurbüro David Fischer Proxy Sniffer Professional Edition 3.7

Ingenieurbüro David Fischer, proxy-sniffer.com

Excellent  9.0
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 9 20%
Scalability 9 20%
Developer tools 9 10%
Value 9 10%

Cost:
$699 for unlimited concurrent users

Platforms:
Linux, Solaris, Windows

Bottom Line:
Proxy Sniffer offers a lot of features for the money and delivers them in the comfort of a Web browser. It can distribute load clients across multiple Unix, Linux, and Windows machines. Load-test setup is a breeze using the built-in tools, and the real-time monitoring and in-depth reporting tools — such as PDF output and comparison facilities — are quite useful.

About our Reviews and Scoring Methodology



Minq PureLoad Enterprise Edition 3.3.1

Minq Software, minq.se

Excellent  8.7
criteria score weight
Ease-of-use 9 20%
Monitoring 9 20%
Reporting 8 20%
Scalability 9 20%
Developer tools 9 10%
Value 8 10%

Cost:
Web Edition, $8,990 for unlimited virtual users; Enterprise Edition starts at $9,990 for 50 virtual users

Platforms:
Any platform supporting Java 2 Standard Edition 1.4.2 or later

Bottom Line:
Sites that need to test both Web protocols and enterprise applications will find PureLoad Enterprise Edition up to the task. Although its reporting is not as extensive as that of some competitors, PureLoad is very easy to set up and use for single- and multiple-machine load tests. A Web Edition that supports HTTP and HTTPS testing is also available.

About our Reviews and Scoring Methodology



 


 
Maggie Biggs is a senior contributing editor for the InfoWorld Test Center.
 

TOP NEWS:


»  Troubleshooting tool for Java offered
Sun's Java VisualVM open-source technology views apps while they run on a JVM and is billed as all-in-one solution

»  Python backing eyed for NetBeans
Scripting language capabilities of the open-source IDE continue to expand

»  Microsoft sets Windows XP SP3 automatic download for Thursday
The latest service pack for Windows XP will be pushed to Automatic Update at 7a.m. EDT on July 10

»  Real Software, Veryant bolster dev tools
RealBasic, Cobol apps platforms get improvements

»  Microsoft sets hosted-services pricing, irks partners
By offering 38 percent discount to customers who buy entire hosted business productivity suite, Microsoft undercuts partners selling similar services

»  Adobe readying new mashup tool for business users
Mashup interface code-named 'Genesis' will open up desktop 'workspace' combining business application data, documents, analytics, and instant messaging




Solutions to the Toughest IT Challenges in Remote Offices
Though small in size, remote offices face many of the same IT challenges as larger central offices. This Webcast zeroes in on the top line challenges to deliver information that can provide immediate benefits to your business. Sponsor: AMD and Dell

»  Click here to view this Webcast
  Zombie PCs Are Attacking Your LAN
A recent study showed that malware-infected zombie PCs are now a bigger threat to ISPs and Web infrastructure than DoS attacks. As this brand new IT Strategy Guide explains, an increased use of peer-to-peer techniques by the attackers has made it harder to fight back. Download now, compliments of Verio:

»  Click here to download now

- Special Advertising Partners -
WHITE PAPERS
 

» Technology White Papers Library

Technology White Papers by Topic

Technology White Papers E-mail Alert

Find out when the latest white paper is available:
 
 
INFOWORLD MARKETPLACE
 
» BUY A LINK NOW
 

FIND PRODUCTS AND COMPANIES
» COMPLETE PRODUCT GUIDE



TECHNOLOGY INDEX
• Applications
• Application Development
• Security
• Networking
• Wireless
• Platforms
• Hardware
• Data Management
• Storage
• Web Services
• Business
• Telecom
• Professional Services
• Standards

TECH WATCH 


What's the 411 on GOOG-411?
Just as Google has become synonymous with "performing a Web search," 411 is understood to mean "information" -- as in "what's the 411?" I was thus surprised to discover, from a billboard, no less, that the king of search is taking on the ...

Apple HTML source reveals 'iPhone Extreme'
"This one's a stretch..." reports AppleInsider. Um, yeah. Reporting on HTML code sightings of product names could be called a stretch, but iPhone Extreme has a ring to it. Now, that sounds like the product Apple should have released first, rather ...

COLUMNISTS

Unified under law
Ephraim Schwartz's Column and Blog (InfoWorld) - In the litigious world we live in, deploying a unified communications platform in your enterprise could...
» MORE COLUMNISTS

MORE INFOWORLD BLOGS


Open Sources 
Product Management
When I joined MySQL four years ago, there was quite a lot of debate about product management. We didn't actually have ...

Zero Day 
Botnet herders tending smaller flocks
New research backs up the theory that botnet operators are keeping their networks smaller in a continued effort to keep ...



• Advice Line
• Database Underground
• The Deep End
• Enterprise Mac
• Geeks in Paradise
• Grid Meter
• The Gripe Line
• InfoWorld Daily
• Inside IT
• IT Troubleshooter
• ITXtreme
• Open Sources
• ProdBlog
• Real World SOA
• Reality Check
• Security Adviser
• SMB IT
• The Storage Network
• Tech Watch
• Virtualization Report
• Zero Day

ADVERTISEMENT


RESOURCE CENTERadvertisement 

GOVERNMENT IT & POLICY
'If you don't go after the network, you're never going to stop these guys. Never.'
From the State Department, All the News for Inquiring Minds
TechPresident, the Internet Citizenry's New Consensus Taker



Sponsored Technology Links

 
 
 HOME  NEWS  BLOGS  PODCASTS  VIDEOS  TECHNOLOGIES  TEST CENTER  EVENTS  CAREERS   About | Advertise | Awards | RSS | Contact Us 

Copyright © 2008, Reprints, Permissions, Licensing, IDG Network, Privacy Policy, Terms of Service.
All Rights reserved. InfoWorld is a leading publisher of technology information and product reviews on topics including viruses,
phishing, worms, firewalls, security, servers, storage, networking, wireless, databases, and web services.

CIO :: ComputerWorld :: CSO :: Demo :: GamePro :: Games.net :: IDG Connect :: IDG World Expo
Industry Standard :: IT World :: JavaWorld :: LinuxWorld :: MacUser :: Macworld :: Network World :: PC World :: Playlist