Free Newsletters
InfoWorld Daily

InfoWorld
Log-in | Register

Clean up your SOAP-based Web services

The Test Center inspects five worthy tools for keeping your services squeaky clean


Apply the above process repeatedly for the different Web methods on the WSDL, and ultimately you'll have a complete test case for a specific WSDL. Test cases can, in turn, be gathered into a test suite, which is really just a kind of folder in the LISA environment.

iTKO LISA
Click for larger view.
LISA provides a healthy collection of test step types, though in most test cases, the majority of steps are of the "Web service execution step" type: Send a request, examine the response, and determine success or failure. Other step types can verify a Web service's compliance with various standards, execute external Java classes, or even call command-line scripts.

In addition, each test step can be adorned with a variety of filters and assertions. The former is provided to parse the content of response messages. For example, you might apply a filter to fetch a specific response value and store it in a property for use in later steps. The assertions manage verification of response data, WSDL, and message conformance. Also, the assertion section of a step specifies whether it has passed or failed, and it identifies whether execution control should proceed to the next step or to some other step.

The full LISA product is very Java-aware. It can generate JUnit tests, functional tests of Java classes, database tests via JDBC, and EJB tests. The free version, WS-Testing, is limited to generating only test cases and for Web services only. In addition, some test steps types are unavailable (it lacks any J2EE-related test step types, for example).

For all the initial ease of learning LISA, navigating the UI is sometimes bumpy. For example, when entering a new value for a field in a test step, there is no obvious way to save that value, nor to cancel the change. I found the only way to cancel input was to select a different node in the explorer, then dismiss the dialog that asked if I really wanted to do that.

The LISA documentation makes a big deal of no-code test development, as if that is the high road to simultaneously simplifying and accelerating test development. Perhaps, but while LISA's pure UI-approach does have the benefit of live interaction and is more accessible to QA engineers inexperienced at coding, it has limitations that a tool with easier access to scripting does not. Some testing nuts can only be cracked by a well-sharpened piece of code.

Mindreef SOAPscope Server 6.0
SOAPscope Server, like QEngine, is a thin-client-based tool. Behind SOAPscope's browser UI is a Tomcat server, girded by an RDBMS (relational database management system) that can be MySQL, Oracle, Microsoft SQL Server, or the embedded Apache Derby database. (Derby is supplied with SOAPscope but not recommended for even moderately large installations.)

SOAPscope Server's service spaces are the overarching containers of testing assets. An administrator will use service spaces to organize users into groups. Within a service space, member users can create one or more workspaces in which to store their, well, work.

Inside a workspace you'll find WSDL contracts, tests, notes, and other ancillary material needed to support actual testing. Typically, a workspace corresponds to a WSDL: When you create a new workspace, the first prompt you encounter is for a WSDL URL. You can, however, add more WSDL contracts to the workspace once it is created. Once you've imported a WSDL into a workspace, you can begin adding messages to that workspace. A message is really a SOAP request/response pair, created when you invoke a Web method on a WSDL. The invocation also optionally creates an "action" within the workspace.

Rick Grehan is contributing editor of the InfoWorld Test Center.
Continued
« PREVIOUS PAGE | 1 | 2 | 3 | 4 | 5 | 6 | NEXT PAGE » 

 The Bottom Line

AdventNet QEngine 6.8
AdventNet, adventnet.com

Good  7.4
criteria score weight
Ease-of-use 7 20%
Features 7 20%
Scalability 8 20%
Setup 8 20%
Documentation 7 10%
Value 7 10%

Cost:
Single-use/installation license, $2,495; additional $795 for performance testing with up to 50 virtual users

Platforms:
Windows 2000 or later, Linux

Bottom Line:
A cross-platform tool, QEngine runs easily on both Windows and Linux. It's hard to beat the solution's programmability; you can extend tests to arbitrary complexity. However, creating test scripts requires coding skills, plus it's easy to get lost in the user interface.

About our Reviews and Scoring Methodology

 The Bottom Line

Crosscheck Networks SOAPSonar 3.0.5
Crosscheck Networks, crosschecknet.com

Very Good  8.2
criteria score weight
Ease-of-use 8 20%
Features 9 20%
Scalability 8 20%
Setup 8 20%
Documentation 8 10%
Value 8 10%

Cost:
Pricing starts at $799 for the Standard versions. Other versions include Automation and Platinum.

Platforms:
Windows 2000 or later

Bottom Line:
SOAPSonar's "four pillars" approach to Web service testing is an excellent testing discipline. Moreover, the product's security testing capabilities are particularly powerful. On the other hand, the different testing "modes" are rather confusing, and automation features cost extra.

About our Reviews and Scoring Methodology

 The Bottom Line

iTKO LISA 3.6e
iTKO, itko.com

Good  7.8
criteria score weight
Ease-of-use 7 20%
Features 8 20%
Scalability 9 20%
Setup 8 20%
Documentation 7 10%
Value 7 10%

Cost:
Starts at $4,000 per license for Web Services Edition. Cost varies based on number of users, load testing, and extensibility needs. Full edition including testing for Web services, ESB, messaging/ESB, databases, Web/RIA apps costs $9,500.

Platforms:
Any Java-compliant platform (Windows, Mac OSX, Linux, Solaris) with at least 1GB of RAM and a 1.6GHz processor

Bottom Line:
LISA tries hard to create a code-free testing environment, quickly embraced by QA engineers that might need help with SOAP intricacies. Moreover, the tool can test both SOAP and REST-based services. Drawbacks include the fact that hard-core developers will miss the ability to write code. Also, the interface is difficult to master.

About our Reviews and Scoring Methodology

 The Bottom Line

Mindreef SOAPscope Server 6.0
Mindreef, mindreef.com

Good  7.8
criteria score weight
Ease-of-use 8 20%
Features 7 20%
Scalability 8 20%
Setup 8 20%
Documentation 9 10%
Value 7 10%

Cost:
Not disclosed

Platforms:
Windows XP/2003 Server/Vista, Linux (Red Hat recommended)

Bottom Line:
Excellent documentation and an easy-to-maneuver interface can't quite make up for SOAPscope's lack of programmability and its inability to address non-SOAP Web services. To its credit, it delivers good support for rule-based message and WSDL governance.

About our Reviews and Scoring Methodology

 The Bottom Line

Parasoft SOAtest 5.1
Parasoft, parasoft.com

Very Good  8.4
criteria score weight
Ease-of-use 8 20%
Features 9 20%
Scalability 9 20%
Setup 8 20%
Documentation 8 10%
Value 8 10%

Cost:
Enterprise Edition, including desktop licenses and training for a team of five, costs around $50,000.

Platforms:
Windows, Linux, Solaris

Bottom Line:
SOAtest does an excellent job jump-starting the test process. Parasoft has done exceptionally well integrating Web-service testing into the company's already robust testing tools. The offering is heavy on Java affinity, which might limit its appeal to .Net developers. Also, project structure is initially confusing.

About our Reviews and Scoring Methodology


Talkback:

commentPost a Comment

 

MOST COMMENTS

 
 





COMPREHENSIVE DATA PROTECTION AND DISASTER RECOVERY
Traditional backup and recovery is becoming irrelevant. You need more. Watch this InfoWorld and Dell Equallogic webcast to learn the current trends in Comprehensive Data Protection and Disaster Recovery for VMware Virtual Infrastructure. Sponsored by Dell Equallogic:

»  Click here to view this Webcast
  Network Security Solutions Guide
Network security is comprised of so much more than protecting just one or two PCs. And network security management can be different based on your situation. Read this Solutions Guide to find the best ways to protect your entire network, from individual PCs to network-attached storage and more. Sponsored by ISC2

»  Click here to download now

- Special Advertising Partners -
WHITE PAPERS
 

» Technology White Papers Library

Technology White Papers by Topic

Technology White Papers E-mail Alert

Find out when the latest white paper is available:
 
 
INFOWORLD MARKETPLACE
 
» BUY A LINK NOW
 
 

Video

 
 
 

Podcasts

 
IFW Daily 12/04/2008

Sun enters RIA realm with JavaFX, Adobe says it will cut 600 jobs, AMD...

 
 
 

Columnists

 
 
 

Resource Center


Ads by techwords beta  [See your link here]
 




Sponsored Technology Links

 
 
 HOME  NEWS  BLOGS  PODCASTS  VIDEOS  TECHNOLOGIES  TEST CENTER  EVENTS   About | Advertise | Awards | RSS | Contact Us 

Copyright © 2008, Reprints, Permissions, Licensing, IDG Network, Privacy Policy, Terms of Service.
All Rights reserved. InfoWorld is a leading publisher of technology information and product reviews on topics including viruses,
phishing, worms, firewalls, security, servers, storage, networking, wireless, databases, and web services.

CIO :: ComputerWorld :: CSO :: Demo :: GamePro :: Games.net :: IDG Connect :: IDG World Expo
Industry Standard :: IT World :: JavaWorld :: LinuxWorld :: MacUser :: Macworld :: Network World :: PC World :: Playlist
TecChannel :: TecCommunity