Free Newsletters
Technology & Business Daily

InfoWorld
Log-in | Register

Coverity and Klocwork code analyzers drill deeper

Industry leaders show remarkable scalability and prowess but differ in design philosophy


Because Coverity is limited to C and C++, it has good representation in embedded contexts. As a result, it works on a very wide variety of platforms and with an enormous number of different compilers -- far more than K7.

Return to special report

DOWNLOAD PDF

Click here to download InfoWorld's special report Code analyzers


Coverity's Unix-like aspect is visible in how it does configuration. For example, to limit the number of false positives, it enables you to provide detailed configuration files that are then compiled with the project, or stub functions that redirect Coverity's checkers, or annotations that are placed as comments directly in the source code. (This last option is of doubtful value. Few sites will change large code bases to accommodate a static-analysis tool.)

The Unix scripting approach is also evident in how the code scanner works. And in this respect, the products are distinctly different. In all tests, K7 found more defects than Coverity. Stripping out false positives still left K7 ahead in total bug counts. However, some defects reported by K7 are close in nature to the items lint reports, whereas Coverity kept far away from reporting these issues. If I removed those items from the bug counts, the products had comparable defect counts.

An important question is, Which approach makes more sense? Personally, I think that if a product finds an undeniable bug, it should be reported -- regardless of whether it seems like a bug for lint or not. This is the path that K7 wisely chose. If for some reason you don't want those results, you can filter them out of the report or display. But always keep the option of seeing them. Coverity does not include such defects at all. If you want them found, you must script your own extensions to the analyzer. Coverity provides samples of such scripts, but it does not build them into the product. This approach reflects the Unix orientation, where anything can be done by writing scripts or using little languages. This view seems valid for Unix, but it's hard to accept in an enterprise-level bug-sniffing tool. And certainly at Coverity's price, you should reasonably expect every bug to be reported without writing, testing, and implementing your own extensions.

Going head-to-head

Both packages are large and have many features, so installation and configuration take time. These are both true enterprise tools, so evaluations should be done with deliberation and careful consultation with sales engineers from the respective vendors. Fortunately, trial licenses are available along with considerable assistance in performing evaluations.

Both products are admirably effective detecting hard-to-find bugs, especially cross-functional defects. Their results are comparable and this measure should not serve as the primary basis for comparison. I prefer Klocwork K7 because it is a more complete tool and is less expensive. Not only does K7 cover more languages, but it has a superb console/dashboard for managing analytical runs and their numerous generated results. In addition, I believe Klocwork's approach to bug identification is superior. In counterpoint, Coverity's strengths are its great flexibility and its capability of running on numerous platforms.

Andrew Binstock is senior contributing editor of the InfoWorld Test Center.
« PREVIOUS PAGE | 1 | 2 | 3 

 The Bottom Line

Coverity Prevent 2.2.2
Coverity, coverity.com

Good  7.2
criteria score weight
Defect discovery 8 40%
Defect management 5 25%
Configurability 8 15%
Interoperability 8 10%
Value 7 10%

Cost:
Price based on total code size for all projects regardless of number of seats; 500,000 lines of code, $50,000 per year

Platforms:
Windows, Linux, Solaris (SPARC and x86), HP-UX, NetBSD, FreeBSD

Bottom Line:
Coverity Prevent is a highly configurable source analyzer that scales well and runs on numerous platforms. It goes beyond traditional static code analyzers in its discovery of defects but analyzes only C and C++, lacks defect management tools, and provides a constrained view of the kinds of bugs it reports.

About our Reviews and Scoring Methodology

 The Bottom Line

Klocwork K7 v. 7.0.4.15
Klocwork, klocwork.com

Very Good  8.2
criteria score weight
Defect discovery 8 40%
Defect management 9 25%
Configurability 7 15%
Interoperability 8 10%
Value 9 10%

Cost:
$3,995 per user; projects with as many as 500,000 lines of code require at least five seats, larger projects require more seats

Platforms:
Windows, Linux, Solaris

Bottom Line:
Klocwork K7 is a comprehensive analytical suite with excellent defect discovery and an extensive management console. In addition, it provides superior code navigation and analysis tools. K7 works on C, C++, and Java — source and bytecodes — but is limited to mainstream platforms.

About our Reviews and Scoring Methodology


Talkback:

commentPost a Comment

 

MOST COMMENTS

 
 





Beyond AntiVirus: Symantec Endpoint Protection
Today's threats to the endpoint are much more dangerous as they rapidly evolve to evade traditional security measures. To combat these threats, companies should supplement existing security with proactive behavioral based technologies. Join this webcast to learn about Symantec's next generation AntiVirus solution that provides that level of protection. Sponsor: Symantec

»  Click here to view this Webcast
  Zombie PCs Are Attacking Your LAN
A recent study showed that malware-infected zombie PCs are now a bigger threat to ISPs and Web infrastructure than DoS attacks. As this brand new IT Strategy Guide explains, an increased use of peer-to-peer techniques by the attackers has made it harder to fight back. Download now, compliments of Verio:

»  Click here to download now

- Special Advertising Partners -
WHITE PAPERS
 

» Technology White Papers Library

Technology White Papers by Topic

Technology White Papers E-mail Alert

Find out when the latest white paper is available:
 
 
INFOWORLD MARKETPLACE
 
» BUY A LINK NOW
 
 

Video

 
 
 

Podcasts

 
 
 

 

Columnists

 
 
 

Resource Center


Ads by techwords beta  [See your link here]
 




Sponsored Technology Links

 
 
 HOME  NEWS  BLOGS  PODCASTS  VIDEOS  TECHNOLOGIES  TEST CENTER  EVENTS  CAREERS   About | Advertise | Awards | RSS | Contact Us 

Copyright © 2008, Reprints, Permissions, Licensing, IDG Network, Privacy Policy, Terms of Service.
All Rights reserved. InfoWorld is a leading publisher of technology information and product reviews on topics including viruses,
phishing, worms, firewalls, security, servers, storage, networking, wireless, databases, and web services.

CIO :: ComputerWorld :: CSO :: Demo :: GamePro :: Games.net :: IDG Connect :: IDG World Expo
Industry Standard :: IT World :: JavaWorld :: LinuxWorld :: MacUser :: Macworld :: Network World :: PC World :: Playlist