About InfoWorld : Advertise : Subscribe : Contact Us : Awards : Events : Store
InfoWorld HomeNewsTest CenterOpinionsProduct GuideTechIndex
 SUBSCRIBE  NEWSLETTERS  EVENTS  WEBCASTS  SPECIAL REPORTS  RSS FEEDS
SiteProducts Search
 
SCORING METHODOLOGY

 
For each product category the InfoWorld Test Center evaluates, we first determine which criteria are most critical to the buying decision, then assign a weighted percentage to each criterion based upon its importance. For any shipping product or service we test within that product category, we assign a score for each criterion (on a scale of 1 to 10), multiply each criterion's assigned percentage by its respective score, then add the resulting figures to calculate a total score.

Finally, we assign a verbal rating based on that score. As of January 2005, products scoring below 4.9 are deemed "Unacceptable"; between 5.0 and 5.9, "Poor"; 6.0 to 6.9, "Fair"; 7.0 to 7.9, "Good"; 8.0 to 8.6, "Very Good"; 8.7 to 10, "Excellent." Scores related to products reviewed before January 2005 correspond to a different set of verbal ratings; the 2005 ratings system was not applied retroactively to those reviews.

Scoring criteria will include a combination of any of the following:

Availability: We gauge how consistently accessible the solution is.

Ease of use: We determine how intuitive and user-friendly the solution is, keeping in mind who the intended user is.

Interoperability: We gauge how seamlessly the solution interacts with various hardware and/or software or how well it supports various standards.

Management: We assess how easy or difficult it is to administer the solution on an ongoing basis.

Performance: We rate how well the product or service solves the problems it was created to address.

Security: We rate how secure the solution is, if it adequately addresses security issues, or if it opens potential security holes.

Reliability: We score how consistently the solution performs the way it is expected to perform.

Scalability: We rate how much growth potential a solution has in relation to the rest of an organization's IT infrastructure.

Setup: We rate the complexity and amount of time and effort required to get the solution up and running, relative to the implementation of solutions of similar size and functionality.

Support: We rate the level of available customer support, be it in the form of documentation, online assistance, or live customer support.


Value: We rate the overall value of the product in relation to similar products offering similar features and capabilities.

The analyst and editor generally will not devise a new set of criteria for a product or service if one already exists for a similar solution. However, they may adjust criteria for various reasons.


 HOME  NEWS  TEST CENTER  CTO NETWORK  TECHINDEX   About InfoWorld :: Advertise :: Subscribe :: Contact Us :: Awards :: Events 


Copyright © 2008, Reprints, Permissions, Licensing