Chart your Web site's success

Four Web analytics solutions deliver deep analysis of site performance

In the late 1990s, Web analytics packages did a respectable job crunching server logs and uncovering broad Web site trends such as page views or user clickstream behavior. Today the focus has shifted to business reporting -- pinpointing the effectiveness of promotional campaigns, measuring ROI, and analyzing processes -- and to delivering those facts to content owners in a clear manner so that the appropriate corrective measures can be put into motion.

Such solutions can help you determine, for example, how the placement of a product on your home page affects sales; which e-mail campaign best persuades recipients to make purchases; or whether a pay-per-click keyword campaign is driving the right customers to your site. Moreover, these tools help you identify customer support issues so that you can post solutions to your site, rather than leaving your call center staff to contend with frequently encountered, easily solved troubleshooting issues.

Maintaining an effective Web site requires matching your site’s business objectives with the appropriate analytics solution. To help you find that solution, I evaluated four of the top applications, which cover both hosted and in-house architectures. They include Coremetrics 2005, NetIQ WebTrends 7.1 Enterprise Edition, Omniture SiteCatalyst 11, and WebSideStory HBX On-Demand Web Analytics 2.5.

Companies that use the Web to gather qualified marketing leads or to provide visitors with support will find that HBX On-Demand and WebTrends deliver the best overall value. Melding technical performance data with content reports, both solutions help you recognize problems with your site and measure how well your online processes work.

The Web is also an enormously effective commerce tool, returning as much as $25 for every dollar invested in retaining clients, according to The Boston Consulting Group. All four products aim at helping you understand your most valuable visitors, and they each come close to the mark. Because visitor segmentation and tracking are so complex, companies in vertical markets such as retail or financial services will be best served by a tailored solution such as Coremetrics.

In evaluating these products, I first considered implementation, paying particular attention to each solution’s approach to adding tracking information to Web pages and the amount of information the solution retained. Next, I focused on usability, scrutinizing each system’s navigability and the readability of its dashboards.

I also examined the depth of each system’s analysis: I looked for active segmentation, campaign analysis, and funnel or scenario analysis. But it isn’t enough to have these features. Reports must be formatted for the intended audience, such as sales figures that can be rolled up over several sites for executives. If a particular report isn’t included, there must be a way to generate an ad hoc report or to access a report builder.

Another important consideration -- especially in this age of personalization and one-to-one marketing -- is the ability to meld Web data with, say, a CRM application or a third-party e-mail system. Therefore, I assessed the various ways collected visitor information can be reused.

Coremetrics 2005

Foremost, Coremetrics 2005 is an online marketing system for selected vertical markets, including retail, financial services, and travel services. Not only does this hosted solution provide a wealth of statistics about Web customers, but its ad hoc reports help e-commerce executives understand customer actions and thus improve business.

From the outset, I was impressed with Coremetrics 2005’s implementation. There’s little work needed to place JavaScript page tags, called SmartTags, nor is there any ongoing maintenance. For example, the tags automatically sense the marketing campaign that sends visitors to specific Web pages. When testing Coremetrics’ competition, I often had to predefine events or customer segments before I could run reports.

Click for larger view.

Another Coremetrics 2005 advantage, called LIVE (Lifetime Individual Visitor Experience), stores a complete record of every click and activity for every customer and visitor to your Web site. In contrast, other products sometimes amalgamate this data, thus losing most details.

This solution’s browser interface conveniently groups reports -- including top-line metrics, marketing, site analysis, and segmentation -- within main drop-downs. Plus, when users log in they see a snapshot graph of how the site is performing. For instance, a retail client might see month-to-date sales compared with targets, as well as projections for the remainder of the month. I easily set up these charts by making a few menu selections.

Although not a capability exclusive to this product, Coremetrics’ LIVEview browser plug-in allowed me to quickly switch the type of data superimposed on a Web page. Readouts range from page views for selected time periods to sales and number of orders.

I found this solution’s marketing and merchandising analysis especially complete. Using the Marketing Management Center module, I displayed reports that broke down channels, such as search and e-mail. With a few clicks I drilled into each channel, getting information such as referrals by Google and Overture search (both paid and natural), sales that were the result of an e-mail campaign, and average order value. These prepopulated reports that summarize site performance can be downloaded to Excel or be e-mailed on predetermined schedules.

Yet where Coremetrics really outclasses other products is in its LIVE profiles. Using a wizard, I created a new customer segment on the fly based on RFM (recency, frequency, monetary) analysis. After a few steps I was able to see all visitors who had returned three or more times to the site, had purchased more than $300 in electronic equipment, and had entered the site via a Google keyword campaign. I could even drill down to an individual visitor and see what they did, click by click.

For this and other tasks, Coremetrics includes Virtual Analyst. This souped-up help function gives you very detailed instructions and answers to questions -- much as you’d get during a live conversation with a member of the company’s professional services staff. In testing, this expertly explained how to create intricate segment reports and what these reports mean.

For retailers, customer data is invaluable -- and Coremetrics 2005 appears to have the best method for employing LIVE repositories for both cross-selling and multichannel marketing. Although I didn’t test these features in depth, several Coremetrics clients report that the system uncovered cross-selling opportunities beyond the ordinary.

In the multichannel area, Coremetrics formats LIVE data so that it can be used by third-party applications. For example, you can tie into CRM applications from Responsys to create targeted e-mail campaigns.

Coremetrics isn’t sold primarily to content site owners, although it does have solid tools that developers can use to optimize sites, such as path analysis, which can be used to find out whether visitors bail out on a transaction because a form is too difficult to use. Coremetrics 2005’s ROI comes from exceptional marketing and merchandising features that enable retailers and other e-commerce site managers to proactively reach out to customers.

NetIQ WebTrends 7.1 Enterprise Edition

For marketers and content owners to act on Web performance data, the data must be easy to view and digest. To that end, WebTrends includes visual aids such as charts of clickstream paths and scenario analysis. The package also offers several ways to mine data dynamically, including a fine Excel plug-in that permits pivoting Web and offline information. Released in late January, Version 7.1 has improved WebTrend’s SmartView browser plug-in for evaluating page links. The updated iteration also integrates better with e-mail marketing services, and it delivers more detailed audience-segmentation data.

WebTrends is easy to set up. You just update Web pages with tracking tags that identify campaigns and other attributes you want to monitor. If it’s installed in-house, you also load a server plug-in.

Click for larger view.

Administrators control rights to templates and thus determine which reports users see when they log in to the WebTrends portal. Because WebTrends desktop supports multiple profiles, I was able to analyze different portions of my Web site, such as the software support area. WebTrends arranges reports in an intuitive “table of contents” format that clusters, for example, all online sales reports under the Commerce heading.

Introduced in Version 7.0, Campaign Drilldown gave me a detailed look at campaign performance, showing me statistics such as the number of visitors from a printed ad. Reports include the number of unique visitors per month, conversion metrics, and revenue information. WebTrends also distinguishes between paid search engine campaigns and organic search. Indeed, the product does one better: It shows your search engine ranking for various keywords versus that of your competition. Yet WebTrends not only reports your position but also the ROI for those keywords. For example, you could be ranked No. 3 for a keyword but actually derive more revenue than if you were in the top spot.

To improve conversion rates, I used Scenario Analysis, one of the most complete navigation analysis tools included in this test. I easily saw how people navigated to -- and through -- a registration process and self-service resolution. Significantly, I was able to find out not only where people abandoned the process but also where they went after that point, which helped me fix problems with forms. Unlike Omniture SiteCatalyst, WebTrends allowed me to see where visitors entered my site from e-mail links, helping me accurately gauge the effectiveness of my e-mail campaign.

In the e-commerce area, Product Drilldown summarized order and revenue figures for broad product groups and then allowed me to dig into each category with a simple click -- down to individual SKUs. Calculations such as GMROI (gross margin ROI) should be especially useful to marketing executives.

One of the best features, SmartReports for Microsoft Excel, integrates offline marketing and product cost data with live Web information. This plug-in automatically creates pivot tables, and with one click, you can update tables with live data. After I customized the spreadsheet and stored it on a shared network drive, a scheduler function updated figures automatically throughout the day. The result: Finance and marketing colleagues received needed data without having to access WebTrends directly.

WebTrends 7.1 enhances the product’s SmartView browser plug-in. For example, much better segmentation data such as buyers vs. nonbuyers appeared over links on Web pages. Moreover, this same overlay capability now works with HTML messages sent using ExactTarget, so you can quickly see performance metrics for each link in an e-mail.

WebTrends’ flexibility -- for example, it can analyze the log files of every major Web server -- comes with a price. You must set up tracking codes and configure campaigns. That effort aside, WebTrends 7, and now 7.1, proves that the company is once again taking the competition -- and client needs -- very seriously. Custom reports are much easier for users to develop, and they don’t rely on Excel, which is necessary in WebSideStory. Just as important, WebTrends helps you easily drill down into data to really understand customer actions.

Omniture SiteCatalyst 11

Metrics are the staple of Web analytics. But many products’ canned reports lack the details a particular manager needs -- and may require developer skills to modify. Omniture’s SiteCatalyst 11 takes an opposite “white box” approach. You get stock reports such as most-popular pages and e-commerce revenue, but the system’s strength is that it opens all collected data to end-users, permitting them to build custom reports relevant to their area of interest in near real time.

Despite being packed with options, SiteCatalyst’s portal-like Web interface is well organized. For example, the primary Commerce, Traffic, and Paths reports are shown prominently in the main navigation window.

My testing kicked off where the product focused most, e-commerce. I especially liked Campaign Manager, which gave me a snapshot of active e-mail and online marketing endeavors along with how much revenue each generates. A downside is that you must preplan these campaigns so pages you want to analyze have the appropriate tags.

An advantage of SiteCatalyst, however, is that you can immediately drill down (using a pop-up menu) to further examine these figures, including what customers bought and the length of purchase cycles. This information isn’t quite as granular as that given by Coremetrics, but it’s very valuable nonetheless. Furthermore, using SiteCatalyst Report Wizard, I easily created new reports, such as which sales were the result of paid search engine placement and which of natural searches.

1 2 Page 1
Page 1 of 2