Speeding  up enterprise search

There’s no overstating the importance of search to your public Web or internal servers. Even the best-architected sites have grown so complex that more than two-thirds of visitors use site search as their primary form of navigation, research company IDC reports. 

Yet making the right search choice can be equally complicated. There are dozens of options, ranging from low-end products that yield imprecise results to intricate solutions that crawl all types of enterprise data repositories and take years to implement.

In fact, major search vendors declined to submit their enterprise products to InfoWorld for testing, saying setup would be too complex. Among the no-shows was Verity’s K2 Enterprise with its intricate taxonomy and classification functions.

Nevertheless, I was able to get a good sense of Verity’s enterprise search approach with a three-month test of Verity Ultraseek, a lighter version of the technology found in the high-end K2 Enterprise. My conclusion: It’s a very good choice for Internet, extranet, and intranet searches. 

Version 5.3.1 improves search results and their display with new options, including Page Expert, which filters out irrelevant page content. The updated Ultraseek is a good fit for large deployments because IT can delegate to business managers admin tasks such as revising search forms to match the requirements of different sites.

Deep searching

After you get Ultraseek running -- a trivial process -- you can almost forget about touching the software. The latest version now supports Suse Linux and Red Hat Enterprise Linux; my test platforms employed both Red Hat Enterprise Linux 3 and Windows Server 2003. 

Customization is performed via a Web-based UI divided into functional sections. Although Ultraseek provides a lot of options for you to customize, creating a basic search isn’t difficult: I merely entered a starting URL and completed a second form with the types of documents to crawl.

I was pleasantly surprised with the usability and depth of Layout Manager, a great GUI for designing the search interface. For example, I employed the same CSS style sheet across any given site to maintain a consistent look for search results, and I could select default collections and categories.

Unfortunately, my initial results were not as good as those I got from search appliances. For example, on identical site crawls, Ultraseek returned 20 percent false hits compared with none for both the Google and Thunderstone appliances. The good news is that I matched those results after configuring two new Ultraseek features, Page Expert and Secure Result Filtering.

The Page Expert function helped me exclude noncontent text (such as navigation and menus), which seemed to confuse Ultraseek’s search algorithms. Next, I used Secure Result Filtering, which checks each hit against the current user’s permissions and then presents only allowable results. This works with basic HTTP, HTTPS, and NTLM (NT LAN manager) security, so it should be adequate for portals and other similarly customized sites.

As do most search software solutions, Ultraseek provides editorial control. For example, editors can allow keywords to be associated with specific URLs that appear above the normal search results. Making these connections with Ultraseek, however, is much easier than it is with Thunderstone.