| About InfoWorld : Advertise : Subscribe : Contact Us : Awards : Events : Store |
|
||||
|
|
||||
|
How to climb the search engine rankings By Todd Coopee, InfoWorld Test Center June 9, 2000 IN THE WORLD of pop music, registering a hit in the top 10 remains a valid benchmark of success. The same benchmark can be applied to search engine rankings on the Internet, where a placing in the top 10 can result in increased site traffic, additional revenue opportunities, and enhanced customer relations -- all without spending additional advertising dollars.
Unfortunately, with well over a billion pages on the Internet, it is difficult to establish and maintain top 10 staying power. To make matters worse, establishing a high search engine ranking is more of an art than a science. Securing a place near the top of one search engine, such as AltaVista, does not necessarily guarantee a successful search ranking with other engines, such as Google or HotBot. Fortunately, there are some established techniques that can be used to increase your chances of breaking in to the top 10 (see related article, below). It also pays to understand the different types of search tools that are being used on the Internet and their various methodologies for cataloging the Web. The task of climbing the ranking ladder can also be partially automated using commercially available software products such as FirstPlace Software WebPosition Gold and Woftam Jones AddWeb Pro. Inner workings For the most part, Internet search tools fall into two camps: search engines, such as HotBot and AltaVista, and online directories, such as Yahoo and Lycos. The difference between the two is related to how they compile their site listings. Of course, there are exceptions to every rule. Some search utilities, such as Ask Jeeves, combine the search engine and directory approaches into a single package,hoping to provide users with the best of both worlds. In directory-based search services, the Web site listings are compiled manually. For example, the ever-popular Yahoo dedicates staff resources to accept site suggestions from users, review and categorize them, and add them to a specific directory on the Yahoo site. You can usually submit your Web site simply by filling out an online form. On Yahoo, for example, you'll find submission information at www.yahoo.com/docs/info/include.html. Because human intervention is necessary to process, verify, and review submission requests, expect a delay before your site secures a spot in a directory-based search service. On the flip side, search engines completely automate the compilation process, removing the human component entirely. A software robot, called a spider or crawler, automatically fetches sites all over the Web, reading pages and following associated links. By design, a spider will return to a site periodically to check for new pages and changes to existing pages. Results from spidering are recorded in the search engine's index or catalog. Given the wealth of information available on the Internet, it is not surprising that indexes grow to very large sizes. For example, the AltaVista index has recently been increased to top out at 350 million pages. This may seem like a mammoth number, but by all estimates it still represents less than 35 percent of all pages on the Web. Because of the depth and breadth of information being indexed, there is usually a delay, sometimes up to several weeks, between the time a site has been "spidered" and when it appears in a search index. Until this two-step process has been completed, a site remains unavailable to search queries. Finally, the heart of each search engine is an algorithm that matches keyword queries against the information in the index, ranking results in the order the algorithm deems most relevant. Because the spiders, resulting indexes, and search algorithms of each search engine differ, so do the search results and rankings across the various search engines. This explains why a top 10 site in HotBot may not appear near the top of AltaVista when the same keyword search criterion is entered. ![]() Results-oriented Because all search engines rely on keyword searching to generate results, you need to keep keywords in mind when creating your site's content. To start, a combination of relevant page titles and body copy can influence site ranking. Determine which keywords prospective visitors would use to search for your site -- and for the sites of your competitors -- and include those terms in your pages. Keyword placement and frequency throughout a page are prime factors in the ranking process. It's a good idea to use a combination of unique and common keywords, but don't overuse unique or proprietary terms at the expense of common or general terms that are more likely to be used in a search. In addition, many, but not all, search utilities also reference metatags -- invisible HTML tags within documents that describe their content -- as a way to control how content is indexed. As a result, proper use of metatags throughout a site can also boost search engine ranking. There are well over 50 metatags available for use within HTML pages, but those most commonly used by search engines for indexing and ranking purposes are the description and keywords tags. As the name indicates, the description tag includes a short description of a site that a search engine would display in a search results list. For example, the following description tag would allow Web searchers to quickly ascertain the service offerings of Acme Corp. and would entice them to go to the site to download free evaluation copies of software: <META NAME="Description" CONTENT="Acme Corp. makes Web site testing and quality assurance software. Download free evaluation versions of our products."> Keywords for a search engine to associate with a particular page are stored in the keywords tag. These are words that a user would type as part of a search engine query to bring up relevant Web pages from a search engine's index. For example, Acme Corp. might include the following metatag in its home page: <META NAME="Keywords" CONTENT="Web site testing, quality assurance, link checking"> ![]() As in the titles and body text of Web pages, you should try to combine both unique and common keywords, as well as specific and general ones, in the keywords tag. Some Web developers even include misspelled keywords. Again, the idea is to anticipate the keywords potential visitors would use to find your site. For large, content-rich sites, maintaining metatags can quickly become tedious. For this reason a number of products, such as Watchfire Metabot, have arrived on the scene to automate the process. Given the growing importance of XML and meta data for interaction across disparate applications and systems, the proper use of metatags will only become more important down the road. Despite their proliferation, meta-tags are still ignored by some search engines. Lycos, for example, ignores them entirely in the ranking process. The use of metatag spamming, such as repeating a particular keyword several hundred times in a Web page, has also forced some search engines to reduce the weight of metatags in determining their rankings. A final factor affecting ranking results in some engines, such as Excite, is page popularity, which is determined by how often a particular Web page is linked to by other pages in the index. The more popular a page is, the higher the ranking. This granular approach to Web page ranking is difficult to influence and is being used by search engines more frequently. Search futures As more and more Web sites arrive on the scene, it will become increasingly more challenging for search engines to rank pages effectively and fairly. You can expect search engines to continue to get smarter, employing linguistic analysis and other heuristic techniques to return more meaningful results. The continued use of XML and embedded meta data will also allow for better ranking and comparisons across information resources. Naturally, Web site developers will have to continue to roll with the changes. But considering how heavily Web surfers rely on search engines, your site developers should make search engine ranking an integral part of their site maintenance procedures, if it isn't already. Related Story Make your site a hit with search engines Technical Analyst Todd Coopee (todd_coopee@infoworld.com) covers Web-based analysis tools, Internet-based groupware, and application development tools for the InfoWorld Test Center.
RELATED SUBJECTS SPONSORED WHITE PAPERS
SPONSORED LINKS
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||