Free Newsletters
Technology & Business Daily

InfoWorld
Log-in | Register

LogLogic hits the high points of log management

Appliance-based solution archives, analyzes multiple log file types

By Paul Venezia
March 10, 2006
 

There are a million and one log-management tools running in networks all over the world. Some are simple file-searching utilities. Some dig a little deeper. But all are focused on a specific log file from a specific service or network device. They don’t always talk to one another, however, which creates havoc for admins.

Free IT resource

TechNet: More ways to know it, share it, and keep it running.

Sponsored by Microsoft

Free IT resource

Attend the SOA Executive Forum: Breaking SOA Bottlenecks SOAExecForum.com/may2007

Sponsored by InfoWorld



LogLogic Series 3 LX and ST Appliances

LogLogic, loglogic.com

Very Good  8.3
criteria score weight
Scalability 9 30%
Ease-of-use 8 20%
Interoperability 7 20%
Manageability 9 10%
Security 9 10%
Value 8 10%

Cost:
LX 2000, $49,999; ST 3000, $74,999

Bottom Line:
LogLogic’s Series 3 appliances (LX and ST models) leave little to chance, providing a robust and extensible log file maintenance, archiving, and reporting platform. Support for more log file formats and custom log file definitions would be nice, but the power of the overall architecture is obvious. If the cost isn’t prohibitive, it’s worth a look.

About our Reviews and Scoring Methodology

LogLogic aims to bring all these disparate log files together in a palatable, sustainable way -- and they largely succeed with the Series 3 appliances.

Under the Hood

LogLogic’s solution is a collection of two appliances: The LX series serves as the initial log-file destination and the console for reporting, while the ST series handles log-file archiving.

Both appliance families are built on standard 2U and 3U rack-mount server hardware platforms, leveraging a Linux core, MySQL, Apache Tomcat, and Java to deliver the whole solution. The kernel is a recent 2.6.12 version, and LogLogic does not prohibit root-level SSH log-ins to the appliances.The hardware itself is quite robust, with both appliances sporting redundant power supplies and a 3ware 8500-series SATA RAID controller.

The LX 2000 I had in the lab was designed only to hold data for 90 days in a high-volume environment, so it had roughly 500GB of storage in a RAID 5 array of four 160GB drives, 4GB of RAM, and two 2.8GHz Intel Xeon CPUs.

The ST 3000 provides storage for the LX’s archived log data. It’s equipped with 2GB of RAM, two 2.8GHz Intel Xeon CPUs, and roughly 2TB of storage across a RAID 5 array of nine 250GB drives, with a mirrored set of boot drives. Both appliances have a significant amount of internal disk, but can be integrated into SAN and NAS environments for more archival storage.

Set ’Em Up, Knock ’Em Down

Setting up the appliances is straightforward, with a serial console connection necessary to configure IP information. Further configuration and admin tasks are done via the Web interface. The Web UI is reasonably fast and well-rendered, but occasionally has a touch of that well-known Java sluggishness.

You can quickly access high-level info using LogLogic’s status dashboard, which shows the current mps (messages per second) rate, existing alerts, system performance, and total message counters. Another click shows all defined syslog sources and their individual message counters, and a Java-based real-time syslog viewer applet shows the current syslog message streams as they flow into the box.

One of the appliances’ nicer features is their log source autodetection capability. To configure a device to log to the LogLogic appliance, you need only to point the device’s syslog output to the appliance’s IP address. When the appliance sees traffic from that source, it is automatically classified according to the determined data type.

LogLogic supports quite a few log formats, from routers, IDSes, and firewalls to more specific formats such as Microsoft Exchange and IAS and even Squid proxy logs. Log files can be imported directly into the LX 2000 via HTTP, HTTPS, SCP, FTP, or SFTP, although log-type restrictions can reduce this feature’s usefulness. However, the direct importing is hugely important when dealing with non-syslog services such as Exchange, as this process can be cumbersome without it.

In the lab, I configured an LX 2000 and an ST 3000 for log-file archiving and began blasting syslog messages at the LX 2000 from a variety of simulated sources. Using a homegrown syslog injection script, I achieved and verified the top-end 3,000 mps rate on the LX 2000. The promised 150 percent burst rate was almost spot-on as well: I maxed out at 4,450 mps, and sustained that level indefinitely. The ST 3000’s top-end rate is purported to be 50,000 mps; while I couldn’t generate enough traffic to approach that level, I did get it up to just under 10,000 mps.

In production, the LX 2000 acts as the syslog server for all local devices and periodically archives data by compressing the log data and transmitting it to the ST 3000 via TCP. This setup means you can place LX 2000s at remote sites to collect log data generated there, significantly reducing the traffic that must flow back across the WAN to the main datacenter.

Reporting Prowess

All this horsepower and back-end work is useless without good reporting tools. LogLogic’s UI includes predefined real-time and summary reports that are readily available in the navigation tree. Reports can be generated on the fly with up-to-the-minute data and can be exported as CSV, HTML, PDF, or printable layout. Summary and scheduled reports are also available.

The predefined reports are actually quite useful: pulling up a list of accepted connections from all known Cisco PIX log sources is as simple as selecting that report, choosing a single PIX (or all of them), and defining a time period. The resulting report can be dissected further with pseudo-SQL search capabilities that allow for more fine-grained reporting or drilling down to a specific event. The recently added Exchange e-mail monitoring is also a boon, with predefined reports showing e-mail usage by user activity, size, and raw SMTP communications.

I found LogLogic’s power and relative lack of complexity intriguing. I would like to see more standard log-file support, such as Linux/BSD firewall log files, Sendmail/Postfix/Exim Mail Server logs, and perhaps an interface to define custom log formats. (You can import unsupported log files, but the options for parsing and reporting are limited.) Otherwise, LogLogic’s Series 3 appliances are ready to make a molehill out of your mountain of logs....





 


 
Paul Venezia is a contributing editor at InfoWorld.
 

TOP NEWS:


»  Yahoo tells Icahn that its own board knows best
Yahoo claims that Icahn's proposal shows a 'significant misunderstanding' of how Microsoft's buyout offer was handled

»  Does Icahn have a backup plan?
Carl Icahn is trying to force Yahoo back to the bargaining table with Microsoft, but if Microsoft is no longer interested, he'll need to have other options available

»  Sprint: WiMax cleared for commercial use
Sprint has completed nearly a year's worth of testing and has now declared WiMax up to commerical deployment standards

»  Tools circulate that crack Debian, Ubuntu keys
The tools take advantage of a recently discovered vulnerability and can be used to forge digital signatures and steal confidential information

»  Facebook to Google: Friend Disconnect
Facebook cites violation of its terms of service as grounds for blocking Google's Friend Connect from accessing social network's members' data

»  U.S. to investigate semiconductor patent complaints
LSI and subsidiary Agere Systems ask ITC to bar imports by companies violating their patent for semiconductor chips containing tungsten metal




Virtualization: A Step by Step Approach to Success
Your virtual machines can be up and running in a matter of minutes. HP and Citrix have integrated XenServer with HP ProLiant servers and management tools, powered by hardware-assisted Intel Virtualization Technology to enable high- performance, cost-savings solutions for server consolidation and disaster recovery. Sponsor: HP

»  Click here to view this Webcast
  Storage is big, and getting bigger
The only certainty is that your requirement for storage will never be satisfied. While you clean out space and authorize POs, you might consider another alternative: outsourcing. The best way to deal with storage might be to let someone else deal with it. Sponsored by SGI

»  Click here to download now

- Special Advertising Partners -
WHITE PAPERS
 
  • Need simple, low cost server virtualization? - Do more with less. Support fewer servers. Simplify disaster recovery. Implement proven, easy-to-use server virtualization...
  • Virtually Limitless Virtual Storage - Do you need virtualization space savings of 50% or more with virtually no performance impact? You might be able to get storage...
  • Invisible IT? - The goal of IT is to become an invisible entity within a larger organization. Eliminating visibility and road blocks IT ...
  • It Really Is Easy to be Green - "Green IT" is a popular concept. And IT organizations are learning the influence that IT purchase decisions have on data...
  • Key Strategies For SOA Testing - SOA requires a unique approach to testing. Unless you're willing to reorient your testing procedures and technology now,...
  • Eliminate Botnet Security Risks - Botnets are widely regarded as the top threat to network security. This Whitepaper explains how botnets have traditionally...

» Technology White Papers Library

Technology White Papers by Topic

Technology White Papers E-mail Alert

Find out when the latest white paper is available:
 
 
INFOWORLD MARKETPLACE
 
» BUY A LINK NOW
 

FIND PRODUCTS AND COMPANIES
» COMPLETE PRODUCT GUIDE



TECHNOLOGY INDEX
• Applications
• Application Development
• Security
• Networking
• Wireless
• Platforms
• Hardware
• Data Management
• Storage
• Web Services
• Business
• Telecom
• Professional Services
• Standards

TECH WATCH 


What's the 411 on GOOG-411?
Just as Google has become synonymous with "performing a Web search," 411 is understood to mean "information" -- as in "what's the 411?" I was thus surprised to discover, from a billboard, no less, that the king of search is taking on the ...

Apple HTML source reveals 'iPhone Extreme'
"This one's a stretch..." reports AppleInsider. Um, yeah. Reporting on HTML code sightings of product names could be called a stretch, but iPhone Extreme has a ring to it. Now, that sounds like the product Apple should have released first, rather ...

COLUMNISTS

Unified under law
Ephraim Schwartz's Column and Blog (InfoWorld) - In the litigious world we live in, deploying a unified communications platform in your enterprise could...
» MORE COLUMNISTS

MORE INFOWORLD BLOGS


Open Sources 
Product Management
When I joined MySQL four years ago, there was quite a lot of debate about product management. We didn't actually have ...

Zero Day 
Botnet herders tending smaller flocks
New research backs up the theory that botnet operators are keeping their networks smaller in a continued effort to keep ...



• Advice Line
• Database Underground
• The Deep End
• Enterprise Mac
• Geeks in Paradise
• Grid Meter
• The Gripe Line
• InfoWorld Daily
• Inside IT
• IT Troubleshooter
• ITXtreme
• Open Sources
• ProdBlog
• Real World SOA
• Reality Check
• Security Adviser
• SMB IT
• The Storage Network
• Tech Watch
• Virtualization Report
• Zero Day

ADVERTISEMENT


RESOURCE CENTERadvertisement 

GOVERNMENT IT & POLICY
'If you don't go after the network, you're never going to stop these guys. Never.'
From the State Department, All the News for Inquiring Minds
TechPresident, the Internet Citizenry's New Consensus Taker



Sponsored Technology Links

 
 
 HOME  NEWS  BLOGS  PODCASTS  VIDEOS  TECHNOLOGIES  TEST CENTER  EVENTS  CAREERS  IT EXEC-CONNECT   About | Advertise | Awards | RSS | Contact Us 

Copyright © 2008, Reprints, Permissions, Licensing, IDG Network, Privacy Policy, Terms of Service.
All Rights reserved. InfoWorld is a leading publisher of technology information and product reviews on topics including viruses,
phishing, worms, firewalls, security, servers, storage, networking, wireless, databases, and web services.

CIO :: ComputerWorld :: CSO :: Demo :: GamePro :: Games.net :: IDG Connect :: IDG World Expo
Industry Standard :: IT World :: JavaWorld :: LinuxWorld :: MacUser :: Macworld :: Network World :: PC World :: Playlist