May 29, 2009

Splunk's 'by IT, for IT' approach marries Google-like search and log files

2009 InfoWorld CTO 25 Awards: Erik Swan

2009 InfoWorld CTO 25 Awards
Erik Swan
CTO
Splunk

Who would see the potential in bringing a Google-like search interface to log files? An IT person, of course -- someone who not only recognized the wealth of information hidden in logs and the need for a flexible way to unearth it, but who also understood the sophistication of the user and the need for an interface that didn't hamstring someone who knew what he was looking for and whose use case might be entirely unforeseen.

This "by IT, for IT" approach of CTO Erik Swan and his development team at Splunk has produced a software tool that is both unusually useful and uncommonly popular with the IT sophisticate in the trenches. It helps that the personal version of Splunk is free, and that Swan and his team have built a number of applications on Splunk and provided them as free downloads on the SplunkBase community site, where Swan himself takes an active role in supporting them.

Thanks to steady improvements in the SDK and the release of the Splunk API, Splunk is now emerging as a powerful application platform, hosting indexing and reporting solutions for a diverse range of systems and purposes. Splunk apps for Unix, Windows management, VMware ESX management, Snort, change management, network security, and PCI compliance have all appeared in the last 18 months. Swan even wrote a Splunk app to index all the data in social networks such as Facebook and Twitter -- just because someone might want to use it.

Splunk isn't open source software, but Swan and company's focus on creating useful free software and building a close-knit community of users and developers is reminiscent of the open source ideal. (The company charges for extended editions of the product.) For Swan, keeping his ear to the community and his hands in the technology are key. "The team knows what to develop because we have a personal commitment to the Splunk community, and an ever-growing relationship with our users," Swan says. "But just as often, we build what we want to use."

[ Discover how the lessons learned from the 2009 InfoWorld CTO 25 Award winners can help your IT efforts. ]

Doug Dineley is executive editor of the InfoWorld Test Center.
Close

On Twitter now

Application development

Powered by Twitter
additional resources
White Paper - How to Improve Delivery of Advanced Web Applications

White Paper

Virtual Workforce: The Key to Expanding The Business While Cutting Costs

Get the independent advice and expertise you need to support a virtual workforce.

Go inside:
The three-step approach to making a virtual workforce a reality.
The four flavors of client virtualization technologies.
The three key initiatives that solve IT challenges.
Download now »
White Paper: Successfully Secure Your Wireless LAN With Wi-Fi firewalls.

White Paper

Addressing Linux Threats Leveraging Fewer Resources

The increase in Linux popularity has increased the frequency and sophistication of malware attacks. Read this 2 page white paper now to learn how you can protect your Linux environment with real-time protection that is certified by all major Linux vendors.

Download now »
White Paper - The 2009 Handbook of Application Delivery

White Paper

The 2009 Handbook of Application Delivery

Ensuring acceptable application delivery will become even more difficult over the next few years. As a result, IT organizations need to ensure that the approach that they take to resolving the current application delivery challenges can scale to support the emerging challenges. This handbook elaborates on the key tasks associated with planning, optimization, management and control and provides decision criteria to help IT organizations choose appropriate solutions.

Download now »
White Paper - Is Your Backup System Outdated?

White Paper

Mid-range Storage Considerations

A common misconception is that mid-range storage requirements are dramatically different than that of a larger enterprise. Mid-range storage users may require less capacity, but they have similar functionality and management requirements. This ESG paper examines mid-range storage needs and reviews a new solution that adjusts size while retaining value, performance and functionality.

Download now »

Sign up to receive InfoWorld Resource Alerts

Subscribe to the Today's Headlines: First Look Newsletter

Find out what will be news for the day, with our first-thing-in-the-morning briefing.

©1994-2010 Infoworld, Inc.