According to StillSecure’s tech support, the third crash was due to an incompatibility between the appliance’s Dell hardware
and the Border Guard software. The bug inadvertently causes the hard drive to become read-only, which prevents Border Guard
from logging data and thus crashes the system. This only happened once during a month of testing but could be a significant
problem. StillSecure acknowledged the bug and claims it will have a fix in the next version.
Thanks to an excellent interface, simple setup, and easy rules maintenance, Border Guard is well-suited to either the novice
or the seasoned administrator. It offers all the benefits of Snort and more, without all the headaches.
ISS Proventia G200
The Proventia G200 appliance from ISS can be deployed passively as an IDS or in-line as an IPS. Although the Proventia does
a decent job of detection, we discovered that it seems better suited as a network analysis or auditing tool.
We found installation cumbersome due to Proventia’s dependency on an external database for logging. We configured the Proventia
as a passive network device, using a span port on our network to monitor all traffic flowing into and out of our test environment.
In addition to IDS and IPS modes, the Proventia also offers an intermediate option called the “in-line simulation” mode. Here
the sensor will just send alerts about things it would normally block in IPS mode, allowing you to test IPS policies before
deployment.
In addition to setting up a separate Microsoft SQL Server database, which Proventia used as the primary repository for captured
data, we had to install a Windows client -- the SiteProtector console -- on our management workstation in order to communicate
with both the sensor and the database and to retrieve stored and correlated data. Unlike the other three competitors in this
comparison, ISS does not provide a Web management interface.
We concede that the Windows client does enhance security because it creates a strict relationship between the appliance and
the console. But it also restricts client platform options for administrators and limits the ability to distribute administrative
duties, as each console requires the management client. We’d like to have the option of using a Web management interface.
SiteProtector was easy to configure, but it’s completely dependent on the Proventia appliance and SQL Server database for
all functioning and authentication. As we found out, if the SQL Server connection is not established, the appliance simply
does not respond to console requests -- not even with an error message. ISS should incorporate a pop-up message to inform
the user when there is a problem.
This wasn’t the only usability hurdle we stumbled into. SiteProtector uses the database log-in and password combination established
by the system administrator. If novice users attempt the log-in incorrectly, they are locked out without explanation.
On the plus side, the management console is designed to handle network vulnerability data from a variety of hardware and software
sources, including ISS’ host-based distributed client, RealSecure Desktop, and its vulnerability management software, Internet
Scanner, which we reviewed last fall. The SiteProtector console also supports several other information-gathering tools, including the SiteProtector SecurityFusion
correlation engine. SecurityFusion helps you prioritize defenses against possible attacks based on other ISS product data.
We came to think of SiteProtector as a Swiss army knife of sorts.
During setup, Proventia presented us with lots of options for various network configurations. For example, we could create
a policy that was geared for specific router traffic or traffic coming from a specific subnet. But we also found creating
and managing policies to be slightly confusing and counterintuitive. Policies we created often didn’t seem to justify the
number of steps we were required to take -- or the variety of templates we had to wade through -- in order to get there.
Among all the products we reviewed, we found that Proventia put the strongest emphasis on network traffic auditing, thanks
to deeper protocol analysis capabilities than its competitors’. For example, if you had a zero-tolerance policy for FTP traffic,
Proventia could easily supply you with the information necessary to combat violations, even going as far as capturing user
names and passwords that are sent in the clear. Of course, the same auditing policy approach works with other types of traffic
such as HTTP and POP3.
Application-layer traffic filtering in Proventia is extensive out of the box. The application auditing it provides is nonexistent
in StealthWatch and would require creating custom rules in Border Guard and Snort. For example, we could filter on POP3 traffic
and inspect headers for source and destination, and we could view quite a substantial amount of information regarding the
session transaction -- even when not viewing the actual payload.
Proventia also offers a plethora of options for reporting, including the ability to collect application-specific data such
as successful FTP log-ons, Telnet users and passwords, or HTTP session information. A 3-D pie chart of current traffic activity
gives the user a quick overview and the ability to drill down into the details.

Border Guard 4.3
StillSecure, stillsecure.com
|
Excellent 8.6 |
 |
| criteria |
score |
weight |
| Threat detection |
8 |
30% |
 |
| Management |
8 |
20% |
 |
| Ease-of-use |
9 |
10% |
 |
| Scalability |
9 |
10% |
 |
| Security |
10 |
10% |
 |
| Setup |
9 |
10% |
 |
| Value |
9 |
10% |
 |
|
 |
Cost: Starts at $7,500 for device and $1,500 per year for maintenance (subscription option available)
Platforms: Management console: Windows, Internet Explorer 6 or later
Bottom Line: Border Guard brings ease-of-use, multinode management, and intrusion prevention capabilities to Snort. Installation and setup
are fast and easy, the GUI is top-notch, and reporting is excellent, removing all the difficulty of navigating Snort and displaying
attacks and payloads. An excellent choice for signature-based detection and prevention.
|
 |
About our Reviews and Scoring Methodology
|
|

Proventia G200
Internet Security Systems, iss.net
|
Very Good 7.8 |
 |
| criteria |
score |
weight |
| Threat detection |
8 |
30% |
 |
| Management |
7 |
20% |
 |
| Ease-of-use |
8 |
10% |
 |
| Scalability |
9 |
10% |
 |
| Security |
10 |
10% |
 |
| Setup |
6 |
10% |
 |
| Value |
7 |
10% |
 |
|
 |
Cost: Starts at $11,995
Platforms: SiteProtector management console: Windows 2000, Windows XP, Windows Server 2003
Bottom Line: Proventia combines signature-based detection and prevention capabilities with a depth of packet analysis unmatched by its
competitors, making it a good solution for monitoring and enforcing network policies. Time-consuming configuration and a complex
management interface, however, make Proventia less suitable as an everyday IDS.
|
 |
About our Reviews and Scoring Methodology
|
|

Snort 2.10 with ACID
Snort.org, snort.org
|
Very Good 7.3 |
 |
| criteria |
score |
weight |
| Threat detection |
7 |
30% |
 |
| Management |
6 |
20% |
 |
| Ease-of-use |
7 |
10% |
 |
| Scalability |
8 |
10% |
 |
| Security |
9 |
10% |
 |
| Setup |
6 |
10% |
 |
| Value |
10 |
10% |
 |
|
 |
Cost: Free
Platforms: Linux, 32-bit Windows, BSD, Mac OS X
Bottom Line: Snort is a free, flexible, effective rules-based IDS that is difficult to set up and not particularly user-friendly. Multisystem
management isn’t supported, and reporting and management fall short of commercial offerings. On the plus side, you can use
existing rules, which are regularly updated by an active open source community, or configure your own.
|
 |
About our Reviews and Scoring Methodology
|
|

StealthWatch 4.0
Lancope, lancope.com
|
Excellent 8.9 |
 |
| criteria |
score |
weight |
| Threat detection |
9 |
30% |
 |
| Management |
9 |
20% |
 |
| Ease-of-use |
9 |
10% |
 |
| Scalability |
9 |
10% |
 |
| Security |
10 |
10% |
 |
| Setup |
8 |
10% |
 |
| Value |
8 |
10% |
 |
|
 |
Cost: Starts at $9,995 for M45 appliance
Platforms: Web management interface: Internet Explorer 6.0 or later, Netscape 6.2 or later
Bottom Line: StealthWatch tunes into deviations in normal network traffic and host behavior, an approach that enabled it to warn of a Sasser
worm outbreak on the test network ahead of our signature-based detection systems. On the downside, networking expertise is
required to use StealthWatch effectively; novice administrators will be challenged.
|
 |
About our Reviews and Scoring Methodology
|
|