Symantec Corporation
Symantec Endpoint Protection 12.1 vs. Trend Micro Deep Security 8
Anti-virus Performance in VMware ESXi Virtual Environments
Document number:
212117
Release Date:
07 May 2012
As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent where all security processing takes place on the client, a virtual appliance that handles the anti-virus
(A/V) workload or, possibly, some hybrid of the two approaches.
Symantec Corp. commissioned Tolly to benchmark the performance
of its new Symantec Endpoint Protection (SEP) 12.1 within VMware
ESXi 5 virtual environments vs. Trend Micro Deep Security 8.
Specifically, this testing focused on the system resource requirements
of each solution when performing on-demand and on-access
scanning, and during distributed virus definition upda
Security
|
AVG Technologies
AVG Internet Security Business Edition 2012
Ease of Management and Usability Evaluation Against Competing Security Suites for SMB Users
Document number:
212102
Release Date:
13 Mar 2012
Endpoint security is just as important for small and medium business (SMB) environments as it is for large enterprises. SMBs, though, are likely to have limited or no dedicated IT resources to manage installation and ongoing policy updates. Thus, understanding the effort required to install a solution and conduct ongoing maintenance tasks is important when choosing an endpoint security solution for SMB deployment.
Testing showed that with AVG users can save valuable time in managing their security solution -- time that can be better used to focus on their business. Testing showed that AVG is a solution that is one of the easiest-to-use for most common tasks such as running scans, installing across a small business network, etc.
Security
|
Bit9
Bit9 Parity Suite 6.0
Comparison of Bit9 Advanced Threat Solution versus McAfee Endpoint Protection Suite and Symantec Endpoint Protection 12.1
Document number:
212108
Release Date:
12 Mar 2012
Security and network operation center personnel have traditionally had few alternatives when it comes to securing endpoints and servers in their enterprise, with most solutions being some variation of the traditional antivirus blacklisting approach to security. Advanced threats which put valuable intellectual property at risk have quickly become a significant security concern for corporations.
Bit9 commissioned Tolly to evaluate leading endpoint security solutions to compare the effectiveness of traditional antivirus products and the most recent application control approach against malware and zero-day threats. The application control (whitelisting) solution tested was Bit9 Parity Suite 6.0, and the antivirus (blacklisting) solutions tested were McAfee Endpoint Protection Suite and Symantec Endpoint Protection 12.1. Testing of 5 attacks across a number of systems showed that Bit9 Parity Suite protects both Windows clients and Windows Web servers more effectively than the Symantec and McAfee endpoint solutions under test.
Security
|
Sophos Ltd.
Sophos Endpoint Security and Control v9.7: Anti-virus Performance in VMware ESX Virtual Environments
Document number:
211125
Release Date:
26 Aug 2011
As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent, where all processing for each client takes place on the client, a virtual appliance that handles the anti- virus (AV) workload or, possibly, some hybrid of the two approaches.
Sophos Ltd. commissioned Tolly to benchmark the performance of its new Sophos Endpoint Security and Control v9.7 within virtual environments. Specifically, this testing focused on the system resource requirements of the Sophos client-based agent when performing on-demand/on-access scanning and virus signature
definition update tasks.
Security
|
Symantec Corporation
Symantec Endpoint Protection 12.1 vs. McAfee and Trend Micro
Anti-virus Performance in VMware ESX Virtual Environments
Document number:
211123
Release Date:
17 Aug 2011
As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent where all processing for each client takes place on the client, an virtual appliance that handles the a/v workload or, possibly, some hybrid of the two approaches.
Symantec Corp. commissioned Tolly to benchmark the performance within virtual environments of its new Symantec Endpoint Protection 12.1 vs. comparable solutions from McAfee and Trend Micro. Specifically, this testing focused on the disk input/output requirements of each solution when performing on-access scan, on- demand scan and virus definition update.
Security
|
Network Box Corp.
M-Series M-285 Internet Security Appliance WildList Malware Detection Evaluation
Document number:
211117
Release Date:
26 May 2011
Businesses of all sizes and types need to be concerned with providing protection from malware to their user base. Irrespective of the delivery mechanism, Unified Threat Management (UTM) firewall appliances aimed at small and medium businesses should deliver immediate and ongoing protection against malware threats propagating on the Internet.
Network Box commissioned Tolly to evaluate how effectively the Network Box M-285 solution detected malware. Using malware samples from the WildList, augmented by additional samples provided by AV-Test, engineers evaluated the detection rates across the HTTP, POP3 and SMTP protocols.
Security
|
Trend Micro, Inc
Trend Micro Deep Security 7.5 vs. McAfee and Symantec
Anti-virus Performance in VMware ESX Virtual Environments
Document number:
211101
Release Date:
09 Feb 2011
Server and desktop virtualization are essential elements of any IT strategy that seeks to decrease capital and operational expenditures . In the rush to implement virtualization technologies, many organizations simply deploy the same anti-virus solution that is in use on their physical server and desktop systems. Because these traditional anti-virus solutions are not designed specifically for virtual environments, they can create significant operational issues such as anti-virus (AV) storms, resource wastage and administrative overhead, and hamper the organization’s objective of maximizing VM densities.
Trend Micro, Inc. commissioned Tolly to benchmark the performance within virtual environments of the Trend Micro Deep Security solution vs. McAfee Total Protection for Endpoint and Symantec Endpoint Protection 11.0. Specifically, this testing evaluated the impact each solution had on host system (physical server) resources especially as guest machine density increased to up to 100 virtual machines simultaneously running in a VMware ESX 4.1 environment.
Security
|
Biometric Signature ID
Biometric Signature ID - BioSig-ID 2.0 User Authentication Solution
Using Signature Gesture Biometrics Ease of Use, Enrollment, Accuracy and Protection Evaluation
Document number:
211104
Release Date:
24 Jan 2011
Single-stage password security mechanisms that act as the front door to user accounts in enterprise networks are susceptible to imposters who successfully steal legitimate user ID and password data.
To strengthen user account security, Biometric Signature ID (BioSig-ID) developed the BioSig-ID solution for Windows client workstations. The solution records a signature profile of a user’s mouse gestures while writing a code through an enrollment process, using that to validate the user during account logon. BioSig-ID uses a form of dynamic biometrics known as “signature/ gesture dynamics.”
This tokenless approach creates a second layer of account logon verification and guards against the possible use of stolen password and account data to gain entry to the network.
Tolly engineers measured the effectiveness and accuracy of the BioSig-ID solution as tested with 93 test subjects accessing their own accounts and also attempting to access 20 “victim” (other user’s accounts) after being supplied with the victims’ credentials. Over 15,000 logon attempts were monitored during the evaluation.
Security
|
|
|
|
|
NETGEAR, Inc.
ProSecure™ UTM10 Unified Threat Management Appliance: Malware Detection Evaluation Versus Fortinet, Inc., SonicWALL, Inc., and WatchGuard Technologies, Inc.
Document number:
209131
Release Date:
26 Oct 2009
NETGEAR commissioned Tolly to conduct a malware detection accuracy evaluation of the ProSecure UTM10, Fortinet FortiGate-60B, SonicWALL TZ 100, SonicWALL TZ 210 and WatchGuard Firebox Edge X55e UTM appliances.
Tests focused on the malware detection capabilities of the above mentioned UTM appliances using their default security policies, over the Web traffic and email vectors using HTTP, POP3 and SMTP protocols. Test malware samples consisted of The WildList Organization International’s latest WildList (a list of viruses and worms found propagating on the Internet) along with other major Win32 malware.
Download the free report.
Security
|
|
|
Lumension, Inc
Lumension VMS versus Microsoft WSUS: Total Cost of Ownership Comparison
Document number:
209135
Release Date:
18 Sep 2009
Lumension commissioned Tolly to evaluate the total cost of ownership (TCO) associated with managing system vulnerabilities on Windows environments and to compare that with free Windows Server Update Service (WSUS) offered by Microsoft.
Tests explored patching Microsoft and non-Microsoft applications, discovering new and/or unauthorized clients, CVE patching, software removal and other areas.
Download the free report.
Security
|
Symantec Corporation
Symantec Endpoint Protection Small Business Edition 12.0 Competitive Windows XP Performance Evaluation
Document number:
209110
Release Date:
27 Apr 2009
Symantec commissioned Tolly to evaluate the impact of endpoint security offerings designed for small businesses on PC client responsiveness.
The Tolly Group compared the Windows XP client version of Symantec Endpoint Protection Small Business Edition 12.0 against security offerings from AVG, BitDefender, Kaspersky Lab, McAfee, Inc., Sophos and Trend Micro, Inc.
The Tolly Group examined system start-up time, the impact on Microsoft Office 2007, on Internet Explorer, on local and network file operations and on the time required to decompress a file archive.
Symantec Endpoint Protection Small Business Edition 12.0 consistently delivered faster response time than competing products tested. Detailed test results are documented in a companion “Appendix” document which can be downloaded from tolly.com at Symantec appendix download.
Tests were conducted in March 2009.
Download the free report.
Security
|
Symantec Corporation
Symantec Endpoint Protection Small Business Edition 12.0 Competitive Windows XP Performance Evaluation - APPENDIX
Document number:
209110APPENDIX
Release Date:
25 Apr 2009
Symantec commissioned Tolly to evaluate the impact of endpoint security offerings designed for small businesses on PC client responsiveness.
The Tolly Group compared the Windows XP client version of Symantec Endpoint Protection Small Business Edition 12.0 against security offerings from AVG, BitDefender, Kaspersky Lab, McAfee, Inc., Sophos and Trend Micro, Inc.
The Tolly Group examined system start-up time, the impact on Microsoft Office 2007, on Internet Explorer, on local and network file operations and on the time required to decompress a file archive.
Symantec Endpoint Protection Small Business Edition 12.0 consistently delivered faster response time than competing products tested.
This appendix document contains detailed results.
Higher-level test results are documented in a companion document which can be downloaded from tolly.com at Symantec test report download.
Tests were conducted in March 2009.
Download the free report.
Security
|
Red Condor, Inc.
Red Condor Message Assurance Gateway 2700: Anti-spam Effectiveness and Feature Comparison versus Solutions From Barracuda, Cisco and Google
Document number:
209107
Release Date:
22 Apr 2009
Red Condor commissioned Tolly to evaluate the anti-spam effectiveness of its Message Assurance Gateway 2700 against competing solutions from Cisco Systems’ IronPort C150 Email Security Appliance, Barracuda Networks’ Spam Firewall 300 and Google’s Message Security powered by Postini.
Testing focused on the anti-spam effectiveness in terms of spam detection percentage, spam error percentage and false positive rate of the solutions under test during a calendar week of testing per solution, while deployed in the live corporate network of The Tolly Group.
The testing was conducted in accordance with Tolly Common Test Plan #1058, Anti-spam Gateway v1.0.
That document is available for license and you can find more information about it on the
Tolly Common Test Plan website.
Click below to download the free report.
Security
|
Open Text Connectivity Solutions Group
Évaluation: Connectivity Secure Server 1.0 d’Open Text a été comparé à Reflection for Secure IT Server 6.1 d’Attachmate, ainsi
qu’à SSH Tectia Server 6.0, de SSH Communications Security
Document number:
209100FR
Release Date:
03 Mar 2009
Connectivity Secure Server d’Open Text a nettement surclassé les serveurs SSH
espectivement conçus par Attachmate Corp. et SSH Communications Security,
offrant une vitesse de traitement supérieure et supportant une montee en charge permettant d’assurer plus de 1000 téléchargements par serveur effectués par
les utilisateurs. Ces performances lui ont permis de mettre en évidence un coût total
de possession sans correspondance avec celui offert par les produits concurrents
avec lesquels il était comparé au cours de l’essai.
Au cours de cette batterie d’essais, effectués en décembre 2008, Connectivity Secure Server d’Open Text a systématiquement surclassé Reflection for Secure IT Server d’Attachmate Corp. et le serveur SSH Tectia de SSH Communications Security. Lors des essais de transfert d’un fichier de 36 Mo d’un serveur vers un client qui en avait effectué la requête, Connectivity Secure Server a exécuté la tâche dix fois plus vite que le serveur Tectia Server de SSH et vingtquatre fois plus vite que le serveur Reflection for Secure IT d’Attachmate.
Download the free report.
Security
|
McAfee
McAfee Total Protection for Virtualization Evaluation in VMware ESX and Microsoft Hyper-V Environments
Document number:
208344
Release Date:
30 Jan 2009
McAfee, Inc. commissioned The Tolly Group to evaluate the effectiveness of McAfee Total Protection (ToPS) for Virtualization, managed by ePolicy Orchestrator (ePO) 4.0, in providing a comprehensive suite of security services to virtualized Microsoft Windows Server 2003 and Windows Server 2008 environments — online and offline — under both VMware and Microsoft’s Hyper-V server virtualization platforms.
Tolly engineers built virtual server environments using both VMware ESX Server version 3.5 and Microsoft Hyper-V. In these environments they deployed virtual instances of Microsoft’s Windows Server 2003 and Windows Server 2008. Engineers then exercised an extensive set of functions to illustrate that McAfee could provide extensive management and protection of virtual server environments in both online and offline states.
Click on the report icon to purchase the report.
Security
|
Passlogy
Passlogy - PatternPass 1000, Evaluation of Token-less PASSLOGIC One-time Password Authentication System
Document number:
208290
Release Date:
26 Jan 2009
Passlogy Co., Ltd. commissioned The Tolly Group to evaluate the PASSLOGIC token-less one-time password (OTP) authentication system running on its PatternPass 1000 appliance. The PASSLOGIC technology implemented a patented 2-way, 2-factor, one-time password authentication mechanism that does not require a dedicated hardware token.
Tests focused on the ability of Passlogy’s PatternPass 1000 appliance and PASSLOGIC system to resist security events such as brute-force attacks or random account locking attacks. Engineers also tested the compatibility of the PASSLOGIC system to work in an SSL VPN scenario, as well as using multiple portable devices like portable game devices, PDAs, mobile phones, etc. to generate the one-time password.
Download the free report.
Security
|
Open Text Connectivity Solutions Group
Evaluation: Open Text Connectivity Secure Server 1.0 vs. Attachmate Reflection for Secure IT Server 6.1 and SSH Communications Security SSH Tectia Server 6.0
Document number:
209100
Release Date:
19 Jan 2009
Open Text’s Connectivity Secure Server outperformed secure shell servers from Attachmate Corp. and SSH Communications Security, delivering superior processing speed and scaling to support over 1,000 user downloads per server which enables it to deliver a cost of ownership unmatched by rival products tested.
Open Text’s Connectivity Secure Server consistently outperformed Attachmate Corp.’s Reflection for Secure IT Server and SSH Communications Security’s SSH Tectia Server. In tests transferring a 36MB file from a server to a requesting client, Connectivity Secure Server completed the task 10X faster than SSH’s Tectia Server and 24X faster than Attachmate’s Reflection for Secure IT server.
Testing was conducted in December 2008.
Security
|
Radware Ltd.
Radware
OnDemand Switch 1 & OnDemand
Switch 2 AppDirector Version 1.06
Competitive Performance Evaluation versus F5 Networks BIG-IP 6800
Document number:
208288
Release Date:
16 Sep 2008
Radware commissioned The Tolly Group to evaluate the performance of its OnDemand Switch 1 & 2 AppDirector, the company’s nextgeneration application switch, in comparison with F5 Network’s BIG-IP 6800.
The goal was to measure performance while handling challenging tasks to determine which device offers the higher Layer 7 transaction rate and faster response time. Tolly Group engineers determined the transactions-per-second (tps) rate and the corresponding throughput and response time for 10 object sizes at Layer 7 in multiple scenarios of a single HTTP request per connection and 10 HTTP requests per connection. They also in conjunction tested the ability of the platforms to maintain performance while dealing with DDoS attack packets.
Tests were conducted in February 2008.
Download the free report.
Security
|
Radware Ltd.
Radware
OnDemand Switch 1 & OnDemand
Switch 2 AppDirector Version 1.06
Competitive Performance Evaluation versus F5 Networks BIG-IP 6400
Document number:
208287
Release Date:
16 Sep 2008
Radware commissioned The Tolly Group to evaluate the performance of its OnDemand Switch 1 & 2 AppDirector, the company’s nextgeneration application switch, in comparison with F5 Network’s BIG-IP 6400.
The goal was to measure performance while handling challenging tasks to determine which device offers the higher Layer 7 transaction rate and faster response time. Tolly Group engineers determined the transactions-per-second (tps) rate and the corresponding throughput and response time for 10 object sizes at Layer 7 in multiple scenarios of a single HTTP request per connection and 10 HTTP requests per connection. They also in conjunction tested the ability of the platforms to maintain performance while dealing with DDoS attack packets.
Tests were conducted in February 2008.
Download the free report.
Security
|
Symantec Corporation
Symantec Corporation
Symantec Endpoint Protection 11.0
vs. McAfee Total Protection for Endpoint
Performance Impact on Microsoft Office Usage
Document number:
208321
Release Date:
12 Sep 2008
Symantec Corporation commissioned The Tolly Group to evaluate the impact of two Enterprise class endpoint security offerings on host client performance: Symantec Endpoint Protection 11.0 compared with McAfee Total Protection for Endpoint. The Tolly Group installed Symantec Endpoint Protection 11.0 which provides anti-virus, anti-spyware and host intrusion prevention
functionality in a single agent against the corresponding products in the McAfee Total Protection for Endpoint Bundle.
The Tolly Group benchmarked file “open” and “save/close” times, as well as memory usage on an unprotected Microsoft Windows Vista SP1 system and compared these with execution times on the protected systems.
Tests were conducted in July 2008.
Security
|
|
|
Trustwave
Trustwave
TS-1000 High-Speed
Intrusion Prevention Appliance
IPS Performance and Security Effectiveness Evaluation
Document number:
208296
Release Date:
25 Jun 2008
Trustwave commissioned The Tolly Group to evaluate its TS- 1000 High-Speed Intrusion Prevention Appliance to determine its performance levels along with its security effectiveness.
The Tolly Group measured the Layer 3 zero-loss (0.001% acceptable packet loss) throughput and latency of the TS-1000 in firewall only mode, with intrusion prevention active, and while under attack. Engineers also measured the TS-1000’s support for concurrent TCP connections and its connection setup rate. Finally, engineers subjected the TS-1000 to a variety of security attacks and identified the product’s effectiveness at protecting servers.
Tests were conducted in March 2008.
Security
|
Cymtec
Cymtec Systems, Inc.
Cymtec Sentry™
Propagation Protection Solution
Detection Accuracy and Network Performance Evaluation
Document number:
208279
Release Date:
20 May 2008
Cymtec Systems, Inc. commissioned The Tolly Group to evaluate its Cymtec Sentry Propagation Protection Solution.
The Tolly Group examined the network performance and accuracy of the Cymtec Sentry. Tests measured throughput and latency; accuracy of threat detection; fail-over response; traffic shaping; and session limits. The Cymtec Sentry is composed of hardware appliances that are placed in specific network segments where propagation protection is required. All appliances are then managed by the Cymtec Sentry Management Console software. This controls the Cymtec Sentry Appliances installed on the network including configuration, current threats, alerts, and statistical information.
Tests were conducted in April 2008.
Security
|
McAfee
McAfee®, Inc.
TCO-evaluatie van McAfee Total Protection
Service1 in vergelijking met Symantec
Endpoint Protection Small Business Edition 11.0 en Trend Micro
Client Server Messaging Security for SMB
Document number:
208255NL
Release Date:
30 Mar 2008
McAfee, Inc. heeft The Tolly Group
opdracht gegeven de effectiviteit te
evalueren van haar McAfee Total
Protection Service - Advanced. Dit is een
SaaS-aanbod (Security as a Service) dat
uitgebreide beveiligingsvoorzieningen biedt
ter bescherming tegen virussen, spyware,
hackers en andere bedreigingen.
Technici van The Tolly Group voerden een
gedetailleerde praktijkevaluatie uit van het
serviceaanbod van McAfee en vergeleken dit
met Symantec Endpoint Protection Small
Business Edition 11.0 en Trend Micro Client
Server Messaging Security for SMB Ver 7.6.
Dit zijn traditionele softwareproducten die
hulpbronnen op locatie voor implementatie en
ondersteuning vereisen. De technici namen de
initiële implementatie, de totale
eigendomskosten (Total Cost of Ownership,
oftewel TCO), het beheer en de bruikbaarheid
van McAfee Total Protection en de twee
andere producten zorgvuldig onder de loep. De
tests werden uitgevoerd in december 2007.
Security
|
McAfee
McAfee®, Inc.
Bewertung der Gesamtbetriebskosten von
McAfee Total Protection Service1 im
Vergleich zu Symantec Endpoint Protection Small Business Edition
11.0 und Trend Micro Client Server Messaging Security for SMB
Document number:
208255DE
Release Date:
30 Mar 2008
McAfee, Inc. hat The Tolly Group damit
beauftragt, die Effektivität von McAfee
Total Protection Service – Advanced zu
bewerten. Bei diesem Produkt handelt es sich um
ein Security-as-a-Service-Angebot (SaaS), das
umfassenden Schutz vor Viren, Spyware, Hackern
und anderen Bedrohungen bietet.
Die Ingenieure von The Tolly Group führten eine
detaillierte praktische Bewertung der McAfee-
Servicelösung durch und verglichen die Ergebnisse
mit Symantec Endpoint Protection
Small Business Edition 11.0 und Trend Micro
Client Server Messaging Security for SMB Version
7,6 - herkömmlichen Softwareprodukten,
für deren Bereitstellung und Support Ressourcen
und Mitarbeiter vor Ort erforderlich sind. Die
Ingenieure unterzogen McAfee Total Protection
und die beiden anderen Produkte einer genauen
Untersuchung hinsichtlich Erstbereitstellung,
Gesamtbetriebskosten, Verwaltung und Verwendbarkeit.
Die Tests wurden im Dezember
2007 durchgeführt.
Security
|
|
|
McAfee
TCO Evaluation of McAfee Total
Protection Service vs. Symantec Endpoint
Protection Small Business Edition 11.0 and Trend Micro Client Server Messaging Security for SMB
Document number:
208255
Release Date:
27 Feb 2008
McAfee, Inc. commissioned The Tolly Group to evaluate the effectiveness of its McAfee Total
Protection Service — Advanced, a Security as a Service (SaaS) offering that provides comprehensive security to protect against viruses, spyware, hackers and other threats.
Tolly Group engineers conducted a detailed hands-on evaluation of the McAfee service offering and compared it against the Symantec Endpoint Protection Small Business Edition 11.0 and Trend Micro Client Server Messaging Security for SMB Ver 7.6, traditional software products that require on-site resources for deployment, and support. Engineers closely examined initial deployment, Total Cost of Ownership (TCO), management and usability factors of McAfee Total Protection and the two other products. Tests were conducted in December 2007.
Security
|
Intoto
iGateway Software Firewall on Intel Multi-Core UDP Throughput and HTTP Connection Rate Performance Evaluation
Document number:
208264
Release Date:
08 Feb 2008
INTOTO, Inc. commissioned The Tolly Group to evaluate the iGateway Firewall. iGateway Firewall is a software-based carrier grade/large enterprise firewall that provides high-performance and scalability while running on off-the-shelf, general purpose Intel multi-core hardware platforms. The software includes stateful inspection with packet integrity checks,
access policies, content filtering, local proxy redirection and DDoS attack prevention. Testing focused on evaluating firewall performance with stateful inspection and access policies.
Tests measured the zero-loss (≤0.001%) aggregate UDP throughput with multiple simultaneous sessions and HTTP connection rate with different policy matching for its eight-core, quad-core and dual-core systems. Tests were conducted in November 2007.
Security
|
Fortinet, Inc.
FortiMail-100™
Anti-spam Effectiveness and Feature
Comparison vs. Barracuda Networks Spam Firewall 200
Document number:
207259
Release Date:
14 Jan 2008
Fortinet, Inc. commissioned The Tolly Group to measure the effectiveness of the company’s FortiMail-100™ multi-layered E-mail security appliance at blocking
spam and virus messages.
Tolly Group engineers tested the spam detection effectiveness of the FortiMail-100 against a Barracuda Networks Spam Firewall 200. In accordance with The Tolly Group’s Fair Testing Charter, Barracuda was invited to review the test methodology, offer suggestions for its product and comment on its results.
Engineers measured the percentage of spam blocked, the number of “false positives,” “false negatives” and virus messages detected per product. Engineers also validated a number of E-mail security features and deployment flexibility. Tests were conducted in October and November 2007.
Security
|
RSA,The Security Division of EMC
RSA® DLP Network Competitive Evaluation
of Content Detection Accuracy versus Symantec
Mail Security 8240
Document number:
208282
Release Date:
10 Jan 2008
RSA, The Security Division of EMC, commissioned The Tolly Group to measure the accuracy of RSA DLP Network, a server-based appliance designed to prevent the loss of sensitive corporate data by monitoring and blocking transmissions from a corporate network.
Tests focused on measuring “recall,” the product’s ability to correctly identify all documents that contain sensitive information and “precision,” or the percentage of retrieved documents that are
sensitive and relevant. The product with the best recall offers the best protection against data loss or misuse; the product with the best precision offers ease of use and lower cost of ownership.
Engineers measured the accuracy of RSA DLP Network against Symantec Corp.’s Mail Security 8240, an appliance that merges anti-spam, anti-virus, content protection and other capabilities (with content
detection technology from Vontu, Inc.).
Tests were executed using pre-built policies for Personally Identifiable. Information (PII) and Payment Card Industry (PCI) data included in both products. Use cases were developed by an independent expert at a leading West coast university and have not been shared with the vendors. Tests focused
on identification of sensitive content. Tests were conducted in June 2007.
Security
|
Fortinet, Inc.
FortiMail-4000A™
Anti-spam Effectiveness and Feature
Comparison vs. IronPort Systems C350 E-mail Security Appliance
Document number:
207258
Release Date:
11 Dec 2007
Fortinet, Inc. commissioned TheTolly Group to measure the effectiveness of the company’s
FortiMail-4000A™ multi-layered E-mail security appliance at blocking spam and virus messages.
Tolly Group engineers tested the performance of the FortiMail-4000A against an IronPort Systems C350 E-mail Security Appliance. In accordance with The Tolly Group’s Fair Testing
Charter, IronPort was invited to review the test methodology, offer suggestions for optimal configuration of its product and comment on its results.
Engineers measured the percentage of spam blocked, the number of “false positives,” “false negatives” and virus messages detected per product. Engineers also validated a number of E-mail
security features and deployment flexibility. Tests were conducted in November 2007.
Security
|
The Tolly Group, Inc.
"Tolly Benchmarks" Vol. 6 No. 4 - Highlights of 3Com, Reflex, Procera
Networks, Nortel, Vyatta, Mirage and NETGEAR projects.
Document number:
207273
Release Date:
19 Nov 2007
Industry notables such as 3Com, Reflex, Procera
Networks, Nortel, Vyatta, Mirage and NETGEAR are featured in the October 29, 2007 issue of Tolly Benchmarks, a regular advertising supplement in Network World newspaper.
Tolly Benchmarks is open exclusively to vendors who have completed testing with The Tolly Group in the past year. The color, magazine-style supplement reaches more than 150,000 network decision makers who read Network World. This edition of Tolly Benchmarks focuses on such issues as network applications, access control, security, traffic and service management, as well as ethernet routing and switching.
Security
|
Mirage Networks
Mirage Endpoint Control™ NAC Solution Evaluation of Network Access Control for
Real-World Endpoints and Applications
Document number:
207252
Release Date:
18 Oct 2007
Mirage networks, Inc. commissioned The Tolly Group to validate the chief capabilities of the
company’s Endpoint Control network access control (NAC) solution.
Tolly Group engineers examined the Mirage Endpoint Control NAC solution (consisting of the Endpoint Control 145 Advanced Compliance Server, the Endpoint Control 245 sensor appliance and the Mirage Operations Console (MOC) management applications) for its ability to detect and restrict network access of both managed and rogue devices and applications that fail to comply with IT security and behavioral policies.
Engineers tested high-risk applications like Peer-to-Peer (P2P) file-sharing services,
Instant Messaging (IM) services, unknown or rogue devices like mobile communication devices, game consoles, personal routers and servers, that have the potential to introduce risk inside an
organization’s trusted network. Tests were conducted in September 2007.
Security
|
Tablus, Inc.
Tablus, Inc. Content Alarm NW Competitive Evaluation of Content Detection Accuracy versus Symantec Mail Security 8240
Document number:
207210
Release Date:
23 Aug 2007
Tablus, Inc. commissioned The Tolly Group to measure the accuracy of the company’s Content Alarm NW, a server-based appliance designed to prevent the loss of sensitive corporate data by monitoring and blocking transmissions from a corporate network.
Tolly Group engineers measured the accuracy of Content Alarm NW against Symantec Corp.’s Mail Security 8240. Tests focused on measuring “recall,” the product’s ability to correctly identify all documents that contain sensitive information and “precision,” or the percentage of retrieved documents that are sensitive and relevant. Tests were conducted in June 2007.
Security
|
BioPassword, Inc. (AdmitOne Security)
BioPassword, Inc. Enterprise Edition 3.2 Accuracy Evaluation of Keystroke Dynamics
Document number:
207233
Release Date:
07 Aug 2007
BioPassword, Inc. commissioned The Tolly Group to evaluate the accuracy of its BioPassword Enterprise Edition 3.2 software-based biometric authentication solution in a Windows XP business environment.
Tolly Group engineers evaluated the accuracy and effectiveness of the BioPassword solution to allow legitimate end-users to log on to their accounts without issues, while also offering high
security for Windows accounts when credentials have been shared or compromised with other users. Testing was conducted in June 2007.
Security
|
Reflex Security, Inc.
Reflex Security, Inc. MG10 Network Security System Performance Evaluation under Severe Attack Strain with No Transaction Loss and High Availability Examination
Document number:
207219
Release Date:
17 Jul 2007
Reflex Security, Inc. commissioned The Tolly Group to measure the performance of the vendor’s Reflex MG10, a network system that employs a blade-based Distributed Security Architecture™ (DSA) that provides scalable throughput from 10 Mbps to 10 Gigabit per second (Gbps).
Engineers measured the multi-Gigabit performance of the MG10, both with and without exposing the device to a serious load of security threats. Engineers also measured the number of open TCP connections sustained across the MG10, and examined how the unit responds during an invoked failure. Testing was conducted in June 2007.
Security
|
|
|
Colubris Networks
White Paper Sponsored by Colubris Networks: Evaluating Wireless IPS Systems
Document number:
207231
Release Date:
23 May 2007
This Tolly Group white paper, commissioned by Colubris Networks, Inc., focuses on the key issues users must consider when evaluating wireless intrusion prevention systems. For the report, The Tolly Group evaluated the Colubris RF Manager, a multi-faceted WIPS designed to protect enterprise network infrastructures from wireless attacks.
The Tolly Group assessed the capability of the Colubris RF Manager to detect and block a range of wireless threats — from dealing with rogue APs, to detection and prevention of access point (AP) MAC address spoofing, to detection and prevention of Denial of Service (DoS) attacks, and several others.
Tolly Group engineers measured the effectiveness of the Colubris RF Manager against two other products: AirMagnet Inc.’s AirMagnet Enterprise and Aruba Networks Aruba Mobility Controller.
Security
|
3Com Corp.
TollyEdge White Paper Series: Benchmarking Strategies for Wireless Intrusion Prevention Systems
Document number:
207216
Release Date:
19 May 2007
This comprehensive 32-page TollyEdge: Benchmarking Strategies for Wireless Intrusion Prevention Systems white paper identifies the chief factors with regards to protection, performance and ease-of-use for WIPS offerings that users need to address, and The Tolly Group offers its insights into the most practical way to benchmark these essential criteria.
The report provides unique perspectives from 3Com and AirDefense. The report aims to help readers understand the key issues they must consider, and the key metrics and processes they should employ to effectively benchmark any WIPS products.
Security
|
|
|
|
|
The Tolly Group, Inc.
TollyEdge White Paper Series: Benchmarking Strategies for Wireless Intrusion Prevention Systems
Document number:
207117
Release Date:
21 Jan 2007
This comprehensive 32-page TollyEdge: Benchmarking Strategies for Wireless Intrusion Prevention Systems white paper identifies the chief factors with regards to protection, performance and ease-of-use for WIPS offerings that users need to address, and The Tolly Group offers its insights into the most practical way to benchmark these essential criteria.
The report provides unique perspectives from AirDefense and AirTight Networks. The report aims to help readers understand the key issues they must consider, and the key metrics and processes they should employ to effectively benchmark any WIPS products.
Security
|
InfoExpress
InfoExpress Dynamic Network Access Control Competitive “Ease-of-Use” Comparison versus Cisco Network Admission Control and Cisco Clean Access
Document number:
207165
Release Date:
19 Jan 2007
InfoExpress commissioned The Tolly Group to evaluate its Dynamic NAC (DNAC) 5 versus Cisco Systemss, Inc.’s Cisco Network Access Control (NAC) 2.0 and Cisco Clean Access (CCA) 4.0.
Tests concentrated on the effort necessary – in terms of number of steps required – to deploy and maintain the NAC solutions under test, and the potential impact of each step on the existing network infrastructure. Tolly Group engineers audited the process of deploying the NAC solution in a representative network, and also documented the effort involved in performing routine maintenance of each NAC solution. Testing was conducted in November 2006.
Security
|
Enterasys Networks
Tolly Group White Paper Series Sponsored by Enterasys: Advanced Security Applications to Secure Any Network
Document number:
207187
Release Date:
18 Jan 2007
Enterasys commissioned The Tolly Group to evaluate Dragon Security Command Console (DSCC), which combines network behavior analysis, security event correlation, vulnerability profiles and directed remediation in a single platform. Engineers evaluated DSCC against the Cisco Security Monitoring, Analysis and Response System (Cisco Security MARS).
Tolly Group engineers subjected both solutions to a battery of tests in the following areas: Accuracy of threat detection, correlation of security events, data reduction, auto discovery and classification of network assets, and multivendor support. Testing took place in October/November 2006.
Security
|
Q1 Labs Inc.
Tolly Group White Paper Series Sponsored by Q1 Labs: Network Security Management for Self-Defending Networks
Document number:
206160
Release Date:
22 Nov 2006
Q1 Labs, Inc. commissioned The Tolly Group in October 2006 to conduct a comprehensive hands-on evaluation of QRadar, a Network Security Management (NSM) solution that combines network behavior analysis, security event correlation, vulnerability profiles and directed remediation in a single platform.
Tolly Group engineers evaluated the QRadar against the Cisco Security Monitoring, Analysis and Response System (Cisco Security MARS). Both solutions were subjected to a battery of tests in the following areas: Accuracy of threat detection, correlation of security events, data reduction, auto discovery and classification of network assets, and multivendor support.
Tests demonstrated that QRadar accurately detected more known attacks, as well as network anomalies, than did Cisco Security MARS. In addition, tests also showed that QRadar is particularly effective when distilling voluminous event and traffic data into manageable and readily understood summary information, with priority events flagged. The report is informed reading for any company considering networking security management.
Security
|
Viking InterWorks
Viking Interworks V 2-Gigabit VPN/Firewall Appliance Firewall/VPN Appliance Performance Evaluation
Document number:
206137
Release Date:
01 Jun 2006
Viking InterWorks, Inc. commissioned The Tolly Group to evaluate its Viking V 2-Gigabit VPN/Firewall Appliance, which employs an entirely new silicon architecture that makes it possible to protect data centers, perimeters and areas inside the LAN with minimal to no impact on throughput.
Tolly Group engineers conducted firewall and VPN throughput tests, measuring the zero-loss bidirectional performance of the Viking 2-Gigabit VPN/Firewall Appliance when subjected to a variety of packet sizes: 64, 128, 256, 512, 768, 1,024, 1,280, 1,518 bytes plus an Internet mix (IMIX) and Tolly IMIX. Tests were conducted during April 2006.
Security
|
Mirapoint, Inc.
Tolly Group White Paper Series: Exploring Exchange-Compatible Appliance-Based Messaging
Document number:
206131
Release Date:
11 May 2006
Mirapoint, Inc. commissioned The Tolly Group to build a microcosm of an enterprise E-mail environment and validate specific capabilities of the vendor’s Message Server appliance related to its ability to provide a “drop in” replacement to Microsoft’s Exchange E-mail application.
This hands-on evaluation proved conclusively that Mirapoint’s Message Server appliance can provide a viable alternative to Microsoft’s Windows-based Exchange Server mail transport application providing full functionalitiy to Outlook clients via Mirapoint’s Outlook SynQ technology while offering platform and security advantages over Microsoft Exchange.
This 23-page white paper comes complete with comparison charts that assess the compatibility of Mirapoint’s management, maintenance, integration and E-mail/calendaring features/functions with Microsoft Outlook. Plus accompanying screen shots provide a window into the Mirapoint Message Server’s “look and feel.”
Security
|
IntruGuard Devices, Inc.
IntruGuard Devices, Inc. IG2000 Rate-Based Intrusion Prevention System, Layer 2-4 DoS/DDoS Attack Mitigation and Performance Evaluation
Document number:
206129
Release Date:
03 May 2006
IntruGuard Devices, Inc. commissioned The Tolly Group to evaluate the performance of its IG2000 Rate-Based Intrusion Prevention System (RBIPS), a stateful security appliance designed to monitor bidirectional traffic, intercept DoS/DDoS floods and other anomalies such as state-anomalies, header anomalies, network scans, dark-address scans, and port scans, etc.
The Tolly Group validated the performance of the IG2000, as well as the appliance’s effectiveness at detecting and mitigating a variety of high-rate attacks at Layers 2, 3 and 4. Additionally, Tolly Group engineers measured the latency of the appliance and effectiveness under attack.
Security
|
Array Networks, Inc.
Array Networks SPX5000 SSL VPN Gateway, SSL VPN Gateway Scalability, Performance and Feature Evaluation
Document number:
206118
Release Date:
01 May 2006
Array Networks commissioned The Tolly Group to evaluate its SPX5000, a purpose-built SSL VPN access gateway that the company says is designed to extend access to remote and local users while maintaining both high security and rapid application response times.
The Tolly Group conducted a number of scalability/performance tests, as well as exercise a number of key SSL VPN features to validate key device capabilities. Engineers examined the scalability of the device in terms of the number of concurrent users supported, the aggregate throughout achieved and latency introduced by the SPX5000 and the ability of the device to work in a variety of popular environments such as Linux, Mac, Windows, Windows Mobile PDA, and Palm-based PDA.
Security
|
The Tolly Group, Inc.
TollyEdge White Paper Series: Benchmarking Strategies for Wired
Intrusion Prevention Systems (IPS)
Document number:
206115
Release Date:
27 Apr 2006
This comprehensive 26-page TollyEdge: Benchmarking Strategies for Wired Intrusion Prevention Systems white paper explains what to look for in an IPS — in terms of protection, performance, ease of use and reliability, quantifying measures and benchmarks where possible, to help you decide how much software or other tools are required to adequately protect your network.
The report provides unique perspectives from vendors such as iPolicy, Karalon, Nortel, SourceFire, and TopLayer. The report maps out the types of threats, how IPS tools are designed to deal with them, and how users can effectively benchmark IPS products to determine the best fit for enterprise security needs.
Security
|
Sana Security, Inc.
Sana Security Primary Response SafeConnect, Malware Detection and Removal/CPU and Memory Utilization
Document number:
206125
Release Date:
25 Apr 2006
Sana Security, Inc. commissioned The Tolly Group to evaluate its Primary Response SafeConnect, a software program designed for Windows-based operating systems (2000, XP) to detect and remove malicious programs.
Primary Response SafeConnect detected and removed 100% — all 183 — of the malware programs that invaded the host system from visiting 4,280 suspicious Web sites. The test results conclusively demonstrate that the program successfully accomplished its main objective — identifying and removing programs showing signs of suspicious behavior, such as trojans, rootkits, Spyware, adware and more. Engineers also measured the CPU utilization and memory utilization of Primary Response SafeConnect during peak program usage.
Security
|
Citrix Systems, Inc.
Citrix Access Gateway 4.2 with Advanced Access Control, SSL/VPN Performance Comparison versus Juniper Networks NetScreen SA-1000
Document number:
206123
Release Date:
18 Apr 2006
Citrix Systems, Inc. commissioned The Tolly Group to evaluate its Citrix Access Gateway, an SSL/VPN appliance that provides a secure, always-on, single point of access for applications and resources. The Tolly Group was asked to compare the Citrix Access Gateway performance against a Juniper Networks NetScreen SA-1000, a remote access security device serving small-to-medium-sized companies.
Tolly Group engineers performed several tests to compare each SSL/VPN appliance. The performance of running common business tasks remotely over Citrix Presentation Server 4, specifically file transfer, remote printing and PowerPoint presentations, was measured by computing the elapsed time (in seconds) and bytes sent. Lastly, Tolly Group engineers examined the effectiveness of endpoint security when a client is connected through the SSL/VPN appliance.
Security
|
Wiresoft Net, Inc.
Tolly Group White Paper Series: Securing SMB Networks Without Breaking the Bank
Document number:
206113
Release Date:
07 Apr 2006
SMBs need a multipurpose security platform that provides complete security protection. The dilemma that SMBs face today is that the IT market abounds with supplier after supplier that offer point solutions for security.
Wiresoft Net, Inc. commissioned The Tolly Group to evaluate its Wiresoft Sentry Security Suite, a versatile platform that offers a variety of security services including transparent virus scanning, challenge response spam blocking, stateful packet firewalling, VPN services (PPTP and IPSec) and more.
Tolly Group engineers conducted a battery of performance tests on the Sentry Security Suite, such as its effectiveness at blocking spam traffic, the aggregate throughput delivered while operating as a firewall, the aggregate throughput delivered across a VPN connection and the aggregate throughput while scanning Web traffic for viruses. Engineers also evaluated a number of functions, such as set up, hardware reliability and failover protection.
Security
|
Fortress Technologies, Inc
Fortress Technologies, Inc. Fortress Security Controller FC-X Encryption and Compression Performance Evaluation of Three Models (FC-1500, FC-500 and FC-250)
Document number:
206104
Release Date:
20 Mar 2006
Fortress Technologies commissioned The Tolly Group to evaluate the performance of the company’s flagship FC-X Security Controller. The Fortress FC-X is a high-performance security appliance with Gigabit Ethernet interfaces and is an integral part of the Fortress Security System designed to provide high performance, secure and reliable connectivity to wireless LANs and fixed wireless networks using Wi-MAX, free space optics, satellite, or other point-to-point links.
The Tolly Group conducted steady-state zero-loss (<0.001%) encryption and compression throughput and latency tests in two FC-X boxes for a variety of Ethernet frame sizes. The FC-X also was subjected to extensive performance tests designed to measure the scalability of the FC-X Security Controller in three selectable performance modules: FC-1500, FC-500 and FC-250.
Finally, The Tolly Group measured the zero-loss throughput in Mbps across the FC-X pair on an encrypted link for different data types (most-compressible traffic and least-compressible traffic) and various numbers of emulated clients for the three FC-X models. For the latency test, The Tolly Group measured the average Store-and-Forward latency for the least-compressible data type and a single client for the FC-1500 model only.
Security
|
Piolink, Inc
PIOLINK Application Switch 4500, Layer 4/7 Load Balancer, Firewall Performance and Worm Attack Protection Evaluation
Document number:
206111
Release Date:
16 Mar 2006
PIOLINK, Inc. commissioned The Tolly Group and TTA to evaluate the PIOLINK Application Switch 4500 (PAS 4500) for Layer 4-7 firewall and load balancing performance, and the impact of the PIOLINK Security Manager (PSM) on the performance.
The PAS 4500 is an intelligent and secure application switch that provides Layer 4-7 load balancing and application/network security with PSM. The PSM is PIOLINK's unique security system and enhances security by offloading the deep packet inspection from the PAS 4500 without imposing noticeable delays on the other traffic in the same data path.
Engineers measured the throughput of the PAS 4500 as a firewall after configuring Layer 4 filters (based on service port number) and Layer 7 filters (based on application payload signature), respectively, for various numbers of filters and frame sizes. Engineers also measured the TCP connection rate of the PAS 4500 when configured as a Layer 4 load balancer, and again as a Layer 7 load balancer. Finally, engineers measured the capability of the PAS 4500 to process legitimate HTTP and UDP traffic while blocking the attack traffic.
Security
|
AirTight Networks, Inc.
White Paper Sponsored by AirTight Networks: Evaluating Wireless IPS Systems
Document number:
206103
Release Date:
06 Feb 2006
This Tolly Group white paper, commissioned by AirTight Networks, Inc., focuses on the key issues users must consider when evaluating wireless intrusion prevention systems. For the report, The Tolly Group evaluated SpectraGuard Enterprise, a multi-faceted WIPS designed to protect enterprise network infrastructures from wireless attacks.
The Tolly Group assessed the capability of SpectraGuard Enterprise to detect and block a range of wireless threats — from dealing with rogue APs, to detection and prevention of access point (AP) MAC address spoofing, to detection and prevention of Denial of Service (DoS) attacks, and several others.
Tolly Group engineers measured the effectiveness of SpectraGuard Enterprise against two other products: AirMagnet Inc.’s AirMagnet Enterprise and Aruba Networks Aruba Mobility Controller. Tests were conducted at AirTight Networks facilities in Mountain View, CA during December 2005.
Security
|
Symantec Corporation
Symantec Gateway Security Version 3.0, Firewall Performance and Security Capability Benchmark versus Cisco ASA 5520 and Juniper NetScreen-500
Document number:
206108
Release Date:
06 Feb 2006
Symantec Corp. commissioned The Tolly Group to evaluate its Symantec Gateway Security solution, a full-inspection firewall with integrated dynamic routing and VLAN support, intrusion prevention, anti-virus, anti-spam, URL and Dynamic Document Review- based (DDR) content filtering, VPN (IPSec and SSL), and intrusion detection.
Tolly Group engineers evaluated the capability of the Symantec Gateway Security (SGS) Version 3.0 software running on a Symantec Gateway Security 5660 to identify and to block network attacks common to enterprise networks. Engineers also examined the SGS capability to isolate and to block suspicious network and audit events, and as well as block common evasion techniques used to deceive security appliances and affect end users. Additionally, engineers measured the aggregate throughput delivered by the SGS 5660 while configured to scan all traffic for attacks, as well as the connection set-up rate and the maximum number of sustained connections supported. Finally, engineers evaluated the graphical user interface (Security Gateway Management Interface) of the SGS. Tests were conducted during September and November 2005.
Engineers benchmarked the SGS appliance against a Cisco Systems, Inc. Adaptive Security 5520 appliance and a Juniper Networks, Inc. NetScreen-500 integrated firewall/IPSec VPN security appliance.
Security
|
Reflex Security, Inc.
"Talking Outside the Box": Podcast Interview with Reflex Security CTO Hezi Moore and Performance Evaluation of Reflex IPS-100 Appliance
Document number:
206101
Release Date:
31 Jan 2006
This 14-minute podcast focuses on intrusion prevention appliances. The podcast reviews the chief findings from a performance evaluation of Reflex Security Inc.’s IPS-100 intrusion prevention appliance.
In addition, Kevin Tolly, President/CEO/Founder of The Tolly Group interviews Reflex Security CTO Hezi Moore on the issues users face when deploying IPS appliances and achieving optimal performance.
Details of the test can be found in document 205136.
Click below to download the "podcast" MP3 audio file.
Security
|
Verso Technologies, Inc. (TeleMate.Net Software)
Verso Technologies, Inc. NetSpective M-Class Content Filter, Content Filter Evaluation for Skype Traffic
Document number:
206105
Release Date:
24 Jan 2006
Verso Technologies, Inc., a global provider of carrier and enterprise solutions, commissioned The Tolly Group to evaluate the NetSpective® M-Class Content Filter, an intelligent signature-based filtering device that maximizes network performance and security by filtering unauthorized or potentially harmful traffic according to user profiles defined by an administrator.
Tolly Group engineers subjected the NetSpective appliance to a test that measures the device’s effectiveness at blocking Skype™ traffic during the login process without affecting other benign traffic or authorized VoIP traffic (i.e. Net2Phone) passing through a test network.
The Tolly Group also examined the capability of the NetSpective appliance to monitor a constant traffic flow in excess of 3 Gbps while still blocking Skype login processes and allowing other VoIP traffic (i.e. Net2Phone) to pass unencumbered.
Security
|
Future Systems, Inc.
Future Systems, Inc. FSC2003 SoC (System on a Chip) in Future Systems RenoGate, Firewall and VPN Performance Evaluation
Document number:
205147
Release Date:
15 Jan 2006
Future Systems, Inc. commissioned The Tolly Group/TTA (Telecommunications Technology Association) to evaluate its FSC2003 System on Chip (SoC) residing in RenoGate, a Fast Ethernet firewall and VPN appliance.
TTA/TTG benchmarked the bidirectional steady-state zero-loss ( 0.001%) firewall and VPN throughput across two Fast Ethernet interfaces when RenoGate equipped with FSC2003 SoC operated as a firewall or a VPN gateway.
Security
|
Reflex Security, Inc.
Reflex Security IPS100 Intrusion Prevention Appliance, Performance, Security and Usability Evaluation
Document number:
205136
Release Date:
20 Nov 2005
Reflex Security, Inc. commissioned The Tolly Group to test the Reflex IPS100 network intrusion prevention appliance. The Reflex IPS blocks a comprehensive range of malicious traffic, including HTTP attacks, Denial-of-Service attempts, scans, backdoor exploits, floods, viruses, and worms. The Tolly Group validated the performance of the Reflex IPS, as well as the appliance’s effectiveness at detecting and preventing a variety of attacks. The Tolly Group also evaluated the system’s reliability, reporting and ease of use.
Tolly Group engineers conducted a battery of performance tests, focusing on HTTP throughput across the Reflex IPS appliance under normal conditions, and when subjected to attack traffic generated by Blade Software IDS Informer. They also performed a security test to measure the number of IDS Informer attacks blocked by the Reflex IPS100 while handling HTTP traffic in the background, and tests were also conducted to verify that the Reflex IPS100 appliance could block E-mails infected with worms and virus.
Security
|
Nortel
Nortel Secure Router 3120, Competitive Performance Evaluation versus Cisco Systems ISR 2821 and ISR 3825
Document number:
205146
Release Date:
01 Nov 2005
Nortel commissioned The Tolly Group to evaluate its Secure Router 3120, a wide-area network router with integrated network services such as Quality of Service, Network Address Translation and Access Control Lists.
Tolly Group engineers measured the multilink Point-to-Point Protocol (PPP) zero-loss throughput of the Nortel Secure Router 3120 with Quality of Service (QoS),Network Address Translation (NAT) and Access Control List (ACL) features enabled. Nortel also directed The Tolly Group to evaluate the Nortel 3120 versus a Cisco Systems 3825 Integrated Services Router and 2821 Integrated Services Router. Testing was performed in September/October 2005.
Test results show that the Nortel Secure Router 3120 delivers superior throughput for the majority of packet sizes tested, especially with regards to smaller packet sizes (64 bytes to 256 bytes), generally delivering up to 4X greater throughput than the Cisco devices tested.
Security
|
Check Point Software Technologies Ltd.
SSL VPN Gateways: Delivering Superior ROI with Integrated Security - JAPANESE VERSION
Document number:
205132JP
Release Date:
12 Oct 2005
Check Point commissioned The Tolly Group to validate the security and functionality claims the company has made concerning the Connectra SSL/VPN appliance. In total, 13 tests were conducted in August 2005 at a Check Point lab in Tel Aviv, Israel, and validated on-site by Tolly Group personnel.
Check Point’s Connectra NGX was tested against three other SSL VPN products: F5 Networks, Inc.’s FirePass 1000, Cisco System Inc.’s VPN Concentrator 3005 and Juniper Networks, Inc. NetScreen-SA 1000. Tests show that Check Point’s Connectra NGX offers much greater depth of protection over SSL VPN links than any of the other three products. Connectra was the only product to pass all of the tests.
Tests results underscore a basic philosohical difference in the architectures of the tested products. Check Point integrates endpoint security with extensive gateway-based security facilities that focus on protecting the network transport, guard against application attacks and protect backend Web servers and applications from network-borne threats. Other products tested provide just basic SSL VPN connectivity.
Japanese translation of Tolly Group document 205132. If there are any issues between the two documents, the English language document takes precedent.
Security
|
Check Point Software Technologies Ltd.
SSL VPN Gateways: Delivering Superior ROI with Integrated Security
Document number:
205132
Release Date:
12 Oct 2005
Check Point commissioned The Tolly Group to validate the security and functionality claims the company has made concerning the Connectra SSL/VPN appliance. In total, 13 tests were conducted in August 2005 at a Check Point lab in Tel Aviv, Israel, and validated on-site by Tolly Group personnel.
Check Point’s Connectra NGX was tested against three other SSL VPN products: F5 Networks, Inc.’s FirePass 1000, Cisco System Inc.’s VPN Concentrator 3005 and Juniper Networks, Inc. NetScreen-SA 1000. Tests show that Check Point’s Connectra NGX offers much greater depth of protection over SSL VPN links than any of the other three products. Connectra was the only product to pass all of the tests.
Tests results underscore a basic philosohical difference in the architectures of the tested products. Check Point integrates endpoint security with extensive gateway-based security facilities that focus on protecting the network transport, guard against application attacks and protect backend Web servers and applications from network-borne threats. Other products tested provide just basic SSL VPN connectivity.
Security
|
NETASQ
NETASQ F2000 IPS-Firewall Multiservice Security Appliance Performance Evaluation
Document number:
205120
Release Date:
10 Jul 2005
NETASQ commissioned The Tolly Group to evaluate the NETASQ F2000 IPS-Firewall, a purpose-built network security appliance that combines real-time intrusion prevention, firewall service, IPSec virtual private networking (VPN), clientless SSL VPNs, advanced content filtering, anti-spam, anti-virus and other integrated security services.
Tolly Group engineers focused testing on the performance of the NETASQ F2000 using a mostly default configuration, measuring the device’s zero-loss throughput (while IPS services were active), benchmarking latency introduced by the device under varying traffic loads and conditions. (In its default state, the NETASQ F2000 enables protocol analysis and signature and port-scan detection, among other IPS capabilities.) Tests were conducted at The Tolly Group’s Boca Raton, FL. facilities in May 2005.
Security
|
Symantec Corporation
Symantec Network Security 7160 Intrusion Prevention Appliance Performance Evaluation
Document number:
205111
Release Date:
23 Jun 2005
Symantec Corp. commissioned The Tolly Group to evaluate its Symantec Network Security 7160, an eight-port Gigabit Ethernet security appliance that offers intrusion protection while delivering throughput in excess of 1 Gbps.
Tolly Group engineers evaluated the capability of the Symantec Network Security 7160 to detect and block network attacks and threats common to enterprise networks. Engineers also examined the Symantec Network Security 7160’s capability to detect and block suspicious network threats and security risks /audit events. Next, engineers tested the ability for the Symantec Network Security 7160 to continue to block threats when common and advanced evasion techniques were used to deceive the security appliance and affect end users. Additionally, engineers measured the aggregate throughput delivered by the Symantec Network Security 7160 while configured to scan all traffic for attacks, as well as the connection set-up rate and the maximum number of sustained connections supported. Finally, engineers evaluated the management capabilities and ease of use for the Symantec Network Security 7160. Tests were conducted in March 2005.
Security
|
Radware Ltd.
White paper: Measuring Key Criteria of Intrusion Prevention Systems
Document number:
205114
Release Date:
20 Jun 2005
Radware, Inc. commissioned The Tolly Group to evaluate its DefensePro 3000, an intrusion prevention switch with DoS protection that combines bandwidth management for attack isolation and traffic shaping to offer enterprise and carrier networks protection against a diverse range of network- and application-level attacks.
The aim of the testing was to evaluate the DefensePro 3000 to determine that it delivers the advanced IPS requirements users need to combat today’s sophisticated security threats.
Tolly Group engineers examined the performance of the DefensePro 3000 in various scenarios to understand the maximum throughput offered by the switch while it actively handled various attacks and processed signature loads. Engineers also evaluated the manner in which the DefensePro 3000 was able to detect and block attacks that utilized common evasion techniques and engineers examined a facility that restricts bandwidth to background applications that otherwise could interfere with strategic application traffic. Finally, The Tolly Group examined a capability of the DefensePro 3000 to implement protection options for different segments of supported networks. Tests were conducted in April 2005 at Radware facilities in Israel.
Also see document 205112.
Security
|
Nortel
Nortel VPN Gateway 3070 SSL VPN Throughput, Scalability and Voice Quality Benchmark Evaluation
Document number:
205113
Release Date:
02 Jun 2005
Nortel commissioned The Tolly Group to evaluate the Nortel VPN Gateway 3070, an enterprise-class device that combines support for IPSec and SSL VPNs into a single device.
Tolly Group engineers benchmarked the throughput of the Nortel VPN Gateway 3070, examined the limits of the device’s scalability and identified the extent of voice quality supported by the gateway. Testing was performed at The Tolly Group's Boca Raton, Fl., facilities in March 2005.
Tests show that the Nortel VPN Gateway 3070 delivers consistent throughput when tested across workgroups scaling from 10 users, to 5,000 users. Scalability tests show that even as the number of users scales to 5,000, the device does not sacrifice significant throughput. Finally, the Nortel VPN Gateway 3070 yielded toll-quality voice during tests focusing on voice quality.
Security
|
Radware Ltd.
Radware, Inc. DefensePro 3000 Throughput Benchmark and Attack Mitigation Evaluation
Document number:
205112
Release Date:
31 May 2005
Radware, Inc. commissioned The Tolly Group to evaluate its DefensePro 3000, an intrusion prevention switch with Denial of Service (DoS) protection that combines bandwidth management for attack isolation and traffic shaping to offer enterprise and carrier networks protection against a diverse range of network- and application-level attacks.
Tests show that the DefensePro 3000 is adept at identifying and blocking attacks with zero instances of false positives while simultaneously handling multi-Gigabit traffic loads. From a performance standpoint, the DefensePro 3000 was able to handle 2.5 Gbps of “real-world” throughput while simultaneously handling either a 40,000-packet per second (pps) worm attack, a 200-Mbps SYN Flood attack or a 100-Mbps DoS attack. Tests also show the DefensePro 3000 is capable of protecting Secure Sockets Layer (SSL) data and can isolate attacks to protect mass mailings and control P2P traffic.
Security
|
Nortel
White Paper – Building a World-Class VPN Solution to Meet Today’s Needs — and Tomorrow’s
Document number:
205103
Release Date:
09 May 2005
This Nortel-focused white paper examines the market trends shaping the adoption of Secure Socket layer (SSL) VPNs, and specifically how Nortel is approaching the market with its VPN Gateway 3070.
Nortel commissioned The Tolly Group in January 2005 to build a hypothetical enterprise environment in which to implement and benchmark the Nortel VPN Gateway 3070, which delivers integrated support for IPSec and SSL VPNs. The goal of this paper is to educate readers about the types of SSL VPN functionality that will be critical in the selection of products and migration to the new technology. Readers will learn the primary functions that should be available in an SSL VPN gateway.
Tolly Group engineers certified the feature/functionality of a series of strategic SSL VPN capabilities in the Nortel VPN gateway 3070, including: basic VPN access, privileged-based access, enhanced clientless access, portal access, scalability and service partitioning.
The Tolly Group also performed SSL VPN throughput tests on the VPN Gateway 3070, subjecting it to tests with either the RC4-MD5 encryption or the much more complex DES-CBC3-SHA (Triple DES) encryption. Further, engineers examined the ability of the VPN Gateway 3070 to handle voice/data convergence by measuring the quality of voice over IP (VoIP) calls placed across the gateway.
Security
|
Internet Security Systems, Inc. (IBM)
Internet Security Systems Proventia Intrusion Prevention Appliance G2000 Throughput, Latency and Failover Performance Evaluation
Document number:
205110
Release Date:
12 Apr 2005
Internet Security Systems Inc. commissioned The Tolly Group to evaluate the performance of its Proventia Intrusion Prevention Appliance G2000, a security appliance designed to monitor all inbound traffic, intercept attack traffic and other security threats and block the attacking stream so it does not reach intended targets. The Proventia G2000 is an eight-port device capable of supporting four monitoring segments with two ports dedicated to each segment. The appliance came with two 10/100/1000 Ethernet management ports and has an advertised throughput of 2 Gbps.
Tolly Group engineers measured the zero-loss Layer 2 bidirectional throughput of the Proventia G2000, as well as the latency of the appliance. In addition, engineers measured the TCP performance in terms of the sustained new connection rate and the maximum simultaneous connections supported. Lastly, Tolly Group engineers evaluated the effectiveness of the Proventia G2000 at thwarting certain Denial of Service (DoS) attacks that otherwise could impact network performance adversely. Tests were conducted in March 2005.
Tests show that the Proventia G2000 is able to deliver network performance on par with typical network switching devices, meaning its presence will not degrade network throughput when it is deployed in an enterprise network. Tests show the Proventia G2000 delivers between 2 Gbps and 5 Gbps of Layer 2, bidirectional, zero-loss throughput (depending on frame size), along with low latency. Moreover the appliance processes TCP connections at rates that are necessary to support scalable enterprise applications and also help repel DoS attacks. Finally, tests show the Proventia G2000 repels DoS, Nimda and Blaster attacks on one network segment without compromising the throughput rate of normal application traffic traversing a second network segment. In essence, good traffic on one network segment remains unaffected by attack traffic that is isolated on a second network segment.
Security
|
SECUi.COM Corp.
SECUi.COM NXG 2000 Evaluation of Gigabit Ethernet Firewall & VPN Performance
Document number:
205102
Release Date:
27 Feb 2005
SECUi.COM Ltd. commissioned The Tolly Group through its South Korean affiliate TTA (Telecommunications Technology Association) to test its NXG 2000, a Gigabit Ethernet firewall & VPN appliance.
TTA/TTG benchmarked the maximum TCP session rate when the NXG 2000 is operated in firewall mode only. The Spirent Communications SmartBits SMB-6000 (Testing S/W: Websuite/ Firewall) was used to establish the TCP connections and to measure the maximum session rate.
TTA/TTG also benchmarked the bi-directional steady-state zero-loss (0.1%) UDP throughput under multiple rules and UDP sessions when the NXG 2000 was operated in firewall or VPN mode respectively. For VPN throughput testing, engineers utilized a variety of frame sizes (64, 128, 256, 512, 1,024, and 1,400 bytes) generated using the SmartBits SMB-6000 (Testing S/W: SmartFlow) equipped with two Gigabit Ethernet interfaces. The VPN test was run three times and the final result was an average of the three test iterations. For the firewall throughput testing, engineers utilized frame sizes of 64, 128, 256 bytes; all frames were generated using same Spirent Communications SmartBits SMB-6000 that was utilized in the VPN throughput test.
Tests show that the NXG 2000 processes up to 83,400 TCP sessions/sec in Layer 2 firewall mode, up to 56,200 TCP sessions/sec in Layer 3 firewall mode. Moreover, the NXG 2000 forwards up to 1,923 Mbps and 1,907 Mbps of bi-directional, zero-loss throughput for a single VPN tunnel and 5,000 VPN tunnels respectively when tested with 1,400-byte frames.
Security
|
Check Point Software Technologies Ltd.
White Paper: Improving Security ROI via an Integrated Application Security Solution
Document number:
205101
Release Date:
23 Feb 2005
Check Point Software Technologies, Inc. commissioned The Tolly Group to conduct a series of tests that demonstrate the effectiveness of the company's Application Intelligence within the Check Point VPN-1 NG Series firewall compared to other offerings and how they handle threatening security exploits. Check Point believes its Check Point VPN-1 NG Series firewall is the only perimeter security gateway to provide protection for the entire perimeter environment -- without requiring the purchase and deployment of a second standalone "intrusion protection" device.
Engineers tested the security attributes of Check Point VPN-1 NG firewall against a Cisco PIX 515E and a Juniper Networks NetScreen-204. The Check Point, Cisco and Juniper security solutions went through 17 rigorous tests that exposed them to a variety of common application-level exploits including SSL, SQL and HTTP-based vulnerabilities. Tests demonstrated that while Cisco’s and Juniper’s solutions are response-based, meaning that they rely on pre-defined signatures to defeat attacks, Check Point’s solution is proactive, protecting the network against attacks before they even occur.
Tests show that the Check Point VPN-1 NG Gateway offers greater depth of protection in comparison to Cisco and Juniper products tested, and also provides application-level security for a greater number of protocols including SQL, HTTP, HTTPS, SOCKS, IPSec, BGP, OSPF, and RIP. Moreover, the Check Point gateway offers integrated IPS, firewall and VPN capabilities in a single device, unlike the rival products that steer users to a companion security device. Finally, the Check Point VPN-1 NG Gateway offers a significant total cost-of-ownership advantage.
Please note that this is a large document - close to 2MB. A shorter version of this document is available, without the 30+ page appendix, from the Check Point web site.
Security
|
Nokia Enterprise Solutions
Nokia Enterprise Solutions Nokia IP2250 Competitive Performance Evaluation versus Juniper Networks NetScreen-5400 - JAPANESE VERSION
Document number:
204150JP
Release Date:
04 Dec 2004
Nokia Enterprise Solutions commissioned The Tolly Group to evaluate its Nokia IP2250 Security Platform, a diskless network processor-based platform that runs the Check Point VPN-1 NG with Application Intelligence firewall. The Nokia IP2250 was tested against a Juniper Networks NetScreen-5400.
Both devices were tested in a number of areas, including firewall throughput using various packet sizes ranging from the taxing 64-byte packets to 1,518-byte packets; VPN throughput, as well as per-second connection and session rates.
Test results show that the Nokia IP2250 outperformed the NetScreen-5400 in every test, offering up to twice the firewall throughput, more than three times the mixed traffic throughput and nearly five times the session rate of the NetScreen-5400. Tests were conducted from August to October 2004.
Click the link below.
Security
|
Nokia Enterprise Solutions
Nokia Enterprise Solutions Nokia IP2250 Competitive Performance Evaluation versus Juniper Networks NetScreen-5400
Document number:
204150
Release Date:
04 Dec 2004
Nokia Enterprise Solutions commissioned The Tolly Group to evaluate its Nokia IP2250 Security Platform, a diskless network processor-based platform that runs the Check Point VPN-1 NG with Application Intelligence firewall. The Nokia IP2250 was tested against a Juniper Networks NetScreen-5400.
Both devices were tested in a number of areas, including firewall throughput using various packet sizes ranging from the taxing 64-byte packets to 1,518-byte packets; VPN throughput, as well as per-second connection and session rates.
Test results show that the Nokia IP2250 outperformed the NetScreen-5400 in every test, offering up to twice the firewall throughput, more than three times the mixed traffic throughput and nearly five times the session rate of the NetScreen-5400. Tests were conducted from August to October 2004.
Click the link below.
Security
|
Inkra Networks Corp.
Inkra Networks Inkra 1504GX and Inkra 1518TX Virtual Service Switch Fast Ethernet/Gigabit Ethernet Security Performance Evaluation
Document number:
204130
Release Date:
03 Dec 2004
Inkra Networks commissioned The Tolly Group to evaluate the performance of the Inkra 1504GX and 1518TX Virtual Service Switches (VSS). The Inkra 1500 Series switches offer an all-in-one real-time security device that offers firewall, intrusion prevention, VPN, SSL and load-balancing services in a single platform.
The Inkra 1504GX is designed for backbones and high-speed applications and supports up to 4 Gbps of aggregate throughput across four GBIC interfaces. The Inkra 1518TX combines high-density Fast Ethernet and Gigabit Ethernet (GbE) uplinks to support multiple server farms and high-speed applications. The Inkra 1518TX comes equipped with up to 16 Fast Ethernet ports and two Gigabit Ethernet ports.
Tolly Group engineers measured the bidirectional zero-loss firewall throughput rates, plus the Layer 7 transaction processing throughput rate of both devices. Tests were conducted in May 2004.
Security
|
Top Layer Networks
Top Layer Networks Attack Mitigator IPS 5500 IPS Evaluation versus TippingPoint UnityOne-2400
Document number:
204146
Release Date:
02 Dec 2004
Top Layer Networks, Inc. commissioned The Tolly Group to evaluate its Attack Mitigator IPS 5500, an intrusion prevention system designed to stop network-based threats while allowing legitimate transactions to complete.
The Tolly Group evaluated the effectiveness of the Attack Mitigator IPS 5500 at dealing with single-protocol and mixed-protocol Distributed Denial-of-Service (DDoS) SYN flood attacks. Moreover, engineers examined the capability of the Attack Mitigator IPS 5500 to handle real-time identification and blocking of embedded worms when mixed in otherwise normal traffic. Tests focused on the capability to filter such traffic while monitoring what, if any, degradation that screening caused to the IPS’ connection rate.
Engineers conducted these tests on the Attack Mitigator IPS 5500 and compared the results to a TippingPoint Technologies Inc. UnityOne-2400 IPS. In every test case the Top Layer IPS5500 outperformed the UnityOne-2400. Tests show the IPS5500 is up to 82.5% more effective at blocking embedded worm attacks than the UnityOne-2400 during tests with worms infecting from 10% to 50% of traffic. Tests also demonstrate that the IPS5500 completes 100% of HTTP and mixed protocol connections attempted while under SYN flood attack. Tests were conducted in October 2004.
Security
|
Aruba Wireless Networks
Aruba Wireless Networks’ Aruba 5000 WLAN Security System Competitive Security Evaluation
Document number:
204144
Release Date:
22 Nov 2004
Aruba Wireless Networks commissioned The Tolly Group to evaluate its Aruba 5000 WLAN switch that combines 10/100/1000 Mbps Ethernet switching with stateful LAN-speed firewalling, VPN concentrator features and a variety of wireless security services.
Tolly Group engineers exposed the Aruba 5000 switch to three security scenarios to determine its effectiveness at securing communications between the switch and various access points (APs). The Aruba 5000 was subjected to a secure voice test, a variant of the “man-in-the-middle” attack, and wireless intrusion prevention scenario.
Aruba asked The Tolly Group to compare the security features/functions of the Aruba 5000 against the Airespace 4012 WLAN switch. Airespace threatened legal action if The Tolly Group tested its product without explicit permission which it ultimately declined to give. The Tolly Group did not test the Airespace 4012 but instead relied upon publicly available information and on-the-record Airespace comments to make comparisons between the products.
In every test instance, the Aruba 5000 demonstrated its security effectiveness. The Tolly Group also validated more than 20 key functions on the Aruba 5000 WLAN switch under its Tolly Verified certification program.
Click the link at the bottom of the page to download the Test Summary document. Click here to download the document containing Airespace's official statement
Security
|
iPolicy Networks
iPolicy Networks-6420 Competitive Performance Evaluation versus Fortinet FortiGate-3600 Anti-Virus Firewall
Document number:
204138
Release Date:
14 Oct 2004
iPolicy Networks commissioned The Tolly Group to evaluate and compare its iPolicy-6420 Intrusion Prevention Firewall with Fortinet’s FortiGate-3600 anti-virus firewall. Both devices are multifunction security appliances designed to protect data networks from a wide range of security threats with no compromise to network performance. Both products are marketed to service providers and large enterprises.
Tests focused on three main functional areas: UDP frame loss, TCP/UDP per-second connection rate, and the ability to establish new connections per second when the device already has a large number of connections active. Tests were conducted during August 2004.
The iPolicy-6420 consistently delivered high performance in every test scenario, even with a range of security applications running. That was not the case with the FortiGate-3600; it demonstrated significantly high frame loss, significantly lower TCP/UDP connection rates, and was barely able to complete any transactions successfully under such test scenarios.
Security
|
Intel Corporation
Intel Corp. IXP425 Network Processors, Performance Analysis of VPN Devices
Document number:
204132
Release Date:
23 Jul 2004
Intel Corp. commissioned The Tolly Group to benchmark the performance of several commercially available VPN gateways that utilize the Intel® IXP425 network processor, and compare the performance of those devices against other, generally available products based upon alternative chipsets.
The Tolly Group conducted performance tests to validate the Layer 2 throughput of various VPN devices focusing on the CPU/NPU performances using Spirent’s SmartFlow and TeraVPN applications running on a SmartBits 6000B. As expected, the two SmartBits applications reported slightly different throughput results, but they both produced very consistent and similar performance trends for all the devices under test. The best performers in the SmartFlow test were also the best ones in the TeraVPN test. This also proves the integrity and validity of the test.
Among the devices tested, the Intel IXP425-based products outperformed the alternative chipset-based devices (Broadcom BCM4702, Motorola MPC860P, etc) in every scenario.
Security
|
Astaro Corp.
Measuring the Value of Integrated Perimeter Security, A White Paper Commissioned by Astaro Corp.
Document number:
204128
Release Date:
01 Jul 2004
This hands-on study measures the time to deploy and manage an integated security solution versus two “best-of-breed” alternatives.
Engineers compared Astaro Security Linux versus two solution sets, one anchored by Juniper Networks (formerly NetScreen Technologies Inc.) firewall/VPN products, and the other anchored by Check Point Software Technologies, Inc. firewall offerings. Both solutions utilized anti-virus and anti-spam software from Trend Micro Devices, Inc. and URL/content filtering software from Websense, Inc.
These test exercises were intended to compare the effort and complexity required to deploy and to manage a comprehensive perimeter security solution for a typical medium-sized business for a period of 12 months.
The results were quite dramatic. The “best-of-breed” combinations took more than 3X as long to deploy and to configure. On an ongoing basis, the best-of-breed solutions required 2X to 2.5X more effort to manage than the integrated solution.
Click the link at the bottom of the page for the English version. A German version is also available.
Click here to download the German version of the complete White Paper
Security
|
Aventail Corp.
Aventail Competitive SSL VPN Feature Analysis Versus F5 Networks FirePass 1000 and Juniper Networks NetScreen-SA EA150 - JAPANESE VERSION
Document number:
204133JP
Release Date:
25 Jun 2004
Aventail Corp. commissioned The Tolly Group to evaluate its Aventail® EX-1500, an SSL VPN appliance that provides users with clientless access from any PC with Internet access to the network applications and resources they need to be productive. The Tolly Group examined the feature/functionality of the EX-1500 versus F5 Networks FirePass 1000 and Juniper Networks NetScreen EA-150, both SSL VPN appliances.
Tolly Group engineers compared the feature/functionality of the three SSL VPN products in three categories: Access control policy, end-point security and system security. All three products were subjected to a battery of feature validation tests as defined under The Tolly Group’s Tolly Verified certification program. Engineers examined the products during May and June 2004.
Tolly Group engineers found that the Aventail EX-1500 offers the most robust set of features/functions of the three products. On the access control side, the EX-1500 supported all nine of the features engineers examined, and even when other vendors matched the feature availability, the EX-1500 offered more robust functionality that makes management simpler
Japanese translation of Tolly Group document 204133. If there are any issues between the two documents, the English language document takes precedent.
Security
|
Aventail Corp.
Aventail Competitive SSL VPN Feature Analysis Versus F5 Networks FirePass 1000 and Juniper Networks NetScreen-SA EA150
Document number:
204133
Release Date:
25 Jun 2004
Aventail Corp. commissioned The Tolly Group to evaluate its Aventail® EX-1500, an SSL VPN appliance that provides users with clientless access from any PC with Internet access to the network applications and resources they need to be productive. The Tolly Group examined the feature/functionality of the EX-1500 versus F5 Networks FirePass 1000 and Juniper Networks NetScreen EA-150, both SSL VPN appliances.
Tolly Group engineers compared the feature/functionality of the three SSL VPN products in three categories: Access control policy, end-point security and system security. All three products were subjected to a battery of feature validation tests as defined under The Tolly Group’s Tolly Verified certification program. Engineers examined the products during May and June 2004.
Tolly Group engineers found that the Aventail EX-1500 offers the most robust set of features/functions of the three products. On the access control side, the EX-1500 supported all nine of the features engineers examined, and even when other vendors matched the feature availability, the EX-1500 offered more robust functionality that makes management simpler.
Security
|
14 South Networks
14 South Security Appliance Card Performance Functionality Evaluation
Document number:
204119
Release Date:
26 Mar 2004
14 South Networks commissioned The Tolly Group to evaluate its Security Appliance Card™ and determine that the device can operate within a host server without any undue impact on the host performance or resident applications. For this test, the Security Appliance Card was running Check Point Software’s VPN-1/FireWall-1 Next Generation with Application Intelligence security software.
Testing illustrated that 14 South’s SAC, while physically resident in the test server, functions independently from that server. Similarly, tests showed that the presence of the SAC had “zero impact” on the operation and performance of the test server.
Tests also identified the Gigabit Ethernet Firewall and Fast Ethernet VPN performance of the SAC when tested at various frame sizes.
Security
|
Analog Devices, Inc.
Fusiv-Vx200 Competitive Routing, Firewall and VPN Performance Analysis
Document number:
204117
Release Date:
19 Mar 2004
Analog Devices, Inc. (ADI) commissioned The Tolly Group to benchmark the performance of the ADI Fusiv-Vx200 network processor, implemented in a reference platform, and compare that performance with commercially available products based upon rival chipsets. The ADI Fusiv-Vx200 was tested against a Linksys WRV54G broadband access router with an embedded Intel Corp. IXP425 network processor, a NetScreen Technologies, Inc. NetScreen-204, and a Texas Instrument’s TNETV2020 as implemented by Nippon Telegraph & Telephone East Corp.’s WebCaster V100.
Tolly Group engineers used the industry-accepted Spirent SmartFlow test suite to gauge the Fast Ethernet firewall and VPN throughput of the devices. Testing was performed in February 2004.
Test results show that the ADI Fusiv-Vx200 exceeds or matches the throughput of the other devices tested in both firewall and “mixed” VPN (i.e., ADI communicating to the other vendor’s device) throughput tests. Tests also illustrated that the ADI Fusiv-Vx200 can continue processing traffic when the main CPU is taken offline.
The full report is available via the link at the bottom of the page. Click here to download a one page summary document
Security
|
Inkra Networks Corp.
Inkra Networks 4000 Virtual Service Switch Multi-Gigabit, Multi-Services Switch Functionality Evaluation
Document number:
204107
Release Date:
11 Feb 2004
Inkra Networks commissioned The Tolly Group to evaluate its Inkra 4000 Virtual Service Switch (VSS), a 14-slot chassis-based device that supports multiple virtual services, including firewall, VPN, intrusion detection, load balancing and SSL processing. Inkra Networks asked The Tolly Group to validate the single-rule firewall throughput of the Inkra 4000 VSS, as well as validate an array of other supported services.
Engineers configured the Inkra 4000 VSS chassis as a single firewall with one rule, using a 1,518-byte packet and 28 Gigabit Ethernet port pairs. Engineers established 14,336 sessions and flowed bidirectional Layer 3 data across the Inkra 4000 VSS and measured the zero-loss firewall throughput. Engineers also measured device latency and VPN throughput. Testing was performed in September 2003.
The Tolly Group also benchmarked a number of Inkra 4000 VSS device functions including server load balancing, SSL connection rate, and intrusion detection/intrusion prevention processing.
Security
|
Inkra Networks Corp.
Inkra 4000 Virtual Service Switch Multi-Gigabit Ethernet Firewall Throughput and Scalability Evaluation
Document number:
203127
Release Date:
03 Nov 2003
Inkra Networks commissioned The Tolly Group to evaluate its Inkra 4000 Virtual Service Switch (VSS), a 14-slot chassis-based device that supports multiple virtual services, including firewall, VPN, intrusion detection, load balancing and SSL processing. Inkra Networks asked The Tolly Group to validate the single-rule firewall throughput, scalability and latency of the Inkra 4000 VSS. Testing was performed in September 2003.
Tolly Group engineers tested the Inkra 4000 VSS aggregate zero-loss (<0.001%) throughput when using 1,518-byte frames. Tests were also conducted using three different configurations in order to demonstrate the linear slope of the product’s scalability. Finally, Tolly Group engineers measured the latency introduced by the Inkra 4000 VSS as data traverses the switch backplane.
Security
|
Aruba Wireless Networks
Aruba Wireless Networks Aruba 5000 Wi-Fi Switch/Aruba 52 Access Point - Encrypted Wireless Performance
Document number:
203126
Release Date:
23 Oct 2003
Aruba Wireless Networks commissioned The Tolly Group to evaluate its Aruba 5000 Wireless LAN Switch and its Aruba 52 access point. The Aruba 5000 is a four-slot WLAN switch with an integrated VPN gateway that operates at 10/100/1000 Mbps and combines firewall and VPN functionality along with wireless service. The Aruba 52 access point is a dual-band AP that supports 802.11a (54 Mbps) and 802.11b (11 Mbps).
Engineers conducted an IPSec throughput test designed to measure the aggregate internal performance of the Aruba 5000 switch. A second test measured the real-world throughput of the Aruba 5000 with an integrated VPN gateway supporting a large-scale wireless client/server network. Lastly, Tolly Group engineers validated 20 different features of the Aruba 5000 WLAN switch and the Aruba 52 AP. All tests were performed in September 2003.
Security
|
Ingate Systems, AB
Ingate Systems SIParator™ 40 Functionality Evaluation
Document number:
203119
Release Date:
19 Sep 2003
Ingate Systems commissioned The Tolly Group to conduct a functionality evaluation of its SIParator™ 40, an adjunct processor that works in conjunction with installed firewalls and enables the traversal of real-time SIP-based communications without compromising existing firewall security.
Tolly Group engineers subjected the SIParator 40 to 26 different SIP test scenarios representing common VoIP and instant messaging functions in each of three different deployment configurations: DMZ mode, DMZ/LAN mode and Standalone mode.
Security
|
Ingate Systems, AB
Ingate Firewall™ 1400, Functionality and Performance Evaluation
Document number:
203118
Release Date:
19 Sep 2003
Ingate Systems commissioned The Tolly Group to conduct a performance evaluation of its Ingate Firewall™ 1400, a firewall designed for use in small- to medium-sized enterprises (SMEs) that supports standard functions plus incorporates a SIP proxy and a SIP registrar to handle SIP-based real-time communications such as VoIP, instant messaging and audio/videoconferencing.
Engineers subjected the Ingate Firewall 1400 to a volley of tests, including throughput benchmarks, an evaluation of the device’s SIP functionality, VPN performance benchmark, and voice call quality capabilities.
Security
|
Forum Systems, Inc.
Forum Sentry™ 1504 XML Security Appliance Web Services Security Evaluation
Document number:
203117
Release Date:
17 Sep 2003
Forum Systems, Inc. commissioned The Tolly Group to evaluate its Forum Sentry™ 1504, a Web services security appliance that utilizes specially designed hardware to provide an enterpirse-class Web services security management and acceleration platform.
The Forum Sentry 1504 integrates three XML Web services security solutions in a single device.
Security
|
SECUi.COM Corp.
SECUi.COM Corp. secuiWALL versus NetScreen Technologies, Inc. NetScreen-500 and NetScreen-1000 Gigabit Ethernet Firewalls Competitive Performance Evaluation
Document number:
203112
Release Date:
06 Jul 2003
Recent tests of three Gigabit Ethernet firewalls reveal a product from SECUi.COM Corp. outperforms a pair of NetScreen Technologies GbE firewalls in zero-loss throughput tests under variable session loads, packet sizes and operating modes. The secuiWALL GbE firewall delivered 15% more bi-directional zero-loss throughput than a NetScreen-1000 when handling 1,518-byte packets with 5,000 UDP sessions and 2,000 active rules. A NetScreen-500 tested was only able to achieve 40% of wire-speed throughput for all conditions tested..
SECUi.COM commissioned the Telecommunication Technology Association (TTA), a Korean-based testing partner of The Tolly Group working in conjunction with The Tolly Group, to evaluate the three GbE firewalls. All products were tested according to the principles, methodologies and fair testing charter employed by The Tolly Group. While testing was conducted in Korea, The Tolly Group reviewed all testing methodologies and results.
TTA exercised all three GbE firewalls in a variety of situations including bi-directional zero-loss Layer 2 throughput tests and bi-directional Layer 3 throughput tests with NAT enabled and then disabled. Test conditions included a variety of packet sizes ranging from 64 bytes to 1,518 bytes with 10 or 5,000 simultaneous UDP sessions with either a single active allow-all rule, or 2,000 active firewall rules.
Test results show that the secuiWALL GbE firewall achieved wire-speed GbE throughput when handling up to 5,000 UDP sessions and 2,000 active rules. The NetScreen-1000 achieved wire speed when handling 1,028-byte packets and handling 10 UDP sessions while the NetScreen-50 only reached 40% of wire speed under all test conditions.
Security
|
SmartPipes, Inc.
The Power of Policy: Streamlining VPN Security through Software: A “hands-on” implementation of
SmartPipes IP PolicyPro SecureSite Software
Document number:
203503
Release Date:
29 Apr 2003
The prevalence of IP VPNs to provide connectivity in enterprise networks raises serious issues for network administrators to confront in their deployment and life-cycle maintenance. In the past, network managers were forced to grapple with complex configuration issues manually on an individual-device basis. The time spent to set up even a single VPN tunnel manually is notorious in the industry. Magnify that across a network for a large-scale deployment and you get a hefty chunk of man-hours, which translates into cost.
SmartPipes, Inc. developed its IP PolicyPro platform and SecureSite software to provide network administrators with an easy-to-use, scalable and secure method for simultaneously provisioning hundreds, and even thousands, of VPNs in today’s global network.
In order to provide intellectual and pragmatic analysis to back up its product claims, SmartPipes commissioned The Tolly Group to build a microcosm of a complex VPN deployment with which to illustrate the key benefits of the SmartPipes SecureSite platform.
The Tolly Group’s evaluation of SmartPipes SecureSite was based on factors that included the set-up, implementation and life-cycle management of SmartPipes SecureSite compared to manual configuration of those aspects using an array of vendor devices that included multiple NetScreen and Cisco devices.
Since it was impractical to deploy a test network consisting of thousands of devices in a full-scale deployment, for this project The Tolly Group conducted a mini-deployment of various key features in its own lab to extrapolate the operational and management characteristics of provisioning these VPN solutions. This provided empirical material that could be used to develop a clearer understanding of the costs and resources involved in deploying SmartPipes SecureSite solution compared to manually configuring a host of devices.
This study shows SmartPipes SecureSite to be a secure, scalable, easy-to-use provisioning platform. By reducing the complexity of configuration and providing a powerful single-point-of-control for large-scale multi-platform VPNs, SmartPipes SecureSite significantly reduces VPN Total Cost of Ownership while simultaneously improving “turn up” speed for provisioning new networks or modifying existing connections.
Security
|
TippingPoint Technologies, a 3Com Company
Tipping Point Technologies, Inc.UnityOne Intrusion Prevention Appliances Performance Evaluation
Document number:
203101
Release Date:
01 Feb 2003
TippingPoint Technologies, Inc. commissioned The Tolly Group to evaluate its line of UnityOne Intrusion Prevention Appliances, the UnityOne 2400, 1200 and 400. UnityOne is an intrusion prevention system that blocks worms, Trojans, viruses, hybrid attacks, denial of service attacks and other attacks while delivering switch-like performance. Engineers measured network performance (aggregate throughput and latency), the precision of each device’s security filtering and the efficiency of testing for false positives and false negatives.
Product class: Intrusion prevention system
Security
|
The Tolly Group, Inc.
User Technology Study: Re-Engineering Enterprise Network Security for 2003
Document number:
203400
Release Date:
10 Jan 2003
In this report detailing results of a survey of 52 enterprise network architects conducted during December 2002, The Tolly Group captures a snapshot of the technology choices users plan to make in their deployment of network security technologies across enterprise networks.
Security
|
WatchGuard Technologies, Inc.
WatchGuard Firebox V60 Competitive Firewall/VON Benchmark Evaluation Versus Cisco PIX 515E and NetScreen-50
Document number:
202164
Release Date:
01 Jan 2003
WatchGuard Technologies, Inc. commissioned The Tolly Group to evaluate the Firebox® V60, a four-port Fast Ethernet firewall/VPN security appliance in a variety of real-world zero-loss throughput scenarios and to compare its performance against a Cisco PIX 515E two-port appliance and a NetScreen Technologies, Inc. NetScreen-50 four-port appliance.
Security
|
Enterasys Networks
Enterasys Networks XSR-1805 Security Router versus Cisco Systems, Inc. 1751 Modular Access Router Competitive Performance Evaluation
Document number:
202154
Release Date:
15 Nov 2002
Enterasys Networks commissioned The Tolly Group to evaluate its XSR-1805 Security Router, a multi-function routing device, and to compare its performance against that of a Cisco Systems, Inc. 1751 router in a LAN-to-LAN environment designed to stress the system’s processing power to the maximum allowable bandwidth. While security routers are typically deployed in conjunction with a WAN, this series of tests attempts to gauge the processing power of the devices; therefore, tests were conducted in a LAN-to-LAN, two-port router configuration using 10 Mbit/s interfaces and 100 Mbit/s interfaces. The Tolly Group conducted zero-loss (<0.001%) bi-directional (full-duplex) Layer 3 throughput tests and zero-loss, Layer 3 throughput tests when QoS and Access Control Lists (ACLs), respectively, were enabled.
Security
|
Enterasys Networks
Enterasys Networks XSR-1850 Security Router versus Cisco Systems, Inc. 2651XM Multiservice Router Competitive Performance Evaluation
Document number:
202155
Release Date:
13 Nov 2002
Enterasys Networks commissioned The Tolly Group to evaluate its XSR-1850 Security Router, and to compare its performance against that of a Cisco Systems, Inc. 2651XM router in a LAN-to-LAN environment designed to stress the system's processing power to the maximum allowable bandwidth. While security routers are typically deployed in conjunction with a WAN, the series of tests attempts to gauge the processing power of the devices; therefore, tests were conducted in a LAN-to-LAN, two-port router configuration using 100 Mbits/ interfaces. The Tolly Group conducted zero-loss bidirectional (full-duplex) Layer 3 throughput tests and zero-loss Layer 3 throughput when QoS and Access Control Lists (ACLs), respectively, were enabled.
Security
|
NetScreen Technologies, Inc (Juniper)
NetScreen Technologies, Inc. Netscreen 5200 versus Nokia IP740 and Cisco Systems PIX 535 Competitive Evaluation of Multi-Gigabit Firewall/VPN Multifunction Devices
Document number:
202121
Release Date:
01 Sep 2002
NetScreen Technologies commissioned The Tolly Group to benchmark the NetScreen-5200, a purpose-built high-performance Internet security system outfitted with Gigabit Ethernet interfaces, and to compare the results with those of a similarly outfitted Cisco PIX 535 firewall/VPN and Nokia IP740 firewall device. The Tolly Group conducted application throughput and zero-loss throughput tests, as well as standard latency tests for both firewall and VPN tunnel configurations, the latter incurring the extra processing factored in with support for 3DES and SHA-1. Each of the devices was subjected to a range of session loads, escalating from 1,000 sessions to as many as 500,000 sessions in firewall tests.
Security
|
Inkra Networks Corp.
Inkra Networks Corp. Inkra 4000 Virtual Service Switch HardWall Technology Evaluation
Document number:
202145
Release Date:
02 Aug 2002
Inkra Networks Corp. commissioned The Tolly Group to evaluate the HardWall feature of its Inkra 4000 Virtual Service Switch, a carrier-class, multi-service device. The Inkra 4000 is designed to deliver multiple virtualized IP services simultaneously, including firewall, server load balancing, SSL acceleration and VPN services for multiple, dedicated clients. HardWall is Inkra's patent-pending hardware-enforces resource management technology (implemented in an ASIC-based Virtual Rack Processor) that isolates each virtual rack on the system from the others to guarantee the performance levels of individual virtual racks. Tests included validation of the system's capability to sustain functionality despite individual rack failure, demonstration of the switch's capability to control virtual rack bandwidth, virtual rack session over-subscription and virtual rack burst-priority.
Security
|
Bivio Networks, Inc.
Bivio Networks, Inc. Bivio 1000 Firewall Performance Evaluation
Document number:
202143
Release Date:
01 Aug 2002
Bivio Networks, Inc. commissioned The Tolly Group to evaluate its Bivio 1000, a high-speed security platform that is integrated with Check Point Software's FireWall-1 NG software. The Bivio 1000 is designed for large enterprises and carriers in order to deliver gigabit-class firewall performance. The Tolly Group tested the Bivio 1000 both as a single-rule, allow-all firewall configured with two Gigabit Ethernet interfaces.
Security
|
|
|
Quarry Technologies (Reef Point)
Quarry Technologies iQ8000 Service Edge Switch Performance Evaluation
Document number:
202112
Release Date:
01 Jan 2002
Quarry Technologies commissioned The Tolly Group to evaluate the performance of its iQ8000 Service Edge Switch, a carrier-class, chassis-based routing system designed to deliver security services at the edge of large, high-speed networks. The Tolly Group conducted bidirectional zero-loss throughput tests in both firewall-only and IPSec tunnel configurations with Quality of Service (QoS) and firewall services enabled.
Security
|
WatchGuard Technologies, Inc.
WatchGuard Technologies, Inc. Firebox III Model 1000 versus Nokia IP330 and SonicWALL PRO-VX Performance Evaluation
Document number:
201132
Release Date:
01 Sep 2001
WatchGuard Technologies, Inc. commissioned The Tolly Group to evaluate its Firebox III Model 1000, an enterprise-class firewall and IPSec gateway designed to serve mid-size business or branch offices. This purpose-built, Fast Ethernet security device was benchmarked by The Tolly Group, which compared the Firebox 1000 performance to a Nokia Corp. IP330 and a SonicWALL PRO-VX. The Tolly Group conducted zero-loss throughput tests in both IPSec tunnel and firewall configurations with a range of packet sizes.
Security
|
ServGate Technologies, Inc.
ServGate Technologies, Inc. SG2000
Firewall Performance Benchmark
Document number:
201126
Release Date:
01 Sep 2001
ServGate Technologies, Inc. commissioned The Tolly Group to evaluate its SG2000, a multifunction firewall designed for large enterprises and carriers that is designed to deliver gigabit performance. The Tolly Group tested the SG2000 as a single-rule firewall configured with two Gigabit Ethernet interfaces and benchmarked its bidirectional packet per second UDP/IP packet throughput.
Security
|
RapidStream, Inc.
RapidStream, Inc. RapidStream 6000 (Fast Ethernet) and RapidStream 8000 (Gigabit Ethernet)
Security Appliance Performance Evaluation
Document number:
201101
Release Date:
01 Aug 2001
RapidStream, Inc. commissioned The Tolly Group to benchmark the performance of its RapidStream 8000 (Gigabit Ethernet) and RapidStream 6000 (Fast Ethernet) firewall/VPN security appliances. The Tolly Group subjected both devices to a battery of tests to determine bidirectional packet per second (pps) UDP packet throughput, bidirectional file-transfer application throughput and bidirectional UDP packet latency during maximum zero-loss utilization.
Security
|
Nortel
Nortel Networks Contivity 2600 VPN Switch Firewall/VPN Multi-Service Performance Evaluation
Document number:
201130
Release Date:
01 Jul 2001
Nortel Networks, Inc. commissioned The Tolly Group to evaluate its Contivity 2600, which is designed to serve large branch offices or data centers that support up to 1,000 VPN tunnels. Tolly Group engineers subjected the Contivity 2600 to a battery of tests to determine the switch's single-rule firewall and IPSec gateway bidirectional zero-loss performance, as well as to benchmark switch performance when both services are contending for bandwidth.
Security
|
|
|
|
|
OpenReach, Inc.
OpenReach, Inc. OpenReach Gateway Software IP Routing and IPSec Gateway Performance Evaluation
Document number:
200236
Release Date:
01 Mar 2001
OpenReach, Inc. commissioned The Tolly Group to evaluate version 2.2 of its OpenReach Gateway Software, an IP routing and IPSec software that runs in conjunction with LINUX on Intel computing platforms. The Tolly Group conducted throughput tests of OpenReach gateway’s IP routing and its (paired) IPSec gateway throughput. Zero-loss packet throughput and application throughput tests were conducted using Red Hat LINUX version 6.1 operating system running on either a 1-GHz Pentium III PC or a 500-MHz Celeron platform.
Security
|
NetScreen Technologies, Inc (Juniper)
NetScreen Technologies, Inc NetScreen-5 versus SonicWALL, inc. SOHO/50 and WatchGuard Technologies, Inc. SOHO Competitive Evaluation of SOHO Internet Security Devices
Document number:
200230
Release Date:
01 Jan 2001
NetScreen Technologies, Inc. commissioned The Tolly Group to evaluate the performance of its NetScreen-5, an Internet security appliance integrating firewall and virtual private networking (VPN) in a SOHO environment. NetScreen requested that The Tolly Group evaluate the NetScreen-5 along with the following Internet appliances: a SonicWALL, Inc. SOHO/50 and a WatchGuard Technologies, Inc. SOHO. The Tolly Group conducted tests of devices as IPSec tunnels for application and zero-loss throughput. Tolly engineers also tested each device as a firewall and measured the zero-loss throughput when using UDP packets. For zero-loss performance tests, The Tolly Group measured steady-state throughput at 0.001%, the same metric The Tolly Group uses to test Layer 2 and Layer 3 networking devices. Testing was performed in July through November, 2000.
Security
|
NetScreen Technologies, Inc (Juniper)
NetScreen Technologies, Inc NetScreen-100 versus Check Point Software Technologies, Ltd. FireWall-1/VON-1, Nokia IP650 and Cisco Systems, Inc. Firewall Series PIX-515 Competitive Evaluation of Enterprise Class Internet Security Devices
Document number:
200225
Release Date:
01 Jan 2001
NetScreen Technologies, Inc. commissioned The Tolly Group to evaluate its NetScreen-100, an enterprise class firewall and Internet Protocol Security (IPSec) Virtual Private Network gateway. This purpose-built, Fast Ethernet security device was benchmarked by The Tolly Group and compared to the following three devices: a Check Point Software Technologies, Ltd. FireWall-1/VPN-1; a Nokia IP650; and a Cisco Systems, Inc. Firewall Series PIX-515. For all devices under test, The Tolly Group conducted application throughput and zero-loss throughput tests in an IPSec tunnel configuration. Engineers also measured zero-loss throughput and TCP/IP session-processing rate in a firewall configuration.
Security
|
Cylink Corporation
Cylink Corporation NetHawk IPSec Gateway Fast Ethernet Performance
Document number:
200224
Release Date:
01 Sep 2000
Cylink Corporation commissioned The Tolly Group to benchmark the performance of a pair of NetHawks in a LAN-to-LAN (IPSec) VPN gateway. The NetHawks, equipped with two full duplex, Fast Ethernet interfaces, were tested for packet per second throughput, file transfer performance, interactive application performance, session capacity and latency. In tests, all traffic was forwarded within a single IPSec Security Association (SA) and was encrypted using DES-3 (triple Data Encryption Standard); data integrity verification was performed with DESMAC (DES Message Authentication Code).
Security
|
Indus River Networks, Inc.(Enterasys)
Indus River Networks, Inc. RiverWorks Enterprise VPN ver. 1.2 versus Nortel Networks Contivity Extranet Switch 4000 and TimeStep Corp. PERMIT/Gate 7520 VPN Tunneling Competitive Evaluation
Document number:
199125
Release Date:
01 Aug 1999
Indus River Networks, Inc. commissioned The Tolly Group to test its RiverWorks Enterprise VPN against Nortel Networks’ Contivity Extranet Switch 4000 (CES 4000) and TimeStep Corp.’s PERMIT/Gate 7520. Tests were conducted to determine the single-tunnel throughput for IPSec and the point-to-point tunneling protocol (PPTP) connections over a simulated Internet. Tests shipping ASCII text data across 56 Kbit/s links, and using compression where available, reveal that RiverWorks delivers an average 20% to 60% greater IPSec throughput than Nortel’s CES 4000 or TimeStep’s PERMIT/ Gate 7520. Results also demonstrate that RiverWorks delivered 50% greater throughput when using PPTP than the CES 4000. For VPN vendors who use the Internet as a transport for remote-user VPN tunnel sessions as opposed to more costly direct-dial lines to a traditional remote access server, RiverWorks makes this a viable option because it can effectively optimize data transport over the Internet.
Security
|
Nortel
Nortel Networks Contivity Extranet Switch 4000 Fast Ethernet-to-Fast Ethernet Layer 2 Tunneling Protocol Thoughput
Document number:
199104
Release Date:
01 Jan 1999
Nortel Networks commissioned The Tolly Group to benchmark the performance characteristics of each L2TP Network Server (LNS) under test, while handling up to 2,000 active L2TP tunnels in a Fast Ethernet environment. Switches and routers configured as LNSs are commonly used to establish secure tunnels across the Internet, enabling remote users to access internal resources at a central office. The Tolly Group examined the zero-packet-loss (+/-2%) Fast Ethernet-to-Fast Ethernet L2TP throughput of Nortel's Continuity Extranet Switch 4000 (CES 4000) versus the Cisco 7206 router. The test configuration emulated VPN solutions that are also referred to as LAN-to-LAN or branch-to-headquarters VPN solutions. All tests used a single L2TP session per tunnel.
Security
|
User not logged in
