Benchmarking Methodology for Network Security Device Performance
draft-ietf-bmwg-ngfw-performance-05

Document Type Active Internet-Draft (bmwg WG)
Authors Balamuhunthan Balarajah  , Carsten Rossenhoevel  , Brian Monkman 
Last updated 2020-10-30
Stream IETF
Intended RFC status (None)
Formats plain text xml pdf htmlized (tools) htmlized bibtex
Reviews
Stream WG state WG Document
Document shepherd Al Morton
IESG IESG state I-D Exists
Consensus Boilerplate Unknown
Telechat date
Responsible AD (None)
Send notices to Al Morton <acm@research.att.com>
Benchmarking Methodology Working Group                      B. Balarajah
Internet-Draft
Intended status: Informational                           C. Rossenhoevel
Expires: May 3, 2021                                            EANTC AG
                                                              B. Monkman
                                                              NetSecOPEN
                                                        October 30, 2020

    Benchmarking Methodology for Network Security Device Performance
                  draft-ietf-bmwg-ngfw-performance-05

Abstract

   This document provides benchmarking terminology and methodology for
   next-generation network security devices including next-generation
   firewalls (NGFW), next-generation intrusion detection and prevention
   systems (NGIDS/NGIPS) and unified threat management (UTM)
   implementations.  This document aims to strongly improve the
   applicability, reproducibility, and transparency of benchmarks and to
   align the test methodology with today's increasingly complex layer 7
   application use cases.  The main areas covered in this document are
   test terminology, test configuration parameters, and benchmarking
   methodology for NGFW and NGIDS/NGIPS to start with.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on May 3, 2021.

Copyright Notice

   Copyright (c) 2020 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

Balarajah, et al.          Expires May 3, 2021                  [Page 1]
Internet-Draft      Benchmarking for NGFW performance       October 2020

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (https://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   4
   2.  Requirements  . . . . . . . . . . . . . . . . . . . . . . . .   4
   3.  Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . .   4
   4.  Test Setup  . . . . . . . . . . . . . . . . . . . . . . . . .   4
     4.1.  Testbed Configuration . . . . . . . . . . . . . . . . . .   4
     4.2.  DUT/SUT Configuration . . . . . . . . . . . . . . . . . .   6
       4.2.1.  Security Effectiveness Configuration  . . . . . . . .  11
     4.3.  Test Equipment Configuration  . . . . . . . . . . . . . .  12
       4.3.1.  Client Configuration  . . . . . . . . . . . . . . . .  12
       4.3.2.  Backend Server Configuration  . . . . . . . . . . . .  14
       4.3.3.  Traffic Flow Definition . . . . . . . . . . . . . . .  15
       4.3.4.  Traffic Load Profile  . . . . . . . . . . . . . . . .  16
   5.  Test Bed Considerations . . . . . . . . . . . . . . . . . . .  17
   6.  Reporting . . . . . . . . . . . . . . . . . . . . . . . . . .  18
     6.1.  Key Performance Indicators  . . . . . . . . . . . . . . .  20
   7.  Benchmarking Tests  . . . . . . . . . . . . . . . . . . . . .  21
     7.1.  Throughput Performance With Application Traffic Mix . . .  21
       7.1.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  21
       7.1.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  21
       7.1.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  21
       7.1.4.  Test Procedures and Expected Results  . . . . . . . .  23
     7.2.  TCP/HTTP Connections Per Second . . . . . . . . . . . . .  24
       7.2.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  24
       7.2.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  24
       7.2.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  24
       7.2.4.  Test Procedures and Expected Results  . . . . . . . .  26
     7.3.  HTTP Throughput . . . . . . . . . . . . . . . . . . . . .  27
       7.3.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  27
       7.3.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  27
       7.3.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  27
Show full document text