Methodology for VNF Benchmarking Automation
draft-rosa-bmwg-vnfbench-06
BMWG R. Rosa, Ed.
Internet-Draft C. Rothenberg
Intended status: Informational UNICAMP
Expires: April 23, 2021 M. Peuster
H. Karl
UPB
October 20, 2020
Methodology for VNF Benchmarking Automation
draft-rosa-bmwg-vnfbench-06
Abstract
This document describes a common methodology for the automated
benchmarking of Virtualized Network Functions (VNFs) executed on
general-purpose hardware. Specific cases of automated benchmarking
methodologies for particular VNFs can be derived from this document.
An open source reference implementation is reported as running code
embodiment of the proposed, automated benchmarking methodology.
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on April 23, 2021.
Copyright Notice
Copyright (c) 2020 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
Rosa, et al. Expires April 23, 2021 [Page 1]
Internet-Draft VNFBench October 2020
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3
2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 4
3. Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
4. Considerations . . . . . . . . . . . . . . . . . . . . . . . 6
4.1. VNF Assessment Methods . . . . . . . . . . . . . . . . . . 7
4.2. Benchmarking Stages . . . . . . . . . . . . . . . . . . . . 7
4.3. Architectural Framework . . . . . . . . . . . . . . . . . . 8
4.4. Scenarios . . . . . . . . . . . . . . . . . . . . . . . . . 10
4.5. Phases of a Benchmarking Test . . . . . . . . . . . . . . . 11
4.5.1. Phase I: Deployment . . . . . . . . . . . . . . . . . . . 11
4.5.2. Phase II: Configuration . . . . . . . . . . . . . . . . . 11
4.5.3. Phase III: Execution . . . . . . . . . . . . . . . . . . 12
4.5.4. Phase IV: Result . . . . . . . . . . . . . . . . . . . . 12
5. Methodology . . . . . . . . . . . . . . . . . . . . . . . . . 12
5.1. VNF Benchmarking Descriptor (VNF-BD) . . . . . . . . . . . 13
5.2. VNF Performance Profile (VNF-PP) . . . . . . . . . . . . . 13
5.3. VNF Benchmarking Report (VNF-BR) . . . . . . . . . . . . . 14
5.4. Procedures . . . . . . . . . . . . . . . . . . . . . . . . 14
5.4.1. Plan . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.4.2. Realization . . . . . . . . . . . . . . . . . . . . . . . 16
5.4.3. Summary . . . . . . . . . . . . . . . . . . . . . . . . . 17
6. Particular Cases . . . . . . . . . . . . . . . . . . . . . . 18
6.1. Capacity . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.2. Redundancy . . . . . . . . . . . . . . . . . . . . . . . . 18
6.3. Isolation . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.4. Failure Handling . . . . . . . . . . . . . . . . . . . . . 18
6.5. Elasticity and Flexibility . . . . . . . . . . . . . . . . 19
6.6. Handling Configurations . . . . . . . . . . . . . . . . . . 19
6.7. White Box VNF . . . . . . . . . . . . . . . . . . . . . . . 19
7. Open Source Reference Implementation . . . . . . . . . . . . 19
7.1. Gym . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
7.2. Related work: tng-bench . . . . . . . . . . . . . . . . . . 20
8. Security Considerations . . . . . . . . . . . . . . . . . . . 21
Show full document text