Last Call Review of draft-ietf-bmwg-vswitch-opnfv-03
review-ietf-bmwg-vswitch-opnfv-03-opsdir-lc-romascanu-2017-05-11-00

Request Review of draft-ietf-bmwg-vswitch-opnfv
Requested rev. no specific revision (document currently at 04)
Type Last Call Review
Team Ops Directorate (opsdir)
Deadline 2017-05-15
Requested 2017-05-01
Authors Maryam Tahhan, Billy O'Mahony, Al Morton
Draft last updated 2017-05-11
Completed reviews Opsdir Last Call review of -03 by Dan Romascanu (diff)
Secdir Last Call review of -03 by Daniel Franke (diff)
Genart Last Call review of -03 by Dan Romascanu (diff)
Assignment Reviewer Dan Romascanu 
State Completed
Review review-ietf-bmwg-vswitch-opnfv-03-opsdir-lc-romascanu-2017-05-11
Reviewed rev. 03 (document currently at 04)
Review result Has Issues
Review completed: 2017-05-11

Review
review-ietf-bmwg-vswitch-opnfv-03-opsdir-lc-romascanu-2017-05-11

This document describes describes the progress of the Open Platform for NFV (OPNFV) project on virtual switch performance "VSPERF". That project reuses the BMWG framework and specifications to benchmark virtual switches implemented in general-purpose hardware. Some differences with the benchmarking of specialized HW platforms are identified and they may become work items for BMWG in the future. It's a well written and clear document, but I have reservations about it being published as an RFC, and I cannot find coverage for it in the WG charter. I also have concerns that parts of the methodology used by OPNFV break the BMWG principles, especially repeatability and 'black-box', and this is not clear enough articulated in the document.  As I was assigned both OPS-DIR and Gen-ART reviews for this document, I detailed the concerns in my Gen-ART review, they seem to belong better there. 

From an OPS-DIR perspective this document has no issues. If the concerns in section 6 are addressed and caution is taken to isolate the SUTs and benchmarking environments from the Internet or operational intranets, there is no operational impact. If approved it would be a useful tool for operators to get some information about how benchmarking of OPNFV project products are being designed.