Large-Scale Measurement of Broadband Performance B. Stark
Internet-Draft AT&T
Intended status: Informational T. Carey
Expires: September 2, 2015 Alcatel-Lucent
March 1, 2015
LMAP Protocol Selection Criteria
draft-starkcarey-lmap-protocol-criteria-01
Abstract
This draft identifies criteria to be used by the LMAP WG in
evaluating and selecting Control and Reporting Protocols described by
[I-D.ietf-lmap-framework] and identified as WG deliverables in the
LMAP charter. It is not intended for use for any other purpose or by
any other party. This draft will not be maintained after LMAP
completes its selection of these protocols. The authors of this
draft do not intend to ask for working group adoption or formal
publication by IETF.
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at http://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on September 2, 2015.
Copyright Notice
Copyright (c) 2015 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(http://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
Stark & Carey Expires September 2, 2015 [Page 1]
Internet-Draft LMAP Protocol Selection Criteria March 2015
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2
2. Control Protocol Criteria . . . . . . . . . . . . . . . . . . 2
2.1. Mandatory Criteria . . . . . . . . . . . . . . . . . . . 2
2.2. Comparative Criteria . . . . . . . . . . . . . . . . . . 3
3. Report Protocol Criteria . . . . . . . . . . . . . . . . . . 4
3.1. Mandatory Criteria . . . . . . . . . . . . . . . . . . . 4
3.2. Comparative Criteria . . . . . . . . . . . . . . . . . . 5
4. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 6
5. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 6
6. Security Considerations . . . . . . . . . . . . . . . . . . . 6
7. Normative References . . . . . . . . . . . . . . . . . . . . 6
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 6
1. Introduction
This draft identifies criteria to be used in evaluating and selecting
Control and Reporting Protocols described by
[I-D.ietf-lmap-framework]. Both mandatory and comparative criteria
are identified for these protocols.
2. Control Protocol Criteria
2.1. Mandatory Criteria
Following is a list of criteria that a Control Protocol is required
to support. Protocols that do not support these criteria will not be
considered appropriate for selection by LMAP WG as a Control
Protocol. Although it is mandatory that the described mechanisms
have been defined for a protocol (in order for the protocol to be
considered by LMAP as a candidate Control Protocol), the mechanisms
do not need to be mandatory to implement per the protocol
specification.
CP-MUST-1 There must be a mechanism that allows a Controller to
cause a session to be established with a MA. Identify
this mechanism and where it is defined.
CP-MUST-2 There must be a mechanism that allows a MA to cause a
session to be established with a Controller. Identify
this mechanism and where it is defined.
Stark & Carey Expires September 2, 2015 [Page 2]
Internet-Draft LMAP Protocol Selection Criteria March 2015
CP-MUST-3 The protocol session must be capable of being secured
using secure credentials, as described in
[I-D.ietf-lmap-framework]. The security mechanism must be
useful for privacy protection, man-in-the-middle defense,
and protection against replay. Identify this mechanism
and where it is defined.
CP-MUST-4 The protocol must be versionable. Identify the process
for extending the protocol.
2.2. Comparative Criteria
Following is a list of criteria that can be used to differentiate
among Control Protocol candidates. For each criterion, it is also
indicated what is considered "better" for a candidate protocol to
support.
CP-DIFF-1 How many exchanges are required to send a complete
instruction set? (less is better)
CP-DIFF-2 How many exchanges are required to send a status update?
(less is better)
CP-DIFF-3 Is it possible to provide partial updates? (yes is
better)
CP-DIFF-4 Are there any special mechanisms (other than STUN/TURN/
ICE or using port forwarding pinholes, PCP, UPnP IGD,
etc.) for NAT/firewall traversal? (if subsequent
evaluation of such a mechanism suggests it is useful and
usable, yes is better)
CP-DIFF-5 How many bytes of overhead (rough estimate or brief
description of the source of overhead is acceptable) are
required to send a complete instruction set? (less is
better)
CP-DIFF-6 How many bytes of overhead (rough estimate or brief
description of the source of overhead is acceptable) are
required to send a status update? (less is better)
CP-DIFF-7 How widely used is the protocol and/or its protocol
elements in mass market devices? (widely is better)
CP-DIFF-8 What mechanisms exist to ensure interoperability of MA
and Controller implementations (e.g., test tools,
plugfests, certification programs, test plan or scripts,
Stark & Carey Expires September 2, 2015 [Page 3]
Internet-Draft LMAP Protocol Selection Criteria March 2015
reference implementations to test against)? (existence of
something is better)
CP-DIFF-9 Are the components of the protocol available as open
source? (yes is better)
CP-DIFF-10 What ecosystem of tools exists for developers
implementing the protocol (e.g., compilers, tutorials,
sample and open source implementations; include tools for
data model creation)? (existence of useful tools is
better)
CP-DIFF-11 Is the protocol versionable? (yes is better, or is this
mandatory?)
CP-DIFF-12 If yes, what is the process for extending the protocol?
(for information)
CP-DIFF-13 What are the encodings supported by the protocol (SOAP,
JSON, XML, etc.)? (simple is better; lower overhead is
better; other aspects still to be determined and
discussed may be better)
3. Report Protocol Criteria
3.1. Mandatory Criteria
Following is a list of criteria that a Report Protocol is required to
support. Protocols that do not support these criteria will not be
considered appropriate for selection by LMAP WG as a Report Protocol.
Although it is mandatory that the described mechanisms have been
defined for a protocol (in order for the protocol to be considered by
LMAP as a candidate Report Protocol), the mechanisms do not need to
be mandatory to implement per the protocol specification.
RP-MUST-1 There must be a mechanism that allows a MA to cause a
session to be established with a Collector. Identify this
mechanism and where it is defined.
RP-MUST-2 The protocol session must be capable of being secured
using secure credentials, as described in
[I-D.ietf-lmap-framework]. The security mechanism must be
useful for privacy protection, man-in-the-middle defense,
and protection against replay. Identify this mechanism
and where it is defined.
RP-MUST-3 The protocol must be versionable. Identify the process
for extending the protocol.
Stark & Carey Expires September 2, 2015 [Page 4]
Internet-Draft LMAP Protocol Selection Criteria March 2015
3.2. Comparative Criteria
Following is a list of criteria that can be used to differentiate
among Report Protocol candidates. For each criterion, it is also
indicated what is considered "better" for a candidate protocol to
support.
RP-DIFF-1 What transport protocols (TCP, UDP, other) can be used
with the protocol? (WG to decide what is better)
RP-DIFF-2 Is a congestion control mechanism supported? (yes is
better)
RP-DIFF-3 How many exchanges are required to send a report? (less
is better)
RP-DIFF-4 Does it allow for sending multiple reports in a session?
(yes is better)
RP-DIFF-5 Is there a capability for long-lived sessions. (yes is
better)
RP-DIFF-6 Is compression supported? (yes is better, or is this
mandatory?)
RP-DIFF-7 How many bytes of overhead (rough estimate or brief
description of the source of overhead is acceptable) are
required to send a report? (less is better)
RP-DIFF-8 How widely used is the protocol and/or its protocol
elements in mass market devices? (widely is better)
RP-DIFF-9 What mechanisms exist to ensure interoperability of MA
and Collector implementations (e.g., test tools,
plugfests, certification programs, test plan or scripts,
reference implementations to test against)? (existence of
something is better)
RP-DIFF-10 Are the components of the protocol available as open
source? (yes is better)
RP-DIFF-11 What ecosystem of tools exists for developers
implementing the protocol (e.g., compilers, tutorials,
sample and open source implementations; include tools for
data model creation)? (existence of useful tools is
better)
Stark & Carey Expires September 2, 2015 [Page 5]
Internet-Draft LMAP Protocol Selection Criteria March 2015
RP-DIFF-12 What are the encodings supported by the protocol (SOAP,
JSON, XML, etc.)? (simple is better; lower overhead is
better; other aspects still to be determined and
discussed may be better)
4. Acknowledgements
Members of LMAP WG, including Dan Romascanu, Joan Luciani, Phil
Eardley, and Juergen Schoenwaelder.
5. IANA Considerations
This memo includes no request to IANA.
6. Security Considerations
Candidate Control and Report protocols are required to meet security
requirements identified in [I-D.ietf-lmap-framework].
7. Normative References
[I-D.ietf-lmap-framework]
Eardley, P., Morton, A., Bagnulo, M., Burbridge, T.,
Aitken, P., and A. Akhter, "A framework for Large-Scale
Measurement of Broadband Performance (LMAP)", draft-ietf-
lmap-framework-11 (work in progress), February 2015.
Authors' Addresses
Barbara Stark
AT&T
1057 Lenox Park Blvd NE
Atlanta, GA 30319
US
Phone: +1-404-499-6424
Email: bs7652@att.com
Timothy Carey
Alcatel-Lucent
TX
US
Phone: +1-972-415-2065
Email: timothy.carey@alcatel-lucent.com
Stark & Carey Expires September 2, 2015 [Page 6]