Evaluation of a Sample of RFC Produced in 2018
draft-huitema-rfc-eval-project-02

Document Type Active Internet-Draft (individual)
Last updated 2019-10-07
Stream (None)
Intended RFC status (None)
Formats plain text xml pdf htmlized bibtex
Stream Stream state (No stream defined)
Consensus Boilerplate Unknown
RFC Editor Note (None)
IESG IESG state I-D Exists
Telechat date
Responsible AD (None)
Send notices to (None)
Network Working Group                                         C. Huitema
Internet-Draft                                      Private Octopus Inc.
Intended status: Informational                           October 7, 2019
Expires: April 9, 2020

             Evaluation of a Sample of RFC Produced in 2018
                   draft-huitema-rfc-eval-project-02

Abstract

   This document presents a first attempt at evaluating the recently
   published RFC.  We analyze a set of randomly chosen RFC approved in
   2018, looking for history and delays.  The average RFC was produced
   in 3 years and 4 months, of which 2 years and 10 months were spent in
   the working group, 3 to 4 months for IETF consensus and IESG review,
   and 3 to 4 months in RFC production.  The main variation in RFC
   production delays comes from the AUTH48 phase.

   We also measure the number of citations of the chosen RFC using
   Semantic Scholar, and compare citation counts with what we know about
   deployment.  We show that citation counts indicate academic interest,
   but correlate only loosely with deployment or usage of the
   specifications.

   The measurement of delays could be automated by processing dates and
   events recorded in the data tracker.  The measurement of published
   RFC could be complemented by statistics on abandoned drafts, which
   would measure the efficiency of the IETF triaging process.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on April 9, 2020.

Huitema                   Expires April 9, 2020                 [Page 1]
Internet-Draft                RFC-Eval-2018                 October 2019

Copyright Notice

   Copyright (c) 2019 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (https://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  RFC Evaluation project  . . . . . . . . . . . . . . . . . . .   3
   2.  Selecting a random sample of RFC  . . . . . . . . . . . . . .   4
   3.  Analysis of 20 selected RFC . . . . . . . . . . . . . . . . .   6
     3.1.  8411  . . . . . . . . . . . . . . . . . . . . . . . . . .   6
     3.2.  8456  . . . . . . . . . . . . . . . . . . . . . . . . . .   7
     3.3.  8446  . . . . . . . . . . . . . . . . . . . . . . . . . .   7
     3.4.  8355  . . . . . . . . . . . . . . . . . . . . . . . . . .   8
     3.5.  8441  . . . . . . . . . . . . . . . . . . . . . . . . . .   9
     3.6.  8324  . . . . . . . . . . . . . . . . . . . . . . . . . .  10
     3.7.  8377  . . . . . . . . . . . . . . . . . . . . . . . . . .  10
     3.8.  8498  . . . . . . . . . . . . . . . . . . . . . . . . . .  11
     3.9.  8479  . . . . . . . . . . . . . . . . . . . . . . . . . .  11
     3.10. 8453  . . . . . . . . . . . . . . . . . . . . . . . . . .  12
     3.11. 8429  . . . . . . . . . . . . . . . . . . . . . . . . . .  12
     3.12. 8312  . . . . . . . . . . . . . . . . . . . . . . . . . .  13
     3.13. 8492  . . . . . . . . . . . . . . . . . . . . . . . . . .  14
     3.14. 8378  . . . . . . . . . . . . . . . . . . . . . . . . . .  15
     3.15. 8361  . . . . . . . . . . . . . . . . . . . . . . . . . .  15
     3.16. 8472  . . . . . . . . . . . . . . . . . . . . . . . . . .  16
     3.17. 8466  . . . . . . . . . . . . . . . . . . . . . . . . . .  16
     3.18. 8362  . . . . . . . . . . . . . . . . . . . . . . . . . .  17
     3.19. 8468  . . . . . . . . . . . . . . . . . . . . . . . . . .  17
   4.  Analysis of process and delays  . . . . . . . . . . . . . . .  18
     4.1.  Publication delays  . . . . . . . . . . . . . . . . . . .  18
     4.2.  Preparation and Publication delays  . . . . . . . . . . .  24
     4.3.  Copy editing  . . . . . . . . . . . . . . . . . . . . . .  27
     4.4.  Independent Series  . . . . . . . . . . . . . . . . . . .  30
   5.  Citation Counts . . . . . . . . . . . . . . . . . . . . . . .  30
Show full document text