This document provides guidance and procedures for testing video
codecs, to evaluate their quality and performance. This document
is to be published as an Informational draft as it describes
methods for implementers of video codecs to compare against known
baselines for object and subject quality as well as measurements
for encoding/decoding performance.
Matthew A. Miller is the document shepherd, Adam Roach is the
responsible AD.
## Review and Consensus
The document has been reviewed both within the NETVC working group
and the Open Alliance for Media (OAM). While there were no
comments at all during Working Group Last Call, the consensus is
demonstrated by the virtue that OAM uses this document to evaluate
the readiness of AV1 implementations.
## IPR
Andrey Norkin disclosed IPR he was aware of IPR held by Netflix
when asked for his acknowledgement in accordance with BCP 78 and
79. It had not been filed with the IETF disclosure tools prior to
this writeup starting, so the shepherd filed it all as a
third-party disclosures. Andrey noted to the shepherd that Neflix
licenses all patents using an Apache Public License.
The other authors have declared they are not aware of any IPR
claims over the procedures described in this document, in
accordance with BCP 78 and 79.
Further, this document has numerous references to video samples
critical to providing a baseline for subjective quality testing.
At least two of the authors have acknowledged the copyrights for
these video samples have a BSD-like license to allow open and
royalty-free use by implementers for testing.
## Other Points
This document is describing procedures and guidelines for how to
evaluate the performance and quality of video codecs; no Security
Considerations or IANA Considerations apply.
A number of references within the document are stale; it is
expected those references will be corrected as part of the RFC
publication process, if not addressed beforehand.
The document has expired numerous times, but without significant
changes. The delays are largely around gathering acknowledgements
from authors. The publication is still worthwhile as it is
already in use by AV1 codec implementers.