Face Recognition Vendor Test (FRVT) Part 2: Identification   [open pdf - 28MB]

From the Executive Summary: "This report updates and extends NIST [National Institute of Standards and Technology] Interagency Report 8238 [hyperlink], documenting the evaluation of automated face recognition algorithms submitted to NIST in November 2018. The algorithms, which implement one-to-many identification of faces appearing in two-dimensional images, are prototypes from the research and development laboratories of mostly commercial suppliers, and are submitted to NIST as compiled black-box libraries implementing a NIST-specified C++ test interface. The report therefore does not describe how algorithms operate. The evaluation used four datasets - frontal mugshots, profile views, webcam photos and wild images - and the report lists accuracy results alongside developer names. It will therefore be useful for comparison of face recognition algorithms and assessment of absolute capability. The primary dataset is comprised of 26.6 million reasonably well-controlled live portrait photos of 12.3 million individuals. The three smaller datasets contain more unconstrained photos: 3.2 million webcam images; 200 thousand side-view images; and 2.5 million photojournalism and amateur photographer photos. These datasets are sequestered at NIST, meaning that developers do not have access to them for training or testing. The last dataset, however, consists of images drawn from the internet for testing purposes so while it is not truly sequestered, its composition is unknown to the developers."

Report Number:
NISTIR 8271; National Institute of Standards and Technology Interagency or Internal Report 8271
Public Domain
Retrieved From:
National Institute of Standards and Technology: https://www.nist.gov/
Media Type:
Help with citations