Ongoing Face Recognition Vendor Test (FRVT) Part 6B: Face Recognition Accuracy with Face Masks Using Post-COVID-19 Algorithms [open pdf - 30MB]
From the Executive Summary: "This is the second of a series of reports on the performance of face recognition algorithms on faces occluded by protective face masks commonly worn to reduce inhalation and exhalation of viruses. Inspired by the COVID-19 [coronavirus disease 2019] pandemic response, this is a continuous study being run under the Ongoing Face Recognition Vendor Test (FRVT) executed by the National Institute of Standards and Technology (NIST). In our first report, we tested 'pre-pandemic' algorithms that were already submitted to FRVT 1:1 prior to mid-March 2020. This report augments its predecessor with results for more recent algorithms provided to NIST after mid-March 2020. While we do not have information on whether or not a particular algorithm was designed with face coverings in mind, the results show evidence that a number of developers have adapted their algorithms to support face recognition on subjects potentially wearing face masks. The algorithms tested were one-to-one algorithms submitted to the FRVT 1:1 Verification track. Future editions of this document will also report accuracy of one-to-many algorithms. [...] This report includes[:]  Results from evaluating 65 face recognition algorithms provided to NIST since mid-March 2020;  Assessment of when both the enrollment and verification images are masked (in addition to when only the verification image is masked);  Results for red and white colored masks (in addition to light-blue and black);  Cumulative results for 152 algorithms evaluated to date (submitted both prior to and after mid-March 2020)[.]"
NISTIR 8331; National Institute of Standards and Technology Interagency or Internal Report 8331
National Institute of Standards and Technology (NIST): https://www.nist.gov/