The National Institute of Standards and Technology (NIST, part of U.S. Department of Commerce) conducts large scale testing of face recognition software in their Face Recognition Vendor Test (FRVT). One of the core tests is the FRVT 1:1 Verification, where algorithms are evaluated on multiple large-scale datasets in how good they perform on 1:1 facial verification.
What is 1:1 verification? It is the scenario where a person claims to be a certain individual, such as the owner of a specific passport or a specific user requesting access to a system with facial biometrics. The system then performs the 1:1 facial verification by capturing a new face sample and compares it against the reference face sample stored in the passport document or in the system. For example, the automatic border gate compares the new image against the facial image from your passport, or your phone compares a new selfie against the stored data when you unlock it.
In NIST FRVT 1:1 the evaluation is conducted on a large series […]