NIST evaluates the algorithms on a closed dataset for FRVT 1:1 and ranks the different algorithms across different categories Visa, Border, Visa Border, Mugshots, Border-Border comparisons, Wild Images, and Child Exploitation Videos.
FRVT 1:1 algorithm measured on false non-match rate (FNMR) across several datasets to achieve the specified false match rate. NIST FRVT 1:1 test result is the widely accepted de-facto standard for the Facial recognition vendor test, and many governments use the benchmark for qualifying a vendor.
NIST regularly conducts the FRVT 1:1, and the algorithm developer is permitted to submit it once every four months. The algorithms are then ranked based on the VISABORDER dataset.