Matching explained

Matching is automatically executed on live video streams and uploaded videos. By default, matching isn’t executed on images. However, it is possible to manually perform matching on uploaded images through the REST API.

Matching score

During matching, a detected person is automatically compared with all persons already registered in watchlists. The result of the face template comparison (matching) is a matching score ─ the higher the score, the higher the similarity of the two compared faces. In SmartFace Platform, the matching score can have a value between 0-100.

The matching score isn't represented as a percentage. The number represents the aggregated comparison of more than 500 facial features. The correlation between the score and similarity has a logarithmic course.


images/download/attachments/99757290/06_Matching_-_Matching_score.png

Matching threshold

SmartFace decides whether the compared persons are matched or not based on a user-defined threshold for the matching score. The matching score that is equal or above the defined threshold is considered a match. Any matching score below the matching threshold value is considered a no-match. In case when a person matches with multiple watchlist members only the highest score is considered as a match. The default value for the threshold in SmartFace Platform is 40.

In the following example, SmartFace compares face templates of detected persons with templates from the watchlist. The decision if these pairs are a match or a no-match, depends on the value of the matching threshold. In this case the user chose the threshold value 40. Compared face templates with the matching scores 85 and 78 are considered as matches. Compared face templates with the matching scores 38 and 12 are considered as no-matches.


images/download/attachments/99757290/06_Matching_-_Matching_Threshold.png

Finding the right value for threshold can vary case to case, as it depends on several aspects like size of the watchlist, quality of the detected faces, size of the detected faces, etc. Therefore, we recommend performing some fine-tuning to set the right value for your use case.

Please consider these factors when setting a value for the matching threshold:

Threshold value

Pros

Cons

Higher

Higher security, because of the lower rate of false match

Can cause too strict security, as only high quality images will be matched. As a result, SmartFace may conclude that a person doesn't match their enrolled image in the watchlist even if they actually do.

Lower

Higher convenience, because of the lower rate of false reject

Can cause lower security, because of a higher rate of falsely matched persons. As a result, SmartFace may conclude that a person matches an enrolled image in the watchlist even if they actually don't match.