TY - GEN
T1 - RPPG-BASED SPOOFING DETECTION FOR FACE MASK ATTACK USING EFFICIENTNET ON WEIGHTED SPATIAL-TEMPORAL REPRESENTATION
AU - Yao, Chenglin
AU - Wang, Shihe
AU - Zhang, Jialu
AU - He, Wentao
AU - Du, Heshan
AU - Ren, Jianfeng
AU - Bai, Ruibin
AU - Liu, Jiang
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Face spoofing detection against paper attack and video-replay attack has been well studied, whereas detecting 3D face mask attack remains challenging. Remote photoplethysmography (rPPG) signal is a recently developed liveness clue for face-spoofing detection. The main challenge of existing rPPG-based methods is that the signal can be easily distorted by background noise or object motion. To address this problem, in this work, we propose an rPPG-based face-spoofing detection method using multiple regions of interests (ROIs) covering entire face, and emphasize the regions containing richer rPPG signals using larger weights. The rPPG signals of these regions form a weighted spatial-temporal map. In view of the discriminant power of EfficientNet over other deep convolutional neural networks, we propose a domain-specific EfficientNet as the classification method. Extensive experiments on two databases namely 3DMAD and HKBU-Mars V2 demonstrate the superior performance of the proposed method over state-of-the-art rPPG-based face-spoofing-detection algorithms.
AB - Face spoofing detection against paper attack and video-replay attack has been well studied, whereas detecting 3D face mask attack remains challenging. Remote photoplethysmography (rPPG) signal is a recently developed liveness clue for face-spoofing detection. The main challenge of existing rPPG-based methods is that the signal can be easily distorted by background noise or object motion. To address this problem, in this work, we propose an rPPG-based face-spoofing detection method using multiple regions of interests (ROIs) covering entire face, and emphasize the regions containing richer rPPG signals using larger weights. The rPPG signals of these regions form a weighted spatial-temporal map. In view of the discriminant power of EfficientNet over other deep convolutional neural networks, we propose a domain-specific EfficientNet as the classification method. Extensive experiments on two databases namely 3DMAD and HKBU-Mars V2 demonstrate the superior performance of the proposed method over state-of-the-art rPPG-based face-spoofing-detection algorithms.
KW - EfficientNet
KW - Face spoofing detection
KW - RPPG
KW - Remote photoplethysmography
KW - Spatial-temporal representation
UR - http://www.scopus.com/inward/record.url?scp=85123788583&partnerID=8YFLogxK
U2 - 10.1109/ICIP42928.2021.9506276
DO - 10.1109/ICIP42928.2021.9506276
M3 - Conference contribution
AN - SCOPUS:85123788583
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 3872
EP - 3876
BT - 2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings
PB - IEEE Computer Society
T2 - 2021 IEEE International Conference on Image Processing, ICIP 2021
Y2 - 19 September 2021 through 22 September 2021
ER -