article2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)Jun 1, 2022Closed access

PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

ZYZitong YuYSYuming ShenJSJingang ShiHZHengshuang ZhaoPHPhilip H. S. Torr

University of Oulu · University of Oxford · +2 more institutions

Indexed incrossref

Abstract

Remote photoplethysmography (rPPG), which aims at measuring heart activities and physiological signals from facial video without any contact, has great potential in many applications. Recent deep learning approaches focus on mining subtle rPPG clues using convolutional neural networks with limited spatio-temporal receptive fields, which neglect the long-range spatio-temporal perception and interaction for rPPG modeling. In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture, to adaptively aggregate both local and global spatio-temporal features for rPPG representation enhancement. As key modules in PhysFormer, the temporal difference transformers first enhance the…

Citation impact

258
total citations
FWCI
76.68
Percentile
100%
References
107
Citations per year

Authors

6

Topics & keywords

Topics
Keywords
  • Computer science
  • Artificial intelligence
  • Transformer
  • Feature learning
  • Overfitting
  • Deep learning
  • Convolutional neural network
  • Segmentation
No related works found for this paper.

Funding