Dual-Stream Siamese Vision Transformer With Mutual Attention For Radar Gait Verification

Ran Ji, Jiarui Li, Wentao He, Jianfeng Ren, Xudong Jiang

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

Abstract

The inconspicuousness of human gait characteristic in radar signal makes it hard to differentiate different identities. In this work, a Dual-stream Siamese Vision Transformer with Mutual Attention is proposed to verify whether a pair of radar gait sequences originate from the same person or not. The proposed Siamese Vision Transformer extracts pairwise discriminant spectral information from spectrograms and cadence velocity diagrams (CVDs). The proposed Mutual Attention scheme extracts the discriminant information from each stream through a self-attention mechanism and discovers the complement information cross the two streams through a cross-attention mechanism. The proposed method is evaluated on a large benchmark radar gait verification dataset. It significantly outperforms state-of-the-art solutions.

Original languageEnglish
Title of host publicationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728163277
DOIs
Publication statusPublished - 2023
Event48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023 - Rhodes Island, Greece
Duration: 4 Jun 202310 Jun 2023

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume2023-June
ISSN (Print)1520-6149

Conference

Conference48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023
Country/TerritoryGreece
CityRhodes Island
Period4/06/2310/06/23

Keywords

  • Cadence velocity diagram
  • Mutual attention
  • Radar gait verification
  • Siamese network
  • Spectrogram
  • Vision transformer

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Dual-Stream Siamese Vision Transformer With Mutual Attention For Radar Gait Verification'. Together they form a unique fingerprint.

Cite this