wikillm

Paper · 2021-02-18 · cs.CV

Deep Gait Recognition: A Survey

Survey of vision-based gait recognition with deep learning, covering work up to January 2021. It proposes a four-dimension taxonomy (body representation, temporal representation, feature representation, neural architecture), reviews 15 gait datasets and their test protocols, and tabulates the reported results. Best author-reported CASIA-B average: 90.4% (3DCNNGait).

Convolutional neural networkRecurrent neural network (RNN)Generative adversarial network (GAN)Metric learningsurveygait-recognitionbiometricscomputer-vision

arXivPDFMarkdown18 min read

AI-compiled by claude-haiku-5-5 on 2026-11-06, not yet reviewed by a human. Every claim cites its source; check it when a detail matters.

In plain words

Gait recognition means identifying a person from the way they walk, using video of them taken from some distance. This paper is a survey: it reads the research on that problem since deep neural networks became common, and organizes it.

The authors sort the work along four questions. How is the body shown to the network: as a silhouette outline or as a set of joint positions? How is time handled: by squashing a whole walk into one summary picture, or by keeping the frames in order? Which part of the body is looked at: the whole figure or separate regions? And which network design is used?

The paper also lists the public video datasets people train and test on, explains how the tests are usually run, and collects the reported accuracy numbers in tables. It ends with open problems, such as disentangling identity from clothing and carried objects, learning without labels, and testing on datasets the model was not trained on.

TL;DR

A survey of deep gait recognition from video up to January 2021, with a four-dimension taxonomy of methods, 15 datasets with their protocols, and comparison tables for CASIA-B, OU-ISIR and OU-MVLP. The authors report that silhouettes are the dominant body representation and CASIA-B is the most used dataset. Use it to find which methods, datasets and test protocols exist. Do not use its numbers as a fair ranking: they are copied from the original papers, and the paper's own sources of error are listed under Pitfalls.

Problem

The paper lists what degrades gait recognition: clothing and carried objects, viewpoint, self-occlusion, complex backgrounds and lighting §1. The person's own state (fatigue, excitement or fear, injury) can also change the walk §1.1. Section 1.1 also explains why gait differs from face or fingerprint recognition: it works at a distance and without the subject's cooperation, and it is hard to fake. Gait is also a finer signal than the activity-recognition problems it is often compared with, because walking is the common base and the identity cues are small differences within it §1.1.

Before this survey, the vision-based gait reviews stopped at about mid-2018 and none focused on deep methods §1.2. The paper states that the field changed sharply after 2015 and that most methods from 2019 and 2020 use deep networks §1.2 fig. 1.

Method

This is a literature review. There is no model, loss or training procedure to implement. The "method" is the search and classification procedure, and the reference data that goes with it. An implementer should use the tables and protocols, not the survey text, as the source.

  1. Search protocol §2. Candidate papers came from Google Scholar, IEEE Xplore, the ACM Digital Library, ScienceDirect and CVF Open Access. Search terms: "gait recognition", "gait identification", "gait biometric", "neural architecture", "deep learning", "deep representations". Forward and backward citation chasing followed. The date filter starts in 2014.

  2. Inclusion rules §2. Papers were excluded if they (i) use non-vision sensors, (ii) propose no new solution, (iii) use non-standard or private datasets, or (iv) do not compare with the state of the art. Where a paper combines vision with another modality, only the vision part is reviewed.

  3. Test protocols §3.1 fig. 3. Protocols are subject-dependent (training and test sets share subjects, as in TUM GAID) or subject-independent (test subjects are disjoint from training subjects, as in CASIA-B and OU-MVLP). In the subject-independent case, the test subjects are split into gallery and probe sets. A classifier then matches each probe against the gallery. All results are reported as rank-1 accuracy §3.1.

  4. Datasets §3.2 tab. 1. Fifteen vision datasets are reviewed. Table 1 gives the data type, subjects and sequences, environment, number of views and the variations covered. Dataset-specific protocols are described in §3.2 and their parameters are in the Hyperparameters section below.

  5. Body representation §4.1. Two options: silhouettes (binary foreground masks) or skeletons (joint positions from a depth camera or a pose estimator). Silhouettes are cheap and focus on gait rather than clothing, but they are sensitive to appearance. Skeletons are more robust to viewpoint and clothing, but they depend on accurate joint detection and need extra computation §4.1.

  6. Temporal representation §4.2 fig. 5. Two families. Templates collapse a sequence into one map, for example by averaging silhouettes over one gait cycle or over the whole sequence. This makes the output independent of sequence length. Volumes keep the frame order and feed a 3D tensor to a 3D CNN or a recurrent network §4.2. Template variants named in §4.2: gait energy image (GEI), chrono gait image (CGI), frame-difference energy image (FDEI), gait entropy image (GEnI), period energy image (PEI); convolutional templates such as set pooling and GCEM.

    Pseudocode
    # Gait energy image (GEI)  [§4.2]
    # Input:  silhouettes (T, H, W), binary
    # Output: template (H, W)
    def gait_energy_image(silhouettes):
        # Average the silhouettes over one gait cycle or the whole sequence  [§4.2]
        template = mean(silhouettes, axis=0)     # (H, W)
        return template
  7. Feature representation §4.3. Global methods learn from the whole silhouette or skeleton. Partial methods split it into regions (patches, body parts, horizontal bins) and learn each region, often with RNNs, capsules, attention or fully connected layers §4.3. Partial methods can learn how much each region contributes §4.3.

  8. Neural architectures §4.4. Nine families, each with its own subsection:

    • CNN §4.4.1 tab. 2. The most used family. Most networks have fewer than 10 layers, and the input is 64×64 in most recent work. The paper cites an analysis (ref. B6) finding that 64×64 and 128×128 give the best results, with 128×128 slightly better §4.4.1.
    • DBN §4.4.2. Two methods use stacked restricted Boltzmann machines (refs. Biom and DBN2).
    • RNN §4.4.3. LSTM and GRU are the common cells. Three uses: RNNs on joint trajectories (ref. LSTM3), RNN combined with CNN (refs. LSTM1, LSTM2), and RNN over partial features of a convolutional template (refs. TBiom, ICPR).
    • DAE §4.4.4. Encoder-decoder networks whose bottleneck features are used for recognition, with the decoder reconstructing a temporal template. Some variants split identity features from covariate features (ref. CVPR20202).
    • GAN §4.4.5. Used for view transformation, clothing change or removal of carried objects, so that identity can be matched across conditions. Two discriminators are common: one for realism and one for identity preservation (ref. B9).
    • CapsNet §4.4.6. Capsules with dynamic routing model relations between body parts and between hierarchical sub-parts (refs. capsule1, ICPR, spyder).
    • 3D CNN §4.4.7. Spatio-temporal convolution over the stacked frames. Its stated limit is handling variable-length sequences; ref. MM uses several 3D CNNs at different temporal scales.
    • GCN §4.4.8. A spatio-temporal graph built from the sequence, with a joint relation learning step (ref. GCN2).
    • Hybrid §4.4.9. The four common pairings are CNN+RNN, DAE+GAN, DAE+RNN and RNN+CapsNet fig. 6 §4.4.9.
  9. Taxonomy classification §5 tab. 3. Every reviewed method is placed on the four dimensions, with its loss function and the datasets it reports. Table 3 is reproduced in full below. The "Key" is the paper's BibTeX key from raw/src/2102.09546/references.bib. The rendered paper numbers its references, so the key is the only stable handle for a method here.

Datasets (reproduced from tab. 1 §3.2)

DatasetYearData typeSubjects / sequencesEnvironmentViewsVariations
CMU MoBo2001RGB; silhouette25 / 600Indoor63 walking speeds; carrying a ball
SOTON2002RGB; silhouette115 / 2,128Indoor and outdoor2Normal walking on a treadmill
CASIA-A2003RGB20 / 240Outdoor3Normal walking
USF HumanID2005RGB122 / 1,870Outdoor2Outdoor walking; carrying a briefcase; time interval
CASIA-B2006RGB; silhouette124 / 13,680Indoor11Normal walking; carrying a bag; wearing a coat
CASIA-C2006Infrared; silhouette153 / 1,530Outdoor13 walking speeds; carrying a bag
OU-ISIR Speed2010Silhouette34 / 306Indoor4Nine walking speeds
OU-ISIR Clothing2010Silhouette68 / 2,746Indoor4Up to 32 clothing combinations
OU-ISIR MV2010Silhouette168 / 4,200Indoor2524 azimuth views and 1 top view
OU-ISIR2012Silhouette4,007 / 31,368Outdoor4Normal walking
TUM GAID2012RGB; depth; audio305 / 3,737Indoor1Normal walking; backpack; shoe covers
OU-ISIR LP Bag2017Silhouette62,528 / 187,584Indoor1Seven carried objects
OU-MVLP2018Silhouette10,307 / 259,013Indoor14Normal walking
CASIA-E2020Silhouette1,014 / undisclosedIndoor and outdoor153 scenes; normal walk; carrying a bag; wearing a coat
OU-MVLP Pose2020Skeleton10,307 / 259,013Indoor14Normal walking

Source: tab. 1 §3.2. The table is sorted by release year, as in the paper.

Taxonomy classification (tab. 3) §5

Source: tab. 3 §5. Columns follow the paper. "Key" is the BibTeX key from raw/src/2102.09546/references.bib. "not stated" means the table leaves the loss blank or lists it as undisclosed. The Key capsule2 appears twice, once for 2019 (JVCI) and once for 2020 (ITNEC), as in the source.

KeyYearVenueBodyTemporalFeatureArchitectureLossDataset
TMM2015T-MMSilhouetteGEIGlobalCNNCross-entropyCASIA-B
SOTA12015CISPSilhouetteGEIGlobalCNNnot statedCASIA-B
SOTA22016ICPRSkeletonSequence volumePartialLSTMnot statedCASIA-B
B82016ICBSilhouetteGEIGlobalCNNCross-entropyOU-ISIR
3DCNNICIP2016ICIPSilhouetteSequence volumeGlobal3D CNNnot statedCMU MoBo; USF HumanID
SOTA32016ICASSPSilhouetteGEIGlobalCNNContrastiveOU-ISIR
LSTM32016BMVCSkeletonSequence volumeGlobalCNN + LSTMCross-entropyCASIA-B; CASIA-A
Biom2017Int. J. Biom.SilhouetteGEIPartialDBNnot statedCASIA-B
SOTA42017CVIUSilhouetteGEIGlobalCNNnot statedCASIA-B
B62017IEEE T-PAMISilhouetteGEIGlobalCNNCross-entropyCASIA-B; OU-ISIR
SOTA52017Applied Sci.SilhouetteNorm. ACGlobalCNNnot statedOU-ISIR
SOTA62017IEEE T-CSVTSilhouetteGEIGlobalCNNTripletOU-ISIR
SOTA72017BIOSIGSilhouetteGEIGlobalCNNnot statedTUM-GAID
SOTA312017MMSilhouetteGEIGlobalCNNTripletOU-ISIR
SOTA302017CCBRSkeletonSequence volumeGlobalCNN + LSTMnot statedCASIA-B
GAN52017CVPRWSilhouetteGEIGlobalGANCross-entropyCASIA-B
DAE12017NeurocomputingSilhouetteGEIGlobalDAEEuclideanCASIA-B; SZU RGB-D
SOTA222018Electronic ImagingSilhouetteSequence volumeGlobal3D CNNnot statedCASIA-B
CNNLSTM12018IEEE AccessSilhouetteSequence volumeGlobalCNN + LSTMCross-entropyCASIA-C
SOTA212018NeuroinformaticsSilhouetteSequence volume + GEIGlobal3D CNNContrastiveOU-ISIR
DIC2018DICSkeletonGEIGlobalCNNCross-entropyCASIA-B
SOTA82018IEEE AccessSilhouetteSequence volumeGlobalCNN + LSTMCross-entropyCASIA-B; OU-ISIR
SOTA92018ISBASilhouetteSequence volumeGlobal3D CNNnot statedCASIA-B
DAEGAN22018ICMESilhouetteGEIPart; globalDAE + GANCross-entropyCASIA-B
SOTA172018JVCIRSilhouetteGEIGlobalCNNCross-entropyCASIA-B; OU-ISIR
SOTA182018CCBRSkeletonSequence volumeGlobalCNN + LSTMnot statedCASIA-B
PRL2019PRLSkeleton; silhouetteSequence volumeGlobalLSTMnot statedCASIA-B; TUM-GAID
IETBiom2019IET Biom.SilhouetteWeighted averagePartialCNNnot statedCASIA-B; TUM; OU-ISIR
B32019CVPRSkeleton; silhouetteSequence volumeGlobalDAE + LSTMMultiple loss functionsCASIA-B; FVG
SOTA272019J. Sys. Arch.SilhouetteGEIGlobalDAE + GANMultiple loss functionsCASIA-B; OU-ISIR
B102019PRSilhouetteGEIGlobalCNNSiameseCASIA-B; SZU
B72019IEEE T-IFSSilhouetteGEIGlobalGANAdversarial & cross-entropyCASIA-B; OU-ISIR
SOTA242019PRLSilhouetteGEIGlobalCNNRestrictive tripletCASIA-B; OU-ISIR
SOTA102019CVPRSilhouetteGEIGlobalCNNQuintupletCASIA-B; OU-ISIR LP Bag
GAN32019NeurocomputingSilhouetteGEIGlobalGANPixel-wise and entropyCASIA-B; OU-ISIR
SOTA262019IJCNNSilhouetteGEIGlobalGANMultiple loss functionsCASIA-B
R62019IEEE T-IFSSkeletonGEIGlobalDAEContrastive & tripletOU-ISIR LP Bag; TUM-GAID
opt12019ICVIPSilhouetteWeighted averagePartialCNNView & cross-entropyCASIA-B
SOTA252019IEEE T-MMSilhouetteSequence volumeGlobalCNN + LSTMContrastiveCASIA-B; OU-ISIR
SOTA292019IJCNNSilhouetteGEIGlobalGANMultiple loss functionsCASIA-B
SOTA282019NCAASilhouetteGEIGlobalCNNnot statedCASIA-B; CASIA-A; OU-ISIR
SOTA232019PRSilhouetteSet poolingGlobalCNNCenter & softmaxCASIA-B
NCAA2019NCAASilhouetteGEIGlobalCNNnot statedCASIA-B; OU-ISIR
capsule22019JVCISilhouetteGEIGlobalCapsNetStandard capsule lossCASIA-B
B12019AAAISilhouetteSet poolingPartialCNNBatch-all tripletCASIA-B; OU-MVLP
RNNAE2020IEEE AccessSkeletonSequence volumeGlobalDAE + LSTMMean squared errorWalking gait (dataset not named)
PR52020PRSkeletonSequence volumePartialCNNCenter & softmaxCASIA-B; CASIA-E
B42020IEEE T-PAMISkeleton; silhouetteSequence volumeGlobalDAE + LSTMMultiple loss functionsCASIA-B; FVG
TIP2020IEEE T-IPSilhouetteSequence volumePartialCNN + LSTMAngle centerCASIA-B; OU-MVLP; OU-LP
GAN42020PRSilhouetteGEIGlobalGANMultiple loss functionsOULP-BAG; OU-ISIR LP Bag
SOTA112020MTAPSilhouetteMF-GEIGlobalCNNnot statedCASIA-B
spyder2020KBSSilhouetteSequence volumeGlobalLSTM + capsuleCapsule & memoryCASIA-B; OU-MVLP
SOTA162020JINSSilhouetteGEIGlobalCNN + LSTMnot statedCASIA-B; OU-ISIR
CSVT2020IEEE T-CSVTSilhouetteGEIGlobalCNNContrastive & tripletCASIA-B; OU-MVLP; OU-ISIR
arXiv2020arXivSilhouetteSequence volumeGlobal3D CNNTripletCASIA-B; OU-MVLP
MTAP22020MTAPSilhouetteGEIPartialCNNnot statedCASIA-B; OU-ISIR
GCN22020arXivSkeletonSequence volumeGlobalGCNTriplet & ArcFaceCASIA-B
MTAP32020MTAPSilhouetteGEIGlobalCNNnot statedCASIA-B; OU-ISIR
SOTA152020JIPSSilhouetteGEIGlobalCNNSoft-maxCASIA-B; OU-ISIR
MTAP42020MTAPSilhouetteGEIGlobalCNNnot statedCASIA-B
Supercom2020J. Supercomput.SilhouetteGEIGlobalCNNnot statedCASIA-B; OU-ISIR; OU-MVLP
capsule22020ITNECSilhouetteGEIGlobalCapsNetStandard capsule lossCASIA-B; OU-ISIR
CVPR202012020CVPRSilhouetteHorizontal poolingPartialCNNBatch-all tripletCASIA-B; OU-MVLP
CVPR202022020CVPRSilhouetteGEIGlobalDAEContrastive & tripletCASIA-B; OU-ISIR LP Bag
Tbiom22020IEEE T-Biom.SkeletonSequence volumeGlobalCNN + LSTMCross-entropy & centerOUMVLP-Pose
ACCVW12020ACCVWSilhouetteSet poolingPartialCNNBatch-all tripletCASIA-E
ACCVW22020ACCVWSilhouetteSet poolingPartialCNNBatch-all tripletCASIA-E
ICPR2020ICPRSilhouetteSet poolingPartialCNN + GRU + capsuleTriplet & cosine proximityCASIA-B; OU-MVLP
TBiom2020IEEE T-Biom.SilhouetteGCEMPartialCNN + GRUTriplet & cross-entropyCASIA-B; OU-MVLP
SOTA202020IEEE AccessSilhouetteSet poolingGlobalCNNTripletCASIA-B
ICASSP32019ICASSPSilhouettePoolingGlobalCNNCenter-rankedCASIA-B; OU-MVLP
SOTA192020IJCBSilhouetteGEIGlobalDAE + GANCenter & soft-maxCASIA-B; OU-ISIR
ACCV2020ACCVSkeleton; silhouetteSequence volumeGlobalCNN + LSTMMultiple loss functionsCASIA-B; OU-MVLP
MM2020MMSilhouetteSequence volumeGlobal3D CNNMultiple triplet lossesCASIA-B; OU-ISIR
ECCV2020ECCVSilhouetteSet poolingGlobalCNNTriplet & cross-entropyCASIA-B; OU-MVLP

Hyperparameters

The survey trains nothing, so it reports no training hyperparameters (no learning rates, optimizers, batch sizes or epochs). The parameters that do matter for reproducing the reported comparisons are the dataset protocol splits and the architecture facts below.

Protocol parameters

DatasetParameterValueSource
CASIA-BTraining subjectsfirst 74§3.2
CASIA-BTest subjectsremaining 50§3.2
CASIA-BGalleryfirst 4 NM sequences per subject per view§3.2
CASIA-BProberemaining 2 NM, 2 CL and 2 BG sequences per subject per view§3.2
CASIA-BProbe views equal to the gallery viewexcluded from the reported results§3.2
CASIA-BViews11, from 0° to 180° in 18° steps§3.2
OU-ISIRGallery / probefirst sequence / second sequence per subject§3.2
OU-MVLPTraining / test subjects5,153 / 5,154 (pre-determined lists)§3.2
OU-MVLPGallery / probesessions 1 / 2§3.2
OU-MVLPCommonly used anglesall 14, or 0°, 30°, 60°, 90°§3.2
OU-LP BagTraining / test subjects29,097 / 29,102§3.2
CASIA-ETrainingfirst 500 subjects; validation: 25 sequences from the last 514§3.2
TUM GAIDProtocoltraining, validation and test split from the original authors§3.2

The CASIA-B probe-view exclusion is stated as "excluding the probe sequences with angles identical to the references" §3.2. The paper does not say how a probe is paired with a reference when the view changes. See Pitfalls.

Input size and depth of the reviewed CNNs

Source: tab. 2 §4.4.1. Layer counts are as the paper reports them.

MethodInput sizeTotal layersConvPoolFC
GEINet (B8)88×1286222
Ensem. CNNs (B6)128×1287322
MGANs (B7)64×648413
EV-Gait (B2)128×1289602
Gait-joint (B10)64×64161222
GaitSet (B1)64×649621
Gait-RNNPart (TBiom)64×649621
GaitPart (CVPR20201)64×649621
SMPL (ACCV)64×645311
Caps-Gait (ICPR)64×649621

Results

Author-reported numbers copied from the original papers. The survey does not rerun any method. The setup is the CASIA-B, OU-ISIR and OU-MVLP protocols in §3.2, with rank-1 accuracy §3.1. The survey says it kept only methods that followed those standard protocols §5.2. No hardware or training budgets are stated.

CASIA-B tab. 4 §5.2

NM, BG and CL are normal walking, walking with a bag, and walking with a coat. A dash means the value is not reported.

ReferenceYearVenueNMBGCLAverage
TMM2015IEEE T-MM78.9———
Biom2017Int. J. Biom.90.845.945.360.7
B62017IEEE T-PAMI94.172.454.073.5
DIC2018DIC83.3—62.5—
SOTA232019PR75.0———
B72019IEEE T-IFS79.8———
B102019PR89.9———
B32019CVPR93.982.663.279.9
B22019CVPR89.9———
IETBiom2019IET Biom.94.578.651.674.9
PRL2019PRL86.1———
B1 (GaitSet)2019AAAI95.087.270.484.2
B42020IEEE T-PAMI92.388.962.381.2
TIP2020IEEE T-IP96.0———
CSVT2020IEEE T-CSVT92.7———
SOTA202020IEEE Access95.187.974.085.7
ICPR2020ICPR95.790.772.486.3
TBiom2020IEEE T-Biom.95.289.774.786.5
CVPR20201 (GaitPart)2020CVPR96.291.578.788.8
CVPR202022020CVPR94.5———
ECCV (GLN)2020ECCV96.894.077.589.4
ACCV (HMRGait)2020ACCV97.993.177.689.5
MM (3DCNNGait)2020MM96.793.081.590.4

Bold marks the best value in each column, as in the paper.

OU-ISIR tab. 5 §5.2

ReferenceYearVenueRank-1 (%)
SOTA32016ICASSP90.71
B62017IEEE T-PAMI92.77
SOTA52017Applied Sci.91.25
SOTA212018Neuroinform.88.56
SOTA82018IEEE Access95.67
IETBiom2019IET Biom.97.40
B72019IEEE T-IFS93.20
SOTA242019PRL94.62
SOTA252019IEEE T-MM97.26
SOTA192020IJCB94.17
CSVT2020IEEE T-CSVT98.93
TIP2020IEEE T-IP99.27
MM2020MM99.90

OU-MVLP tab. 6 §5.2

ReferenceYearVenueRank-1 (%)
B1 (GaitSet)2019AAAI83.40
ICASSP32020ICASSP57.80
CSVT2020IEEE T-CSVT63.10
TIP2020IEEE T-IP84.60
ICPR2020ICPR84.50
TBiom2020IEEE T-Biom.84.30
CVPR20201 (GaitPart)2020CVPR88.70
ECCV (GLN)2020ECCV89.18

Headline numbers, as the survey states them §1.2 §5.2: 84.2% CASIA-B by GaitSet (2019); 90.4% CASIA-B average by 3DCNNGait (2020); 99.9% OU-ISIR by ref. MM; 89.18% OU-MVLP by GLN.

  • Silhouettes are used by over 81% of the reviewed methods, skeletons by about 13%, and both by about 5% §5.1.
  • Gait templates are used by about 70% of the methods, and sequence volumes by about 30% §5.1.
  • Global feature learning covers over 87% of methods §5.1.
  • 2D CNNs are used alone by 48% of methods; 3D CNNs and GANs by 8% each; hybrids by 26%, of which CNN+RNN is 16% §5.1.
  • Cross-entropy is the most used single loss (20%), followed by triplet loss (17%), contrastive loss (7%) and softmax (6%). Multiple losses are used by 41% §5.1.
  • CASIA-B appears in about 80% of the reviewed literature, OU-ISIR in 40%, OU-MVLP in 18%, OU-ISIR LP Bag in 5%, TUM GAID in 5% and CASIA-E in 4% §5.1.

Paper vs code

No official code.

What I checked: the paper, its abstract and the arXiv metadata have no code link or project page. A GitHub repository search for "deep gait recognition survey" returned no results. A second search for "sepas-moghaddam gait" also returned no results. Nothing was cloned, because a survey has no implementation.

Pitfalls

  • Survey numbers are not a fair ranking. The tables gather results from different papers with different splits, preprocessing and training budgets. The survey's own claim that it included only standard protocols §5.2 is an assertion, and the paper does not show that each row followed the protocol. Compare only within one row's source paper, or re-run the methods under one protocol.
  • Missing values are not zero. Many Table 4 entries have only one or two of the three conditions, and the average is then "—" tab. 4. Where all three are present, the average matches the mean of the three to one decimal place (for example B1: (95.0 + 87.2 + 70.4) / 3 = 84.2). Use the average only where the three columns are all present.
  • The CASIA-B probe-view rule is ambiguous. The paper says probes with an angle "identical to the references" are excluded §3.2, but it does not say which gallery angle each probe is matched to. The survey leaves this open. Read the source paper of the method you reproduce.
  • Section 6 in the Organization paragraph is out of date. The paragraph in §1.4 says the challenges are in Section 6. The compiled section numbering is 6 for adversarial attacks and 7 for challenges, because the adversarial section was added later. This card follows the compiled numbering, counted from the \section commands in the LaTeX source.
  • Layer counts are inconsistent. §4.4.1 says that "fewer than 10 layers" suffice, but tab. 2 lists Gait-joint with 16 layers. EV-Gait is listed with a total of 9 layers, but its conv, pool and FC counts add to 8.
  • CASIA-E year conflict. The dataset text says CASIA-E was developed in 2020 §3.2, and tab. 1 gives 2020. Yet the paper that uses CASIA-E (key SOTA23) is listed as 2019 in tab. 3 and tab. 4.
  • ICASSP3 year conflict. tab. 3 gives ICASSP3 as 2019, but it sits in the 2020 block of that table, and tab. 6 gives it as 2020. Check the source.
  • OU-ISIR Speed count does not match. The text says "nine different speeds, ranging from 2 km/h to 11 km/h, with 1 km/h interval" §3.2. Stepping 1 km/h from 2 to 11 gives 10 speeds. Treat the speed list as unverified.
  • The CNN resolution claim is a second-hand result. The 128×128 vs 64×64 finding is cited to ref. B6 and is not reproduced here §4.4.1.
  • Dataset details are thin. Several datasets are described only by a sentence (CMU MoBo, SOTON, CASIA-A). The survey says SOTON has no pre-defined protocol §3.2. Expect to read the dataset paper for exact splits.
  • Hybrid costs are not measured. The survey says that pose estimation adds computation §4.1 and that hybrids perform well §5.1, but it reports no runtimes, parameter counts or memory use.
  • Privacy and synthesis are only proposed. §7.4 suggests synthetic subjects to ease privacy concerns, but no method or dataset is evaluated.

Open problems (author-stated) §7

  • Disentanglement §7.1: separate identity from covariates such as view, appearance, sequence order, body-part motion and lighting. Few methods do this so far.
  • Self-supervised learning §7.2: learn from unlabelled gait with pretext tasks, such as body-part motion or sequence order, possibly several at once. Designing good pretext tasks is the stated difficulty.
  • Multi-task learning §7.3: most methods train only for identity. Auxiliary tasks such as affect, gender and age are named as options.
  • Data synthesis and domain adaptation §7.4: GANs or game engines could create data and reduce privacy concerns; domain adaptation could add missing variations to OU-ISIR and OU-MVLP.
  • Cross-dataset evaluation §7.5: no cross-dataset study on CASIA-B, OU-ISIR or OU-MVLP existed at the time. Out-of-distribution testing is suggested.
  • Multi-view recognition §7.6: most methods learn one view at a time; multi-view LSTM variants exist, but unknown or moving viewpoints remain open.
  • Multi-biometric recognition §7.7: fuse gait with face, ear and soft traits such as height, weight and age.

Lineage

  • Surveys it positions itself against: vision-based gait surveys covering work up to mid-2018 and a wearable-sensor survey §1.2 §1. None is linked here, because they are not in the wiki.
  • Methods it singles out as the state of the art: GaitSet (ref. B1) §5.2; 3DCNNGait (ref. MM) §5.2; GLN (ref. ECCV) §5.2; GaitPart (ref. CVPR20201) §5.2.
  • Superseded by: not stated in the paper, and not known from content in this wiki.

Source and license

Adapted from “Deep Gait Recognition: A Survey” by Alireza Sepas-Moghaddam, Ali Etemad (arXiv:2102.09546), used under CC BY 4.0. Changes: condensed and restructured for implementation, with tables, equations and algorithms taken from the paper and its code, each cited to its source. Not affiliated with or endorsed by the authors.