| abstract |
The invention relates to a micro-expression recognition method and system based on optical flow and RGB modal contrastive learning, including: A. Preprocessing micro-expression videos, including: acquiring video frame sequences, face detection and positioning, and face alignment And extract optical flow sequence features and RGB sequence features; B. Extract optical flow sequence features and RGB sequence features from the micro-expression dataset, and divide it into a test set and a training set; C. Build a dual-modal contrastive learning and recognition model, including Three-dimensional convolutional residual network, three-dimensional convolutional residual network encodes optical flow sequence features and RGB sequence features respectively; D. Construct cross entropy loss and contrastive learning loss, and use loss function to train dual-modal contrastive learning and recognition model; E. Classification and recognition, according to the trained dual-modal contrast learning recognition model, classify and recognize the test set. The present invention uses supervised information and unsupervised information to constrain the network at the same time, so as to obtain stronger feature expression. |