| abstract |
The invention discloses an action detection method based on asymmetric multi-stream, comprising the following steps: extracting RGB image and optical flow from prior video, training to obtain trained RGB image single-stream network and optical flow single-stream network; extracting prior The image flow feature information and optical flow feature information of each frame in the video, combined with the action label, trains an asymmetric two-stream network; through the trained RGB image single-stream network and optical flow single-stream network, extract the target video of each frame to be detected. Image flow feature information and optical flow feature information, obtain the segment features of the target video and input it into the trained asymmetric two-stream network, and calculate and obtain the video classification vector; select potential actions from the video classification vector, and obtain the action recognition sequence of potential actions; through The action recognition sequence completes the detection of actions. The motion detection method of the present invention takes into account the asymmetry between image flow and optical flow, and can improve the accuracy of motion recognition and motion detection. |