Portal de Periódicos da CAPES

A variational U‐Net for motion retargeting

2020; Wiley; Volume: 31; Issue: 4-5 Linguagem: Inglês

10.1002/cav.1947

1546-427X

Seong Uk Kim, Hanyoung Jang, Jongmin Kim,

Video Analysis and Summarization

Abstract Motion retargeting is the process of copying motion from one character (source) to another (target) when the source and target body sizes and proportions (of arms, legs, torso, etc.) are different. The problem of automatic motion retargeting has been studied for several decades; however, the motion quality obtained with the application of current approaches is on occasion unrealistic. This is because previous methods, which are mainly based on numerical optimization, generally do not incorporate prior knowledge of the details and nuances of human movements. To address these issues, we present a novel human motion retargeting system using a deep learning framework with large‐scale motion data to produce high‐quality retargeted human motion. We establish a deep‐learning‐based motion retargeting system using a variational deep autoencoder combining the deep convolutional inverse graphics network (DC‐IGN) and the U‐Net. The DC‐IGN is utilized for disentangling the motion of each body part, while the U‐Net is employed to preserve details of the original motion. We conduct several experiments to validate the proposed motion retargeting system, and find that ours achieves better accuracy along with reduced computational burden when compared with the conventional motion retargeting approach and other neural network architectures.