Abstract
Recording real life human motion as a skinned mesh animation with an acceptable quality is usually difficult.
Even though recent advances in pose estimation have enabled motion capture from off-the-shelf webcams, the low quality makes it infeasible for use in production quality animation.
This work proposes to use recent advances in the prediction of human motion through neural networks to augment low quality human motion, in an effort to bridge the gap between cheap recording methods and high quality recording.
First, a model, competitive with prior work in short-term human motion prediction, is constructed.
Then, the model is trained to clean up motion from two low quality input sources, mimicking a real world scenario of recording human motion through two webcams.
Experiments on simulated data show that the model is capable of significantly reducing noise, and it opens the way for future work to test the model on annotated data.
Even though recent advances in pose estimation have enabled motion capture from off-the-shelf webcams, the low quality makes it infeasible for use in production quality animation.
This work proposes to use recent advances in the prediction of human motion through neural networks to augment low quality human motion, in an effort to bridge the gap between cheap recording methods and high quality recording.
First, a model, competitive with prior work in short-term human motion prediction, is constructed.
Then, the model is trained to clean up motion from two low quality input sources, mimicking a real world scenario of recording human motion through two webcams.
Experiments on simulated data show that the model is capable of significantly reducing noise, and it opens the way for future work to test the model on annotated data.
Original language | English |
---|---|
Title of host publication | International Conference on Pattern Recognition Applications and Methods (ICPRA) 2022 |
Publisher | https://www.scitepress.org/ProceedingsDetails.aspx?ID=ajMWuYUO5gc=&t=1 |
Publication date | Feb 2022 |
Publication status | Published - Feb 2022 |
Keywords
- body motion
- recurrent neural networks
- motion capture
- denoising
- noise
- animation
Fingerprint
Dive into the research topics of 'Neural Network-Based Human Motion Smoother'. Together they form a unique fingerprint.Prizes
-
Best Student Paper Award in 11th International Conference on Pattern Recognition Applications and Methods
Bastholm, M. (Recipient), Grasshof, S. (Recipient) & Brandt, S. (Recipient), 5 Feb 2022
Prize: Prizes, scholarships, distinctions