I'm currently a final-Year Ph.D. student in the Department of Computer Science, working with Prof. Taku Komura. My research lies in Human Motion and Virtual Avatar, I hope diverse human motions can be captured and reenacted into the virtual world to bring more fantasies to our life. For that, I am developing an advanced motion capture system and motion generation framework.

Before that, I got my B.Eng. and M.Sc. degree from Shandong University, supervised by Prof. Baoquan Chen. I spent three wonderful years(2017~2020) in Reality Capture Group in Beijing Film Academy and the CFCS in Peking University collaborated with the best research scientist Kfir Aberman.

Experiences

• 10/2022~03/2023, Pittsburgh, FAIR(Facebook AI Research) with Jungdam Won.

• 06/2020~10/2020, Shanghai, Electronic Arts with Sebastian Starke and Yiwei Zhao

• I enjoyed the time in CYENS, Tencent AI Lab and miHoYo.

Publications

Taming Diffusion Probabilistic Models for Character Control

Rui Chen*, Mingyi Shi* , Shaoli Huang, Ping Tan, Taku Komura, Xuelin Chen

SIGGRAPGH 2024, Conference track

*Joint first author

[webpage] [paper] [exe]

PhaseMP: Robust 3D Pose Estimation via Phase-conditioned Human Motion Prior

Mingyi Shi, Sebastian Starke, Yuting Ye, Taku Komura, Jungdam Won

ICCV 2023

[webpage][paper] [code is coming soon]

Normalized Human Pose Features for Human Action Video Alignment

Jingyuan Liu, Mingyi Shi, Qifeng Chen, Hongbo Fu, Chiew-Lan Tai

ICCV 2021, oral

[paper] [supp]

MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency

Mingyi Shi, Kfir Aberman, Andreas Aristidou, Taku Komura, Dani Lischinski, Daniel Cohen-Or, Baoquan Chen

ToG 2020, presented in SIGGRAPH Asia 2020

[webpage][paper][video][code]

Deep Video-Based Performance Cloning

Kfir Aberman, Mingyi Shi, Jing Liao, Dani Lischinski, Baoquan Chen, Daniel Cohen-Or

Eurographics 2019

[paper][video]

Neural Best-Buddies: Sparse Cross-Domain Correspondence

Kfir Aberman, Jing Liao, Mingyi Shi, Dani Lischinski, Baoquan Chen, Daniel Cohen-Or

SIGGRAPH 2018

[webpage][paper][video][code]

Group optimization for multi-attribute visual embedding

Qiong Zeng, Wenzheng Chen, Zhuo Han, Mingyi Shi, Yanir Kleiman, Daniel Cohen-Or, Baoquan Chen, Yangyan Li

Visual Informatics 2018

[paper]

Academic Service

I help to review papers for:

• Conference: SIGGRAPH, SIGGRAPH Asia, Eurographics
• Journal: TOG(Transactions on Graphics), TVCG, CGF