Projects/Publications

Recent Update: 2025-10-2

Projects

t2mhumanfeedback
Fine-tune a motion generative model through human feedback.
Integrate human feedback into the text-to-motion model fine-tuning. Guide humanoid motion to better align with human preferences.
onlineHMR
Video-based human mesh recovery.
Deal with the challenge of online input, world-coordinate human paramatric model streaming inference.

Conference Papers

FreeDance
FreeDance: Towards Harmonic Free-Number Group Dance Generation via a Unified Framework
Yiwen Zhao, Yang Wang, Liting Wen, Hengyuan Zhang, Xingqun Qi
[ICCV 2025]Travel Grant | project page | paper(coming soon) | code
SVSAug
Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty
Yiwen Zhao, Jiatong Shi, Yuxun Tang, William Chen, Shinji Watanabe
[ASRU 2025] | project page | paper(coming soon) | code(coming soon)
ARECHO
ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
Jiatong Shi, Yifan Cheng, Bo-Hao Su, Hye-jin Shim, Jinchuan Tian, Samuele Cornell, Yiwen Zhao, Siddhant Arora, Shinji Watanabe
[NeurIPS 2025]Spotlight | paper | code
SpeechLM
ESPnet-SpeechLM: An Open Speech Language Model Toolkit
Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Mackaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
[NAACL 2025] (Demo) | paper | code
VERSA
VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, Shinji Watanabe
[NAACL 2025] (Demo) | paper | code
VRLocomotion
Exploring Locomotion Methods with Upright Redirected Views for VR Users in Reclining & Lying Positions
Tianren Luo, Chenyang Cai, Yiwen Zhao, Yachun Fan, Zhigeng Pan, Teng Han, Feng Tian
[UIST 2023]Oral | paper

Workshop Papers

SLMSVS
Adapting Speech Language Model to Singing Voice Synthesis
Yiwen Zhao, Jiatong Shi, Jinchuan Tian, Yuxun Tang, Jiarui Hai, Jionghao Han, Shinji Watanabe
[NeurIPSW 2025 AI4Music]Student Grant | paper(coming soon) | code
FashionChatroom
Fashion Chatroom: An Automated Pipeline for Fashion Dataset Construction
Yiwen Zhao, Huizhu Jia, Shanghang Zhang
[AAAIW 2024 AI4CSE] | paper

Underreview Papers

CRISP
CRISP: Contact-guided Real2Sim from Monocular Video with Planar Scene Primitives
Zihan Wang, Jiashun Wang, Jeff Tan, Yiwen Zhao, Jessica K. Hodgins, Shubham Tulsiani, Deva Ramanan
in submission