Projects/Publications

Recent Update: 2025-12-16

Projects

t2mhumanfeedback
Fine-tune a motion generative model through human feedback.
Integrate human feedback into the text-to-motion model fine-tuning. Guide humanoid motion to better align with human preferences.

Papers

OnlineHMR
OnlineHMR: Video-based Online World-Grounded Human Mesh Recovery
Yiwen Zhao, Ce Zheng, Yufu Wang, Hsueh-Han Daniel Yang, Liting Wen, Laszlo A. Jeni
in submission
CRISP
CRISP: Contact-guided Real2Sim from Monocular Video with Planar Scene Primitives
Zihan Wang*, Jiashun Wang*, Jeff Tan, Yiwen Zhao, Jessica K. Hodgins, Shubham Tulsiani, Deva Ramanan
in submission | project page | paper | code
FreeDance
FreeDance: Towards Harmonic Free-Number Group Dance Generation via a Unified Framework
Yiwen Zhao, Yang Wang, Liting Wen, Hengyuan Zhang, Xingqun Qi
[ICCV 2025]Travel Grant | project page | paper | code
ARECHO
ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
Jiatong Shi, Yifan Cheng, Bo-Hao Su, Hye-jin Shim, Jinchuan Tian, Samuele Cornell, Yiwen Zhao, Siddhant Arora, Shinji Watanabe
[NeurIPS 2025]Spotlight | paper | code
SLMSVS
Adapting Speech Language Model to Singing Voice Synthesis
Yiwen Zhao, Jiatong Shi, Jinchuan Tian, Yuxun Tang, Jiarui Hai, Jionghao Han, Shinji Watanabe
[NeurIPSW 2025 AI4Music]Student Grant | project page | paper | code
SpeechLM
ESPnet-SpeechLM: An Open Speech Language Model Toolkit
Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Mackaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
[NAACL 2025] (Demo) | paper | code
SVSAug
Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty
Yiwen Zhao, Jiatong Shi, Yuxun Tang, William Chen, Shinji Watanabe
[ASRU 2025] | project page | paper | code
VERSA
VERSA-v2: A Modular and Scalable Toolkit for Speech and Audio Evaluation with Expanded Metrics, Visualization, and LLM Integration
Jiatong Shi, Bo-Hao Su, Shikhar Bharadwaj, Yiwen Zhao, Shih-Heng Wang, Jionghao Han, Haoran Wang, Wei Wang, Wenhao Feng, Yuxun Tang, Siddhant Arora, Jinchuan Tian, William Chen, Hye-jin Shim, Wangyou Zhang, Wen-Chin Huang, Shinji Watanabe
[ASRU 2025] (Demo) Best Demo Candidate
VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, Shinji Watanabe
[NAACL 2025] (Demo) | paper | code
FashionChatroom
Fashion Chatroom: An Automated Pipeline for Fashion Dataset Construction
Yiwen Zhao, Huizhu Jia, Shanghang Zhang
[AAAIW 2024 AI4CSE] | paper
VRLocomotion
Exploring Locomotion Methods with Upright Redirected Views for VR Users in Reclining & Lying Positions
Tianren Luo, Chenyang Cai, Yiwen Zhao, Yachun Fan, Zhigeng Pan, Teng Han, Feng Tian
[UIST 2023]Oral | paper