Biography
Zhanpeng Jin is a tenured Professor and Xinshi Endowed Professor at South China University of Technology (SCUT), where he serves as Associate Dean of the School of Future Technology and Deputy Director of both the MOE Engineering Research Center for Human Body Data Sensing and the Guangdong Key Lab of Digital Twin Humans. He was previously a tenured Associate Professor at the University at Buffalo, SUNY, where he directed the Cyber-Med Lab and served as Director of Graduate Studies. He is a Senior Member of ACM and IEEE. He is a Executive Committee member of CCF Technical Committees of Ubiquitous Computing, Human-Computer Interaction, and Internet-of-Things. His research focuses on artificial intelligence, ubiquitous computing, HCI, intelligent sensing, proactive health, and IoTs. He has served as a reviewer for agencies including NSF, NIST, NWO, and ORF. He is currently Associate Editor for ACM Computing Surveys, ACM IMWUT, Elsevier CBM, and CCF TPCI, and reviewer for 30+ international venues. He haspublished 160+ papers and advised over 20 Ph.D. students and over 60 M.S. students, now working in top universities and leading tech companies.
Education
2007-2010, University of Pittsburgh, Ph.D.
2003-2006, Northwestern Polytechnical University, MS
1999-2003, Northwestern Polytechnical University, BS
Work Experience
2022-Present, South China University of Technology, Professor
2018-2022, University at Buffalo, SUNY, Associate Professor
2011-2018, Binghamton University, SUNY, Associate Professor
2011-2017, Binghamton University, SUNY, Assistant Professor
2010-2011, University of Illinois at Urbana-Champaign, Postdoc
Research Projects
NSFC, "Multimodal LLM-Driven Interactive Sign Language Learning and Translation with Intelligent Wearables", ￥800k, 2026.01.01-2027.12.31.
Selected Publications
[1] Wenbo Zhang, Chenxu Zhang, Yang Gao, Zhanpeng Jin, KineticsSense: A Multimodal Wearable Sensor Framework for Modeling Lower-Limb Motion Kinetics, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 9, no. 3, September 2025. (UbiComp'25)
[2] Junbin Ren, Ruihao Zheng, Wenbo Zhang, Dong She, Yuting Bai, Zhanpeng Jin, Yang Gao, Motion2Press: Cross Model Learning from IMU to Plantar Pressure for Gait Analysis, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 9, no. 3, September 2025. (UbiComp'25)
[3] Yang Gao, Wenbo Zhang, Junbin Ren, Ruihao Zheng, Yingcheng Jin, Di Wu, Lin Shu, Xiangmin Xu, Zhanpeng Jin, PressInPose: Integrating Pressure and Inertial Sensors for Full-Body Pose Estimation in Activities, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 8, no. 4, November 2024. (UbiComp'25)
[4] Jianan Jiang, Di Wu, Hanhui Deng, Yidan Long, Wenyi Tang, Xiang Li, Can Liu, Zhanpeng Jin, Wenlei Zhang, Tangquan Qi, HAIGEN: Towards Human-AI Collaboration for Facilitating Creativity and Style Generation in Fashion Design, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 8, no. 4, November 2024. (UbiComp'25)
[5] Jiyang Li, Lin Huang, Siddharth Shah, Sean J. Jones, Yincheng Jin, Dingran Wang, Adam Russell, Seokmin Choi, Yang Gao, Junsong Yuan, and Zhanpeng Jin, SignRing: Continuous American Sign Language Recognition Using IMU Rings and Virtual IMU Data, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 7, no. 3, September 2023. (UbiComp'23)
[6] Seokmin Choi, Junghwan Yim, Se Jun Kim, Yincheng Jin, Di Wu, and Zhanpeng Jin, VibPath: Two Factor Authentication With Your Hand's Vibration Response To Unlock Your Phone, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 7, no. 3, September 2023. (UbiComp'23)
[7] Yincheng Jin, Shibo Zhang, Yang Gao, Xuhai Xu, Seokmin Choi, Zhengxiong Li, Henry J. Adler, and Zhanpeng Jin, SmartASL: Point-of-Care Comprehensive ASL Interpreter Using Wearables, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 7, no. 2, pp. 60:1-21, June 2023. (UbiComp'23)
[8] Di Wu, Jinhui Ouyang, Ningyi Dai, Mingzhu Wu, Haodan Tan, Hanhui Deng, Yongmei Fan, Dakuo Wang, and Zhanpeng Jin, DeepBrain: Enabling Fine-Grained Brain-Robot Interaction through Human-Centered Learning of Coarse EEG Signals from Low-Cost Devices, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 6, no. 3, pp. 147:1-27, September 2022. (UbiComp'23)
[9] Yincheng Jin, Yang Gao, Xuhai Xu, Seokmin Choi, Jiyang Li, Feng Liu, Zhengxiong Li, and Zhanpeng Jin, EarCommand: “Hearing” Your Silent Speech Commands In Ear, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 6, no. 2, pp. 57:1-28, July 2022. (UbiComp'22)
[10] Seokmin Choi, Yang Gao, Yincheng Jin, Sejun Kim, Jiyang Li, Wenyao Xu, and Zhanpeng Jin, PPGface: Like What You Are Watching? Earphones Can “Feel” Your Facial Expressions, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 6, no. 2, pp. 48:1-32, July 2022. (UbiComp'22)
[11] Yang Gao*, Yincheng Jin*, Seokmin Choi, Jiyang Li, Junjie Pan, Lin Shu, Chi Zhou, and Zhanpeng Jin, SonicFace: Tracking Facial Expressions Using a Commodity Microphone Array, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 5, no. 4, pp. 156:1-33, December 2021. (* Co-first authors) (UbiComp'22)
[12] Yincheng Jin*, Yang Gao*, Yanjun Zhu, Wei Wang, Jiyang Li, Seokmin Choi, Zhangyu Li, Jagmohan Chauhan, Anind K. Dey, and Zhanpeng Jin, SonicASL: An Acoustic-based Sign Language Gesture Recognizer Using Earphones, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 5, no. 2, pp. 67:1-30, June 2021. (* Co-first authors) (UbiComp'21)
[13] Yang Gao, Yincheng Jin, Jagmohan Chauhan, Seokmin Choi, Jiyang Li, and Zhanpeng Jin, Voice In Ear: Spoofing-Resistant and Passphrase-Independent Body Sound Authentication, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 5, no. 1, pp. 12:1-25, March 2021. (UbiComp'21)
[14] Aditya Singh Rathore, Zhengxiong Li, Weijin Zhu, Zhanpeng Jin, and Wenyao Xu, A Survey on Heart Biometrics, ACM Computing Surveys, vol. 53, no. 6, article 114, pp. 1-38, December 2020.
[15] Yang Gao, Yincheng Jin, Jiyang Li, Seokmin Choi, and Zhanpeng Jin, EchoWhisper: Exploring an Acoustic-based Silent Speech Interface for Smartphone Users, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 4, no. 3, pp. 80:1-27, September 2020. (UbiComp'20)
