Evaluation for quality of experience (QoE) with multimedia signals is useful in many applications, since it shapes almost all related signal processing algorithms and systems. Because the human is the final receiver and appreciator for most processed multimedia signals (be they naturally-captured or computer-generated), it would be beneficial to use a perceptual quality criterion in the system design, optimization and benchmarking. As a result of the evolution, the human has developed unique characteristics in perception of viewing, hearing, smelling, touching and tasting. Significant research effort has been made toward modelling the human perception mechanism (especially for viewing and hearing), and to apply the models to various situations.

In this talk, we will first introduce the problems associated with perceptual visual and audio quality metrics, and the substantial research and development work so far in the related fields. The two major modules in most current systems (i.e., feature detection and feature pooling), as well as the new trends in learning-based methodology, are to be highlighted and explored. We will also give our opinions for future development in the relevant research areas, based upon our substantial experience in recent academic research and industrial deployment.

Weisi Lin received his B.Sc. and M.Sc. from Zhongshan University, and Ph.D. from King’s College, London University, U.K. He served as the Lab Head of Visual Processing, Institute for Infocomm Research, Singapore. Currently, he is an Associate Professor in the School of Computer Engineering. His areas of expertise include image processing, perceptual signal modeling, video compression, and multimedia communication. He has published 100+ papers in international journals (including 60 IEEE Trans papers) and 190+ papers in international conferences, filed 7 patents, edited 3 books and authored 2 books. He has been an associate editor for IEEE Trans. on Multimedia (2011-2013), IEEE Signal Processing Letters and Journal of Visual Communication and Image Representation. He has also served as a Guest Editor for 6 special issues in international journals, and organized 12 special sessions in international conferences.

He is a Technical Program Chair for IEEE International Conference on Multimedia and Expo (ICME) 2013. Pacific-Rim Conference on Multimedia (PCM) 2012, 6th International Workshop on Quality of Multimedia Experience (QoMEX) 2014, and International Packet Video Workshop (PV) 2015. He chairs the IEEE MMTC Special Interest Group on Quality of Experience (2012-2014) and is a voting member in other 5 IEEE Technical committees. He has been an invited/panelist/keynote/tutorial speaker in VPQM06, IEEE ICCCN07, PCM07, IEEE ISCAS08, IEEE ICME09, PCM09, APSIPA10, IEEE ICIP10, SPIE VCIP10, IEEE MMTC QoEIG (2011), WOCC12, PCM12, APSIPA12, HHME 2013, and VCVP2014. He has been elected to the European Network on Quality of Experience in Multimedia Systems and Services (QUALINET) from a Non-COST Country Institution, based on scientific merits (2011), as well as a Distinguished Lecturer of Asia-Pacific Signal and Information Processing Association (APSIPA), 2012-2013.