Louis-Philippe Morency
Scholar

Louis-Philippe Morency

Google Scholar ID: APgaFK0AAAAJ
Associate professor, Carnegie Mellon University
Multimodal InteractionMachine LearningComputer Vision
Citations & Impact
All-time
Citations
43,037
 
H-index
77
 
i10-index
239
 
Publications
20
 
Co-authors
53
list available
Resume (English only)
Academic Achievements
  • Published survey paper 'Multimodal Machine Learning: A Survey and Taxonomy' in IEEE TPAMI (2019)
  • Multiple papers in top venues including CVPR, ICLR, ACL, e.g., 'Video Relationship Reasoning using Gated Spatio-Temporal Energy Graph' (CVPR 2019)
  • Introduced Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence (CVPR 2019)
  • Developed CMU-MOSEI dataset and Interpretable Dynamic Fusion Graph (ACL 2018)
  • Proposed Multimodal Transformer, Factorized Multimodal Representations, and Efficient Low-rank Multimodal Fusion
Background
  • Leonardo Associate Professor of Computer Science at the Language Technology Institute, Carnegie Mellon University
  • Director of the Multimodal Communication and Machine Learning Laboratory (MultiComp Lab)
  • Research focuses on computational foundations enabling computers to analyze, recognize, and predict subtle human communicative behaviors in social interactions
  • Core technical challenge: multimodal machine learning—mathematical foundations for heterogeneous multimodal data and inter-modality contingencies
  • Interdisciplinary research spanning multimodal interaction, social psychology, computer vision, machine learning, and AI
  • Applications in medicine, robotics, and education