Institution profile

J.P. Morgan

Industry researchnorthamerica · us
Official website
Research library52linked papers
Opportunities0open roles
Selected work

Representative Papers

Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations

Aug 04, 2026

This work addresses the challenge of multimodal sentiment analysis in real-world scenarios, where performance is often hindered by missing observational data and the lack of explicit modeling of modality reliability in existing methods, leading to reliability mismatch and propagation bias. To overcome these limitations, the authors propose the Modality Reliability-aware Collaborative Fusion (MRCF) framework, which introduces, for the first time, a sample-level modality reliability assessment mechanism that integrates intra-modality quality cues with cross-modality semantic consistency. MRCF dynamically regulates multimodal information flow through a reliability-aware branch, a reliability-guided interaction mechanism, and a calibration-based fusion module. Extensive experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS demonstrate that the proposed approach significantly enhances model robustness and accuracy under incomplete observational conditions.

0 citationsRead paper
Recent publications

Latest Papers

Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations

Aug 04, 2026

This work addresses the challenge of multimodal sentiment analysis in real-world scenarios, where performance is often hindered by missing observational data and the lack of explicit modeling of modality reliability in existing methods, leading to reliability mismatch and propagation bias. To overcome these limitations, the authors propose the Modality Reliability-aware Collaborative Fusion (MRCF) framework, which introduces, for the first time, a sample-level modality reliability assessment mechanism that integrates intra-modality quality cues with cross-modality semantic consistency. MRCF dynamically regulates multimodal information flow through a reliability-aware branch, a reliability-guided interaction mechanism, and a calibration-based fusion module. Extensive experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS demonstrate that the proposed approach significantly enhances model robustness and accuracy under incomplete observational conditions.

0 citationsRead paper