AI Wizards at EXIST 2026: Hierarchical Soft-Label Learning for Multimodal Sexism Identification in Memes

📅 2026-07-05
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the challenge of multimodal gender bias detection in internet memes by proposing a hierarchical soft-label learning framework that models three progressively difficult subtasks as conditional prediction problems, effectively capturing both inter-annotator semantic disagreements and task dependencies. Leveraging visual-language representations from Gemini Embedding 2, the approach introduces a lightweight gated MLP and employs an optimization strategy combining KL divergence with homoscedastic uncertainty weighting. Evaluated on the EXIST 2026 benchmark, the method achieves first place on Task 2.3 and fourth place on both Tasks 2.1 and 2.2 in the official Soft-Soft leaderboard, demonstrating its effectiveness and technical novelty.
📝 Abstract
We present the AI Wizards submission to EXIST 2026 for multimodal sexism identification in memes. The task is composed of three, increasingly harder subtasks. We model them hierarchically as conditional soft-label prediction over empirical annotator distributions. Our system maps fixed Gemini Embedding 2 vision-language representations through a lightweight Gated MLP trained with KL divergence and homoscedastic uncertainty weighting. Our submissions ranked first on Task 2.3 and fourth on Tasks 2.1 and 2.2 on the official Soft-Soft leaderboards. The code is available at https://github.com/NLP-AI-Wizards/EXIST-2026
Problem

Research questions and friction points this paper is trying to address.

multimodal sexism identification
memes
hierarchical learning
soft-label prediction
gender bias detection
Innovation

Methods, ideas, or system contributions that make the work stand out.

Hierarchical Soft-Label Learning
Multimodal Sexism Identification
Gated MLP
KL Divergence
Homoscedastic Uncertainty Weighting
M
Matteo Fasulo
Swiss Data Science Center, ETH Zürich, Andreasturm, Andreasstrasse 5, 8092 Zürich, Switzerland
A
Antonio Gravina
Everest Systems GmbH, Max-Jarecki-Straße 21, 69115 Heidelberg, Germany
L
Luca Tedeschini
Villanova.ai S.P.A, Località Sa Illetta, SS 195 KM 2.3, 09123 Cagliari, Italy
L
Luca Babboni
Independent researcher