Chimaera: A Mixture-of-Graph-Experts Architecture for Cross-Task and Cross-Dataset Graph Learning

2026-09-08

AI Summary

Chimaera通过结合多种图基础模型和专家混合策略，解决了图数据学习中因结构不规则及嵌入特性差异带来的挑战，并展示了跨任务和数据集的有效性。

Abstract

Designing foundation models for graphs is challenging due to the irregular structure of graphs and the different sizes and characteristics of embeddings. Chimaera integrates mixture-of-experts with graph foundation models (GFM). It integrates different GFM architectures, such as graph prompts and linear GNN models. Large language models are used to generate embeddings, and experts can be trained and combined following different strategies, GFMs, embeddings, etc. Furthermore, Chimaera extends existing linear GNNs to support link-level and graph-level tasks in addition to node-level tasks. Empirical analyses are performed on same-task and cross-task experiments with node, link, and graph classification tasks using six benchmark text-attributed graph datasets. The experiments demonstrate the effectiveness of Chimaera and its capabilities for transfer across tasks and datasets. Further insights include the need to use both large and small language models to generate embeddings for the experts, a strong cross-task transferability of simple but effective linear GNNs, and using few samples only to provide strong results.

Problem

• graph foundation models
• mixture-of-experts
• irregular structure
• embeddings
• cross-task transferability

Innovation

• mixture-of-experts
• graph foundation models
• cross-task transferability
• linear GNNs
• embedding generation