Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model

📅 2023-12-04
🏛️ Expert systems with applications
📈 Citations: 1
Influential: 0
📄 PDF
🤖 AI Summary
To address the challenge of jointly modeling textual semantics and graph structural information in knowledge graph completion, this paper proposes a prompt-based disentangled representation framework. Methodologically, it is the first to integrate prompt tuning, disentangled variational autoencoding, and contrastive learning regularization: a pretrained language model (PLM) encodes contextual semantics of entities and relations; a disentangled encoder explicitly separates relational semantics from entity-role semantics; and contrastive learning regularizes the embedding space to preserve structural consistency. On standard benchmarks including FB15k-237, the approach achieves a 3.2% improvement in mean reciprocal rank (MRR) for link prediction, substantially outperforming TransE and GNN-based methods. Moreover, it enhances model generalization and interpretability by decoupling semantic and structural representations. This work establishes a novel paradigm for KG completion that balances deep semantic understanding with explicit structural clarity.
Problem

Research questions and friction points this paper is trying to address.

Knowledge Graph Completion
Pre-trained Language Models
Text Understanding and Graph Structure
Innovation

Methods, ideas, or system contributions that make the work stand out.

PDKGC
Pre-trained Models
Prompt-based Learning
🔎 Similar Papers
No similar papers found.
Yuxia Geng
Yuxia Geng
Zhejiang University, Hangzhou Dianzi University, PowerChina Huadong Engineering Corporation Limited
Knowledge GraphLarge Language ModelIndustry Application
Jiaoyan Chen
Jiaoyan Chen
Department of Computer Science, University of Manchester
Knowledge GraphOntologyMachine LearningLarge Language Model
Y
Yuhang Zeng
HDU-ITMO Joint Institute, Hangzhou Dianzi University, Hangzhou, 310018, China
Z
Zhuo Chen
College of Computer Science and Technology, Zhejiang University, Hangzhou, 310028, China
W
Wen Zhang
School of Software Technology, Zhejiang University, Ningbo, 315048, China
Jeff Z. Pan
Jeff Z. Pan
Professor of Knowledge Computing, University of Edinburgh
Artificial IntelligenceKnowledge Representation and ReasoningKnowledge Based Learning
Y
Yuxiang Wang
School of Computer Science, Hangzhou Dianzi University, Hangzhou, 310018, China
X
Xiaoliang Xu
School of Computer Science, Hangzhou Dianzi University, Hangzhou, 310018, China