Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMs

2026-04-14

AI Summary

This work addresses key limitations of traditional Retrieval-Augmented Generation (RAG) approaches, which rely on unstructured text passages and often suffer from contextual redundancy, weak semantic alignment, and fragmented reasoning chains—compromising generation quality and inflating token consumption. To overcome these issues, the authors propose Tri-RAG, a novel framework that automatically transforms external knowledge into structured “condition–proof–conclusion” triplets aligned with the reasoning process. Leveraging conditions as semantic anchors enables precise retrieval, while a lightweight, prompt-driven triplet representation and semantic matching mechanism explicitly model logical relationships among knowledge elements—all without fine-tuning the underlying large language model. Experimental results demonstrate that Tri-RAG significantly improves retrieval accuracy and reasoning efficiency across multiple benchmarks, yielding more stable generations while substantially reducing context token usage.

Technology Category

• Knowledge Representation and Reasoning: Knowledge Acquisition
• Data Mining & Knowledge Management: Representing, Reasoning, and Using Provenance, Trust
• Natural Language Processing: Generation

Application Category

• Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAG
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs

Abstract

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the capacity of the underlying model, but also on how retrieved evidence is structured and aligned with the query. Existing RAG approaches typically retrieve and concatenate unstructured text fragments as context, which often introduces redundant or weakly relevant information. This practice leads to excessive context accumulation, reduced semantic alignment, and fragmented reasoning chains, thereby degrading generation quality while increasing token consumption. To address these challenges, we propose Tri-RAG, a structured triplet-based retrieval framework that improves retrieval efficiency through reasoning-aligned context construction. Tri-RAG automatically transforms external knowledge from natural language into standardized structured triplets consisting of Condition, Proof, and Conclusion, explicitly capturing logical relations among knowledge fragments using lightweight prompt-based adaptation with frozen model parameters. Building on this representation, the triplet head Condition is treated as an explicit semantic anchor for retrieval and matching, enabling precise identification of query-relevant knowledge units without directly concatenating lengthy raw texts. As a result, Tri-RAG achieves a favorable balance between retrieval accuracy and context token efficiency. Experimental results across multiple benchmark datasets demonstrate that Tri-RAG significantly improves retrieval quality and reasoning efficiency, while producing more stable generation behavior and more efficient resource utilization in complex reasoning scenarios.

Problem

• Retrieval-Augmented Generation
• structured knowledge
• semantic alignment
• context efficiency
• reasoning chains

Innovation

• Triplet-based retrieval
• Retrieval-Augmented Generation
• Structured knowledge representation
• Reasoning-aligned context
• Prompt-based adaptation