A Text Mining and Classification Approach for Analyzing Architecture Decision Records

2026-09-07

AI Summary

研究通过文本挖掘和分类方法分析了软件项目中的架构决策记录（ADRs），揭示了其内容与既定知识概念的一致性问题及模板遵循情况，为改进文档实践提供了依据。

Abstract

Architectural decision records (ADRs) have become a popular lightweight mechanism for documenting architectural knowledge in software projects. However, there is limited empirical evidence on the kinds of architectural concerns captured in ADRs and how well their contents align with established architectural knowledge concepts and documentation practices. In this paper, we propose an automated text-mining and classification approach for analyzing ADRs at scale. We apply this approach to a dataset of ADRs extracted from ~550 open-source repositories, combining topic modeling, LLM-based classification, and template compliance checks. Our analysis examines decision taxonomies and quality attributes, and the degree to which ADRs adhere to the MADR template. Our findings show that ADRs frequently capture existence, technology, and process-related decisions, while alternatives, decisions drivers, and some quality concerns remain under-documented. We also observe recurring mismatches between ADR contents and template sections. These insights into current documentation practices provide architects with valuable information to reflect on how ADRs are and should be used to effectively deal with architectural knowledge. Furthermore, our automated approach is adaptable to other architectural tasks.

Problem

• Architectural Decision Records
• architectural concerns
• documentation practices

Innovation

• text-mining
• classification
• topic modeling
• LLM-based classification
• template compliance checks