engineering practices

Leading technical decisions and sustaining high‑quality software through architecture reviews, coding standards, code review processes, CI/CD pipelines, automated testing, observability, incident response, documentation and mentorship; involves trade-offs across scalability, maintainability, and delivery cadence using tools like Git, CI systems, linters, and monitoring stacks.

engineeringpractices

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

"Good"and"Bad"Failures in Industrial CI/CD -- Balancing Cost and Quality Assurance

Apr 16, 2025
SS
Simin Sun
🏛️ Chalmers University of Technology | University of Gothenburg | Zenseact

This study addresses the quality-efficiency-cost imbalance in industrial CI/CD pipelines caused by heterogeneous failure types. We propose a process refactoring paradigm centered on two critical milestones: code integration (pre-merge) and product release. First, we systematically define “good failures” (early-detected, low-cost) versus “bad failures” (late-occurring, high-blocking). Grounded in empirical studies across four enterprises—including workflow mapping and failure root-cause modeling—we develop a transferable pre-merge failure governance framework. Evaluation results show a 37% reduction in average feedback latency, a 29% decrease in spurious build overhead, significant improvement in developer throughput, and optimized cloud resource utilization. Our core contribution lies in transcending conventional stage-based pipeline segmentation to enable failure-driven, fine-grained process control—marking a paradigm shift toward adaptive, cost-aware CI/CD orchestration.

Addressing pre-merge phase failure prevention gapsBalancing cost and quality in CI/CD workflowsDistinguishing CI and CD for optimization milestones

Japan faces the “2025 cliff”—a critical inflection point where aging core IT systems are approaching end-of-support, triggering surging maintenance costs, severe system opacity (“black-boxing”), and impediments to digital transformation (DX). Method: This study proposes a scalable, industrial-grade DevOps solution built on a GitHub–Jenkins–AWS–Docker stack, featuring an end-to-end CI/CD pipeline that dynamically provisions and decommissions isolated, containerized development environments. The approach enables on-demand elastic scaling and secure, sandboxed technology experimentation. Contribution/Results: Deployed at enterprises including Asahi Group, the solution reduces reliance on manual maintenance and mitigates service-outage risks. It shortens middleware and OS upgrade cycles by 60% and cuts annual maintenance costs by ~40%. The work establishes a reusable, highly adaptable DevOps paradigm for legacy system modernization—demonstrating both practical engineering viability and broad academic transferability.

Addressing legacy system maintenance costs and black box issuesDeveloping scalable CI/CD pipeline for legacy IT modernizationReducing financial risks from Japan's 2025 digital transformation cliff

AI-Augmented CI/CD Pipelines: From Code Commit to Production with Autonomous Decisions

Aug 15, 2025
MB
Mohammad Baqar
🏛️ Cisco Systems Inc | MUFG Bank | University of Houston

In modern CI/CD pipelines, manual intervention in unstable test diagnosis, rollback decisions, feature flag tuning, and canary promotion introduces release delays and operational overhead. To address this, we propose an AI-augmented autonomous software delivery framework that integrates large language models (LLMs) with policy-constrained autonomous agents, yielding a reference architecture for agent-based decision-making bounded by formal policies. Our approach introduces: (1) a taxonomy of deployment decisions; (2) policy-as-code guardrails enforcing safety and compliance; (3) a tiered trust framework governing agent autonomy; and (4) a DORA-metrics-driven, verifiable evaluation methodology. Evaluated in a React 19 microservices environment, the framework significantly reduces deployment latency and manual intervention frequency, improves release velocity and system reliability, and ensures auditable, formally verifiable autonomous decision paths.

Automating human decisions in CI/CD to reduce latencyMinimizing operational toil through autonomous policy-bounded agentsReplacing manual rollback and testing choices with AI

Empirical Analysis on CI/CD Pipeline Evolution in Machine Learning Projects

Mar 18, 2024
AH
Alaa Houerbi
🏛️ University of Michigan- Dearborn

This study presents the first empirical investigation into the evolution of CI/CD configurations in machine learning (ML) projects. Addressing the lack of understanding regarding how CI/CD configurations co-evolve with ML components, the authors analyze 508 open-source ML projects, 343 manually annotated commits, and 15,634 automated CI/CD commits. They propose a novel 14-category taxonomy capturing synergistic changes between CI/CD and ML components, develop a dedicated clustering tool to identify recurrent evolutionary patterns, and establish an empirically grounded model linking developer experience to CI/CD configuration modification behavior. Results show that 61.8% of CI/CD-related commits involve build strategy modifications; common anti-patterns—including dependency hardcoding and missing test frameworks—are identified; and senior developers modify CI/CD configurations more frequently and effectively than juniors, confirming the critical role of experience in CI/CD maintenance.

Analyzes CI/CD evolution in ML projectsDevelops clustering tool for CI/CD patternsIdentifies common CI/CD configuration changes

On the Need to Monitor Continuous Integration Practices - An Empirical Study

Sep 08, 2024
JS
Jadson Santos
🏛️ Federal University of Rio Grande do Norte | University of Otago | University of Waterloo

Continuous Integration (CI) practices suffer from severe monitoring deficiencies: developers largely neglect critical metrics such as “build health” and “time-to-fix failed builds,” while mainstream CI services offer only weak native monitoring capabilities, forcing reliance on fragmented and often redundant third-party tools. Method: We conducted a triangulated investigation—including documentation analysis, developer surveys, functional audits of CI platforms, and case studies of open-source projects—to systematically identify cognitive gaps and practical monitoring needs. Contribution/Results: Our study provides the first empirical evidence that although over 80% of developers track test coverage, only a minority monitor build health or timeliness; further, all major CI services lack built-in multidimensional monitoring support. These findings establish an evidence-based foundation for designing next-generation CI monitoring frameworks and prioritizing tooling enhancements.

CI services lack native support for monitoring key practices.Developers inadequately monitor Continuous Integration practices.Third-party tools fail to fully address CI monitoring gaps.

Latest Papers

What's happening recently
View more

This work addresses the fragility, inefficiency, and strong platform coupling commonly found in CI/CD pipelines for legacy COBOL systems, which often result in high maintenance costs and vendor lock-in. To overcome these challenges, the authors propose a portable CI/CD architecture tailored for highly secure and compliance-driven environments. The approach leverages OCI-compliant container images preloaded with COBOL toolchains, introduces a platform abstraction layer, integrates multiple repositories, and employs Groovy script refactoring to achieve platform-agnostic continuous integration and delivery. Empirical evaluation demonstrates that the proposed solution significantly enhances efficiency—reducing pipeline execution time by 82%—while simultaneously improving system portability, security, and maintainability. This architecture offers a reusable paradigm for modernizing legacy COBOL applications within regulated domains.

CI/CDCOBOLlegacy systems

This study addresses the lack of systematic understanding regarding the evolution of GitHub Actions workflows. Through a mixed-methods approach, we conduct the first large-scale empirical analysis of over 3.4 million workflow file versions from more than 49,000 repositories spanning November 2019 to August 2025. We identify seven categories of conceptual changes and find that repositories typically contain a median of three workflow files, with 7.3% of workflows modified weekly—approximately 75% of which involve only a single change, predominantly in task configuration and specification. Our findings further indicate that current large language model (LLM) tools have not yet significantly influenced workflow maintenance frequency, offering empirical grounding for the design of fine-grained automated maintenance tools.

CI/CDempirical studyGitHub Actions

When Continuous Delivery Is Not an Option: Practical Paths to Continuous Engineering in Complex Organizations

Nov 04, 2025
EK
E. Klotins
🏛️ Blekinge Institute of Technology | Addalot AB

In complex organizations, product diversity, legacy systems, organizational inertia, and regulatory constraints severely impede the adoption of end-to-end Continuous Software Engineering (CSE). Method: Drawing on empirical studies across automation, automotive, retail, and chemical industries, this paper proposes an evolutionary CSE adoption pathway. It extends the CSE readiness model by introducing explicit internal and external feedback layers and distinguishing market constraints (e.g., compliance requirements) from organizational constraints (e.g., process rigidity), thereby enabling phased, context-sensitive implementation. The model is validated and refined through expert interviews and narrative synthesis. Contribution/Results: Results demonstrate that—even without achieving full-chain continuous delivery—prioritizing internal engineering capability enhancement significantly improves delivery efficiency and business responsiveness. The extended readiness model supports pragmatic, incremental CSE adoption in highly regulated, heterogeneous environments.

Addressing barriers to Continuous Software Engineering adoption in complex organizationsIdentifying organizational and market constraints limiting full CSE implementationProposing updated readiness model for realistic CSE implementation goals

This study addresses the long-standing lack of effective evaluation of sustainability in scientific open-source software. It proposes a data-driven approach to systematically uncover, for the first time, the relationships among code quality, test coverage, and software sustainability. By analyzing code structure, measuring test coverage, and modeling code–test correlations, the authors classify and compare projects within the CASS software portfolio. The findings reveal that sustainable projects consistently exhibit higher and more stable test coverage, along with clearer mappings between code and tests. In contrast, scientific software as a whole demonstrates generally low test coverage, and high code complexity coupled with strong coupling significantly impairs its testability.

code qualityopen-sourcescientific software

Hot Scholars

YL

Yuanwei Liu

IEEE Fellow, AAIA Fellow, Clarivate Highly Cited Researcher, The University of Hong Kong
NOMARIS/STARAI6G
ZD

Zhiguo Ding

University of Manchester and Khalifa University, Fellow of IEEE, Web of Science Highly Cited
Wireless communicationssignal processingand cross-layer optimization
MK

Marcos Kalinowski

Professor, Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
Empirical Software EngineeringAI EngineeringAI4SEHuman Aspects in Software Engineering
CB

Chan-Byoung Chae

Underwood Distinguished Professor, Yonsei University, IEEE Fellow
CommunicationsNetworkingComputingApplied Machine Learning
RD

Ronnie de Souza Santos

Assistant Professor, University of Calgary
Human Aspects of Software EngineeringSoftware TestingSoftware FairnessSoftware Development