Applying Formal Methods Tools to an Electronic Warfare Codebase (Experience report)

2026-01-16

AI Summary

This study addresses the limited adoption of formal methods in electronic warfare systems, which is hindered by steep learning curves, inconsistent terminology, and challenges in integrating with existing development workflows. From the perspective of frontline engineers, the authors empirically evaluate multiple static analysis tools—covering input/output contracts, memory effect analysis, and loop invariants—on safety-critical electronic warfare software, comparing their efficacy against conventional unit testing. The research highlights fundamental differences in reasoning paradigms and tool usage between formal methods and traditional testing, revealing the unique capability of formal techniques to uncover deep-seated security vulnerabilities. Furthermore, the paper identifies concrete directions for improving usability, including reducing manual intervention and enhancing support for library code, thereby facilitating broader practical adoption.

Technology Category

• Machine Learning: Evaluation and Analysis
• Natural Language Processing: Safety and Robustness
• Knowledge Representation and Reasoning: Automated Reasoning and Theorem Proving

Application Category

• Security and Privacy: Large-scale security measurements
• Systems and Infrastructure for Web, Mobile and WoT: Web performance, measurement, and characterization
• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods

Abstract

While using formal methods offers advantages over unit testing, their steep learning curve can be daunting to developers and can be a major impediment to widespread adoption. To support integration into an industrial software engineering workflow, a tool must provide useful information and must be usable with relatively minimal user effort. In this paper, we discuss our experiences associated with identifying and applying formal methods tools on an electronic warfare (EW) system with stringent safety requirements and present perspectives on formal methods tools from EW software engineers who are proficient in development yet lack formal methods training. In addition to a difference in mindset between formal methods and unit testing approaches, some formal methods tools use terminology or annotations that differ from their target programming language, creating another barrier to adoption. Input/output contracts, objects in memory affected by a function, and loop invariants can be difficult to grasp and use. In addition to usability, our findings include a comparison of vulnerabilities detected by different tools. Finally, we present suggestions for improving formal methods usability including better documentation of capabilities, decreased manual effort, and improved handling of library code.

Problem

• formal methods
• usability
• electronic warfare
• software engineering
• adoption barriers

Innovation

• formal methods
• usability
• electronic warfare
• software verification
• tool integration