Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression

📅 2026-09-02
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于行为指标的框架,用于监测和评估人工智能系统可能带来的灾难性威胁,并采用网络安全和国家安全领域的成熟方法来建立明确的度量标准。
📝 Abstract
This article presents a structured framework of behavioral indicators that may signal progression toward potentially catastrophic threats from artificial intelligence systems. We adopt a pragmatic approach, inspired by established methodologies in cybersecurity and national security. By establishing clear metrics, indicators, and thresholds across multiple dimensions of AI capability and behavior, this framework enables researchers and policymakers to implement evidence-based monitoring protocols.
Problem

Research questions and friction points this paper is trying to address.

Catastrophic Risk
AI
Systematic Monitoring
Rogue AI
Behavioral Indicators
Innovation

Methods, ideas, or system contributions that make the work stand out.

structured framework
behavioral indicators
evidence-based monitoring
🔎 Similar Papers
2024-08-14AGI - Artificial General Intelligence - Robotics - Safety & AlignmentCitations: 27
T
T. Bauer
Sandia National Laboratories (SNL), Albuquerque, NM, 87185, USA.
W
W. P. Kegelmeyer
Sandia National Laboratories, Livermore, CA 94451, USA.
E
E. Begoli
Oakridge National Laboratories (ORNL), Oak Ridge, TN, 37830, USA.
A
A. Sadovnik
Oakridge National Laboratories (ORNL), Oak Ridge, TN, 37830, USA.
T
T. Emerson
Pacific Northwest National Laboratory (PNNL), Richland, WA, 99352, USA.
C
C. Corley
Pacific Northwest National Laboratory (PNNL), Richland, WA, 99352, USA.
N
N. Generous
Los Alamos National Laboratory, Los Alamos, NM, 87545, USA.
J
J. Moore
Los Alamos National Laboratory, Los Alamos, NM, 87545, USA.
B
B. Bartoldson
Lawrence Livermore National Labs (LLNL), Livermore, CA, 94550, USA.
R
R. Goldhahn
Lawrence Livermore National Labs (LLNL), Livermore, CA, 94550, USA.
M
M. Goldman
Lawrence Livermore National Labs (LLNL), Livermore, CA, 94550, USA.
M
M. Greaves
Schmidt Sciences, New York, NY, 10011, USA.
M
M. J. D. Vermeer
RAND, Santa Monica, CA 90401, USA.
B
B. MacLennan
University of Tennessee, Knoxville, TN 37996, USA.
D
D. Schulker
Software Engineering Institute (SEI), Carnegie Mellon University, Pittsburgh, PA, 15213, USA.
N
N. VanHoudnos
Software Engineering Institute (SEI), Carnegie Mellon University, Pittsburgh, PA, 15213, USA.
J
J. Bansemer
Georgetown University, Washington D.C., 20057, USA.
Y
Y. Bengio
University of Montreal and LawZero, Montreal, H2S 3G9, Canada.