Safety Control of Service Robots with LLMs and Embodied Knowledge Graphs

📅 2024-05-28
🏛️ arXiv.org
📈 Citations: 4
Influential: 0
📄 PDF
🤖 AI Summary
To address insufficient safety and regulatory compliance of service robots in human-robot cohabitation scenarios, this paper proposes a closed-loop safety verification framework integrating large language models (LLMs), embodied knowledge graphs (EKGs), and embodied robot control prompts (ERCPs). The method innovatively employs ERCPs to guide LLMs in generating safety-compliant motion commands, while leveraging EKGs for real-time physical feasibility validation—thereby enabling cross-modal safety alignment across language understanding, knowledge reasoning, and embodied execution. A multi-stage safety verification mechanism is established within the framework. Evaluated on real-world service tasks, it reduces unsafe operation rates by 72% and significantly improves safety compliance. The framework delivers a verifiable, interpretable safety assurance solution for personnel and asset protection in human-robot collaborative environments.

Technology Category

Application Category

📝 Abstract
Safety limitations in service robotics across various industries have raised significant concerns about the need for robust mechanisms ensuring that robots adhere to safe practices, thereby preventing actions that might harm humans or cause property damage. Despite advances, including the integration of Knowledge Graphs (KGs) with Large Language Models (LLMs), challenges in ensuring consistent safety in autonomous robot actions persist. In this paper, we propose a novel integration of Large Language Models with Embodied Robotic Control Prompts (ERCPs) and Embodied Knowledge Graphs (EKGs) to enhance the safety framework for service robots. ERCPs are designed as predefined instructions that ensure LLMs generate safe and precise responses. These responses are subsequently validated by EKGs, which provide a comprehensive knowledge base ensuring that the actions of the robot are continuously aligned with safety protocols, thereby promoting safer operational practices in varied contexts. Our experimental setup involved diverse real-world tasks, where robots equipped with our framework demonstrated significantly higher compliance with safety standards compared to traditional methods. This integration fosters secure human-robot interactions and positions our methodology at the forefront of AI-driven safety innovations in service robotics.
Problem

Research questions and friction points this paper is trying to address.

Ensuring service robots consistently adhere to safety protocols
Preventing autonomous robot actions from harming humans or property
Integrating LLMs with embodied knowledge for robust safety control
Innovation

Methods, ideas, or system contributions that make the work stand out.

Integrating LLMs with Embodied Robotic Control Prompts
Validating robot actions using Embodied Knowledge Graphs
Enhancing safety with predefined instructions and continuous alignment
🔎 Similar Papers
No similar papers found.
Y
Yong Qi
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
G
Gabriel Kyebambo
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
S
Siyuan Xie
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
W
Wei Shen
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
S
Shenghui Wang
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
B
Bitao Xie
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
B
Bin He
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
Z
Zhipeng Wang
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China
S
Shuo Jiang
School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xian, Shaanxi Province, 710026, China