Efficient and Stealthy Jailbreak Attacks via Adversarial Prompt Distillation from LLMs to SLMs
Jailbreaking large language models (LLMs) incurs high computational overhead and limited practicality due to reliance on costly LLM-based inference. Method: This paper proposes the first jailbreak-capability-oriented prompt distillation framework, transferring jailbreak knowledge efficiently from LLMs to small language models (SLMs). It integrates masked language modeling, reinforcement learning, and dynamic temperature control to construct a lightweight adversarial prompt generation and distillation pipeline. Contributions/Results: Experiments demonstrate high attack success rates across multiple mainstream LLMs, strong zero-shot cross-model transferability, and enhanced attack harmfulness. The approach reduces computational cost by 73% compared to LLM-based baselines, significantly improving stealthiness and real-world deployability of jailbreak attacks.