Safety Alignment of Large Language Models: The Offensive-Defensive Game Mechanism under Multi-round Adversarial Prompting

Abstract

With the widespread application of large language models in various fields, the issue of safety alignment with value has become increasingly crucial. The adversarial game mechanism under multiple rounds of adversarial prompts provides a new perspective and approach for the safety alignment of large language models. This paper deeply analyzes the connotation and characteristics of multiple rounds of adversarial prompts, elaborates on the basic principles of the adversarial game mechanism, discusses its significant role in the safety alignment of large language models, analyzes the challenges faced, and proposes corresponding countermeasures, aiming to provide theoretical support for the safe and reliable application of large language models.