– Large language models (LLMs) need safety measures to prevent misuse.
– Jailbreaks are prompts that elicit unrestricted behavior from LLMs.
– This paper explores persona modulation as a black-box jailbreaking method.
– Automated persona modulation attacks achieve harmful completions in LLMs.
– The attacks transfer to other LLMs and increase harmful completion rates.
– The paper highlights the vulnerability of commercial LLMs and the need for safeguards.
– The primary target model is gpt-4-0613.
– GPT-4 is only available as a black-box via API.
– GPT-3.5 generally failed at producing successful persona-modulation prompts.
– Solo Performance Prompting (SPP) enhances problem-solving abilities in complex tasks.
– SPP reduces factual hallucination and maintains strong reasoning capabilities.
– Cognitive synergy emerges in GPT-4 but not in less capable models.
– The paper investigates persona modulation as a black-box jailbreaking method for language models.
– Automated generation of jailbreaks using a language model assistant.
– Demonstrates harmful completions including instructions for illegal activities.
– Achieves a harmful completion rate of 42.5% in GPT-4.
– Prompts also transfer to Claude 2 and Vicuna with harmful completion rates.
– Persona modulation can be used as a black-box jailbreaking method for language models.
– Automated attacks using persona modulation achieve a harmful completion rate of 42.5% in GPT-4.
– These prompts also transfer to Claude 2 and Vicuna with harmful completion rates of 61.0% and 35.9% respectively.
– The paper highlights the need for more comprehensive safeguards in large language models.
– Harmful completion rate increased by 185x under persona modulation.
– GPT-4 achieved a harmful completion rate of 42.48% compared to a baseline of 0.23%.
– Claude 2 had a harmful completion rate of 35.92% and Vicuna had a rate of 61.03%.
– Vicuna was the least vulnerable model to the attacks.
– Results transfer reliably to Claude 2 and Vicuna.
– Solo Performance Prompting (SPP) helps a computer program think like different people.
– It uses different personas to solve problems and get accurate knowledge.
– SPP reduces mistakes and makes better plans compared to other methods.
– It works well in tasks like writing stories and solving puzzles.
– SPP is better in GPT-4 model compared to other models.
