
New Anthropic Research: Persona Vectors We can: 1. Monitor how a model’s personality is changing during a conversation, or over training 2. Mitigate undesirable persona shifts during development or prevent during training. 3. Identify training data that leads to shift
New Anthropic research: Persona vectors. Language models sometimes go haywire and slip into weird and unsettling personas. Why? In a new paper, we find “persona vectors"—neural activity patterns controlling traits like evil, sycophancy, or hallucination.











