LLMs respond differently to harmful prompts when AI watermarking is used

In response to a new European Union law, AI platforms are implementing new schemes for watermarking the content they generate. Anthropic recently disclosed that its future Claude models will use SynthID-Text, an approach developed and released as open source by Google. This technique employs a secret key that subtly alters the model's process for selecting the next word in a sentence.