
Model competition is heating up, and distillation is 🔥🔥 Distillation detection is hard, so watermarking can help make it detectable. But are existing watermarks robust? We find two ways to break them: distill a model, then distill that model again; or distill only selected tokens that matter. Then what do we do? We introduce SubWM, which outperforms prior methods and is more robust to laundering.
Excited to present our new work on distillation detection: Subliminal Watermarks (SubWM). SubWM is much more robust compared to existing distillation detectors, is able to distinguish different watermarking keys, and also works reliably for out-of-domain prompts! Blog: subliminal-watermarks.github… 🧵























