Rethinking the Invisible Protection against Unauthorized Image Usage in Stable Diffusion

Authors: 

Shengwei An, Lu Yan, Siyuan Cheng, Guangyu Shen, Kaiyuan Zhang, Qiuling Xu, Guanhong Tao, and Xiangyu Zhang, Purdue University

Abstract: 

Advancements in generative AI models like Stable Diffusion, DALLĀ·E 2, and Midjourney have revolutionized digital creativity, enabling the generation of authentic-looking images from text and altering existing images with ease. Yet, their capacity poses significant ethical challenges, including replicating an artist's style without consent, the creation of counterfeit images, and potential reputational damage through manipulated content. Protection techniques have emerged to combat misuse by injecting imperceptible noises into images. This paper introduces Insight, a novel approach that challenges the robustness of these protections by aligning protected image features with human visual perception. By using a photo as a reference, approximating the human eye's perspective, Insight effectively neutralizes protective perturbations, enabling the generative model to recapture authentic features. Our extensive evaluation across 3 datasets and 10 protection techniques demonstrates its superiority over existing methods in overcoming protective measures, emphasizing the need for stronger safeguards in digital content generation.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {299878,
author = {Shengwei An and Lu Yan and Siyuan Cheng and Guangyu Shen and Kaiyuan Zhang and Qiuling Xu and Guanhong Tao and Xiangyu Zhang},
title = {Rethinking the Invisible Protection against Unauthorized Image Usage in Stable Diffusion},
booktitle = {33rd USENIX Security Symposium (USENIX Security 24)},
year = {2024},
isbn = {978-1-939133-44-1},
address = {Philadelphia, PA},
pages = {3621--3638},
url = {https://www.usenix.org/conference/usenixsecurity24/presentation/an},
publisher = {USENIX Association},
month = aug
}