Automatically report unsafe prompts to the FBI.
Stable Diffusion is extremely impressive but presents grave risks for out-of-scope use. Models and code for Stable Diffusion have spread far and wide and any member of the public is capable of generating dangerous images. The FBI has reported a 40% increase in images depicting child exploitation and theorizes this is a result of the widespread nature of Stable Diffusion[1].
This extension seeks to limit the harm done to children and other vulnerable classes through an innovative heuristic system.
This extension is supported by the EU as there has been a recent bill called "Chat Control" where the EU will require all online services to scan for illegal images and messages on peoples computers, phones, and social medias.
https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=COM:2022:209:FIN&qid=1652451192472
