While the motives may be noble (regulating surveillance) it might happen that models like Stable Diffusion will get caught in the regulatory crossfire to a point where using the original models becomes illegal and new models will get castrated until they are useless. Further this might make it impossible to train open source models (maybe even LoRAs) by individuals or smaller startups. Adobe and the large corporations would rule the market.
I can use a pencil and paper to draw wathever i want. Will drawing be illigal just cause anybody can draw prohibited stuff? I’m just saying that if this is the only argument they can find it’s dumb
But this happens on the COMPUTER, which we don’t understand, so we have to regular the scary thing so nobody else can use it too.
A difficult comparison - the pencil is more like photoshop or krita. Drawing a (photorealistic) image from scratch requires mechanical skill. SD is something else, like a magical canvas that guides the pencil while you draw…
They could still try to enforce safeguards against generating with certain tokens, or only allow models with certain training data. Or the almighty copyright-claim-banhammer…
While we here know it is futile to censor a model without breaking it - they do not understand it.