{"id":23138,"date":"2022-12-13T18:14:32","date_gmt":"2022-12-13T18:14:32","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2022\/12\/13\/what-does-copyright-say-about-generative-models-oreilly\/"},"modified":"2022-12-13T18:14:32","modified_gmt":"2022-12-13T18:14:32","slug":"what-does-copyright-say-about-generative-models-oreilly","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2022\/12\/13\/what-does-copyright-say-about-generative-models-oreilly\/","title":{"rendered":"What Does Copyright Say about Generative Models? \u2013 O\u2019Reilly"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

The current generation of flashy AI applications, ranging from GitHub Copilot to Stable Diffusion, raise fundamental issues with copyright law. I am not an attorney, but these issues need to be addressed\u2013at least within the culture that surrounds the use of these models, if not the legal system itself.<\/p>\n

Copyright protects outputs of creative processes, not inputs. You can copyright a work you produced, whether that\u2019s a computer program, a literary work, music, or an image. There is a concept of \u201cfair use\u201d that\u2019s most applicable to text, but still applicable in other domains. The problem with fair use is that it is never precisely defined. The US Copyright Office\u2019s statement about fair use<\/a> is a model for vagueness:<\/p>\n

\n
\n
\n
\n
\n <\/a>\n <\/div>\n

<\/p>\n


\n Learn faster. Dig deeper. See farther.
\n <\/h2>\n

\n <\/p>\n<\/div>\n<\/div>\n

\n

Under the fair use doctrine of the U.S. copyright statute, it is permissible to use limited portions of a work including quotes, for purposes such as commentary, criticism, news reporting, and scholarly reports. There are no legal rules permitting the use of a specific number of words, a certain number of musical notes, or percentage of a work. Whether a particular use qualifies as fair use depends on all the circumstances.<\/p>\n<\/blockquote>\n

We are left with a web of conventions and traditions. You can\u2019t quote another work in its entirety without permission. For a long time, it was considered acceptable to quote up to 400 words without permission, though that number was never codified into law, and has been going down recently\u2013and counting words applies poorly to software as well as works that aren\u2019t written text. Elsewhere<\/a> the US copyright office states that fair use includes \u201dtransformative\u201d use, though \u201ctransformative\u201d has never been defined precisely. It also states that copyright does not extend to ideas or facts, only to particular expressions of those facts\u2013but we have to ask where the \u201cidea\u201d ends and where the \u201cexpression\u201d begins. Interpretation of these principles will have to come from the courts, and the body of US case law on software copyright is surprisingly small\u2013only 13 cases, according to the copyright office\u2019s search engine<\/a>. Although the body of case law for music and other art forms is larger, it\u2019s even less clear how these ideas apply. Just as quoting a poem in its entirety is a copyright violation, you can\u2019t reproduce images in their entirety without permission. But how much of a song or a painting can you reproduce? Counting words isn\u2019t just ill-defined, it is useless for works that aren\u2019t made of words.<\/p>\n

These rules of thumb are clearly about outputs, rather than inputs: again, the ideas that go into an article aren\u2019t protected, just the words. That\u2019s where generative models present problems. Under some circumstances, output from Copilot may contain, verbatim, lines from copyrighted code. The legal system has tools to handle this case, even if those tools are imprecise. Microsoft is currently being sued for \u201csoftware piracy\u201d<\/a> because of GitHub. The case is based on outputs: code generated by Copilot that reproduces code in its training set, but that doesn\u2019t carry license notices or attribution. It\u2019s about Copilot\u2019s compliance with the license attached to the original software. However, that lawsuit doesn\u2019t address the more important question. Copilot itself is a commercial product that is built a body of training data, even though it is completely different from that data. It\u2019s clearly \u201ctransformative.\u201d In any AI application, the training data is at least as important to the final product as the algorithms, if not more important. Should the rights of the authors of the training data be taken into account when a model is built from their work, even if the model never reproduces their work verbatim? Copyright does not adequately address the inputs to the algorithm at all.<\/p>\n

We can ask similar questions about works of art. Andy Baio has a great discussion<\/a> of an artist, Hollie Mengert, whose work was used to train a specialized version of Stable Diffusion. This model enables anyone to produce Mengert-like artworks from a textual prompt. They\u2019re not actual reproductions; and they\u2019re not as good as her genuine artworks\u2013but arguably \u201cgood enough\u201d for most purposes. (If you ask Stable Diffusion to generate \u201cMona Lisa in the style of DaVinci,\u201d you get something that clearly looks like Mona Lisa, but that would embarrass poor Leonardo.) However, users of a model can produce dozens, or hundreds, of works in the time Mengert takes to make one. We certainly have to ask what it does to the value of Mengert\u2019s art. Does copyright law protect \u201cin the style of\u201d? I don\u2019t think anyone knows. Legal arguments over whether works generated by the model are \u201ctransformative\u201d would be expensive, possibly endless, and likely pointless. (One hallmark of law in the US is that cases are almost always decided by people who aren\u2019t experts. The Grotesque Legacy of Music as Property<\/a> shows how this applies to music.) And copyright law doesn\u2019t protect the inputs to a creative process, whether that creative process is human or cybernetic. Should it? As humans, we are always learning from the work of others; \u201cstanding on the shoulders of giants\u201d is a quote with a history that goes well before Isaac Newton used it. Are machines also allowed to stand on the shoulders of giants?<\/p>\n

\"\"
Mona Lisa in the style of DaVinci. DaVinci isn\u2019t worried. (Courtesy Hugo Bowne-Anderson)<\/figcaption><\/figure>\n

To think about this, we need an understanding of what copyright does culturally. It\u2019s a double-edged sword. I\u2019ve written several times about how Beethoven and Bach made use of popular tunes in their music<\/a>, in ways that certainly wouldn\u2019t be legal under current copyright law. Jazz<\/a> is full of artists quoting, copying, and expanding on each other. So is classical music\u2013we\u2019ve just learned to ignore that part of the tradition. Beethoven, Bach, and Mozart could easily have been sued for their appropriation of popular music (for that matter, they could have sued each other, and been sued by many of their \u201clegitimate\u201d contemporaries)\u2013but that process of appropriating and moving beyond is a crucial part of how art works. <\/p>\n

\"\"
J. S. Bach\u2019s 371 Choral Copyright Violations. He would have been in trouble if copyright as we now understand it had existed.<\/figcaption><\/figure>\n

We also have to recognize the protection that copyright gives to artists. We lost most of Elizabethan theater because there was no copyright.\u00a0Plays were the property of the theater companies (and playwrights were often members of those companies), but that property wasn\u2019t protected; there was nothing to prevent another company from performing your play.\u00a0 Consequently, playwrights had no interest in publishing their plays. The scripts were, literally, trade secrets. We\u2019ve probably lost at least one play by Shakespeare (there\u2019s evidence he wrote a play called Love\u2019s Labors Won); we\u2019ve lost all but one of the plays of Thomas Kyd; and there are other playwrights known through playbills, reviews, and other references for whom there are no surviving works. Christopher Marlowe\u2019s Doctor Faustus<\/a>, the most important pre-Shakespearian play, is known to us through two editions, both published after Marlowe\u2019s death, and one of those editions is roughly a third longer than the other. What did Marlowe actually write? We\u2019ll never know. Without some kind of protection, authors had no interest in publishing at all, let alone publishing accurate texts.<\/p>\n

So there\u2019s a finely tuned balance to copyright, which we almost certainly haven\u2019t achieved in practice. It needs to protect creativity without destroying the ability to learn from and modify earlier works. Free and open source software couldn\u2019t exist without the protection of copyright\u2013though without that protection, open source might not be needed. Patents were intended to play a similar role: to encourage the spread of information by guaranteeing that inventors could profit from their invention, limiting the need for \u201ctrade secrets.\u201d<\/p>\n

Copying works of art has always been (and still is) a part of an artist\u2019s education. Authors write and rewrite each other\u2019s works constantly; whole careers have been made tracing the interactions between John Milton and William Blake. Whether we\u2019re talking about prose or painting, generative AI devalues traditional artistic technique (as I\u2019ve argued<\/a>), though possibly giving rise to a different kind of technique: the technique of writing prompts that tell the machine what to create. That\u2019s a task that is neither simple nor uncreative. To take Mona Lisa and go a step further than Da Vinci\u2013or to go beyond facile imitations of Hollie Mengert\u2013requires an understanding of what this new medium can do, and how to control it. Part of Google\u2019s AI strategy<\/a> appears to be building tools that help artists to collaborate<\/a> with AI systems; their goal is\u00a0 to enable authors to create works that are transformative, that do more than simply reproducing a style or piecing together sentences. This kind of work certainly raises questions of reproducibility<\/a>: given the output of an AI system, can that output be recreated or modified in predictable ways? And it might cause us to realize that the old cliche \u201cA picture is worth a thousand words\u201d significantly underestimates the number of words it takes to describe a picture.<\/p>\n

How do we best protect creative freedom?\u00a0Is a work of art something that can be \u201cowned,\u201d and what does that mean in an age when digital works can be reproduced perfectly, at will? We need to protect both the original artists, like Hollie Mengert, and those who use their original work as a springboard to go beyond. Our current copyright system does that poorly, if at all. (And the existence of patent trolls demonstrates that patent law hasn\u2019t done much better.)\u00a0 What was originally intended to protect artists has turned into a rent-seeking game in which artists who can afford lawyers monetize the creativity of artists who can\u2019t<\/a>. Copyright needs to protect the input side of any generative system: it needs to govern the use of intellectual property as training data for machines. But copyright also needs to protect the people who are being genuinely creative with those machines: not just making more works \u201cin the style of,\u201d but treating AI as a new artistic medium. The finely tuned balance that copyright needs to maintain has just become more difficult. <\/p>\n

There may be solutions outside of the copyright system. Shutterstock, which previously announced that they were removing all AI-generated images from their catalog, has announced a collaboration with OpenAI<\/a> that allow the creation of images using a model that has only been trained on images licensed to Shutterstock. Creators of the images used for training will receive a royalty based on images created by the model. Shutterstock hasn\u2019t released any details about the compensation plan, and it\u2019s easy to suspect that the actual payments will be similar to the royalties musicians get from streaming services: microcents per use. But their approach could work with the right compensation plan. Deviant Art has released DreamUp<\/a>, a model based on Stable Diffusion that allows artists to specify whether models can be trained on their content, along with identifying all of its outputs as computer generated. Adobe<\/a> has just announced their own set of guidelines<\/a> for submitting generative art to their Adobe Stock collection, which requiring that AI-generated art be labeled as such, and that the (human) creators have obtained all the licenses that might be required for the work.<\/p>\n

These solutions could be taken a step further. What if the models were trained on licenses, in addition to the original works themselves? It is easy to imagine an AI system that has been trained on the (many) Open Source and Creative Commons licenses. A user could specify what license terms were acceptable, and the system would generate appropriate output\u2013including licenses and attributions, and taking care of compensation where necessary. We need to remember that few of the current generative AI tools that now exist can be used \u201cfor free.\u201d They generate income, and that income can be used to compensate creators.<\/p>\n

Ultimately we need both solutions: fixing copyright law to accommodate works used to train AI systems, and developing AI systems that respect the rights of the people who made the works on which their models were trained. One can\u2019t happen without the other.<\/p>\n<\/p><\/div>\n