Student Legal Consequences: AI-Altered Classmate Photos

The rise of artificial intelligence (AI) has brought about unprecedented technological advancements, but it has also opened doors to new forms of misconduct, particularly among students. One alarming trend involves the use of AI to create and share altered images of classmates, often of a sexually explicit nature. This article delves into the legal consequences students may face for creating and sharing AI-altered photos of their classmates, examining relevant cases, legal frameworks, and the challenges of addressing this emerging issue.

The Deepfake Dilemma: A New Era of Cyberbullying

Deepfakes, realistic but fabricated images and videos created using AI, have become increasingly accessible. What once required technical expertise can now be achieved with readily available apps and online tools. This ease of creation has led to a rise in incidents where students use AI to alter images of their classmates, often with malicious intent.

In one disturbing case in Lafourche Parish, Louisiana, a 13-year-old student was expelled from Sixth Ward Middle School after she physically confronted a male classmate who she claimed created and disseminated a deepfake pornographic image of her. The girl's father, Joseph Daniels, and her attorneys, Greg Miller and Morgyn Young, planned to file a federal lawsuit against the Lafourche Parish School District, alleging that the school failed to address the girl's complaints about the circulating image. According to Miller, the school board's actions in this case were reprehensible. The girl was begging them all day to put a stop to this. Not only did they not put a stop to it, they put [her] on the bus with the perpetrator. The incident highlights the potential for AI deepfakes to disrupt children's lives both at school and at home.

Legal Landscape: Navigating Uncharted Territory

The legal ramifications for students involved in creating and sharing AI-altered images are complex and often unclear. Traditional laws addressing child pornography and nonconsensual pornography may not directly apply to AI-generated content, creating loopholes that perpetrators can exploit.

Existing Laws and Their Limitations

Many states have laws against "revenge porn" or nonconsensual distribution of intimate images. However, whether these laws cover AI-generated deepfakes is often uncertain. Some jurisdictions, like New York, expressly include digitally created or altered images in their nonconsensual pornography laws. However, the federal civil action, as originally enacted, does not explicitly address such images. As a result, it is not settled whether VAWA's right of action encompasses such digitally modified depictions.

California's child pornography law, for example, applies to images that "depict a person under 18 years of age personally engaging in or simulating sexual conduct." Joseph Abrams, a Santa Ana criminal defense attorney, argues that an AI-generated nude "doesn't depict a real person" and might be considered child erotica but not child pornography.

The TAKE IT DOWN Act: A Federal Response

Recognizing the growing threat of AI-generated intimate images, Congress passed S. 146, the TAKE IT DOWN Act, on April 28, 2025, and the President signed the bill into law on May 19, 2025. This Act criminalizes the nonconsensual publication of intimate images, including "digital forgeries" (i.e., deepfakes), in certain circumstances.

The Act makes it unlawful for any person to knowingly publish either an intimate visual depiction or a digital forgery of an identifiable individual using an interactive computer service. A digital forgery is defined as an intimate visual depiction of an identifiable individual created or altered using AI or other technological means. The Act outlines seven separate offenses, including publications involving authentic intimate visual depictions of adults or minors, publications involving digital forgeries of adults or minors, and threats involving such depictions.

The penalties for violating the Act range from criminal fines and imprisonment of up to two years for offenses involving adults to imprisonment of up to three years for offenses involving minors. The Act also requires covered platforms to establish a notice-and-removal process by May 19, 2026, allowing individuals to report and request the removal of nonconsensual intimate visual depictions.

State-Level Efforts

Many states have also taken legislative action to address AI-generated deepfakes. At least half the states enacted legislation in 2025 addressing the use of generative AI to create fabricated images and sounds, according to the National Conference of State Legislatures. Some states have modified existing laws banning child pornography to cover AI-generated child sexual abuse material, which often carries more severe penalties. For example, recent laws passed in South Carolina and Florida have “proportional penalties” that take into account circumstances including age, intent and prior criminal history.

Read also: Guide to UC Davis Student Housing

Challenges in Prosecution

Despite these legislative efforts, prosecuting students for creating and sharing AI-altered images remains challenging. One hurdle is determining whether the images meet the legal definition of "sexually explicit conduct." Courts often use a multi-factor test to determine whether an image is lascivious, considering factors such as the image's focus, the pose's naturalness, and the intent to arouse the viewer.

Another challenge lies in proving intent. Prosecutors must demonstrate that the student knowingly created or shared the image with the intent to cause harm. This can be difficult, especially when minors are involved, as they may not fully comprehend the severity of their actions.

School Discipline and Educational Initiatives

In addition to legal consequences, students who create or share AI-altered images may face disciplinary action from their schools. The severity of the punishment can vary depending on the school's policies and the specific circumstances of the case.

School Policies and Cyberbullying

Many schools are updating their policies to address the threat of AI-generated deepfakes. These policies often include provisions against cyberbullying, harassment, and the creation or distribution of inappropriate content. Sameer Hinduja, the co-director of the Cyberbullying Research Center, recommends that schools update their policies on AI-generated deepfakes and get better at explaining them.

Educational Initiatives and AI Literacy

Education is crucial in preventing students from engaging in harmful behavior involving AI. AI literacy education initiatives can teach young users what crosses the line into illegal behavior and provide resources for victims of nonconsensual intimate imagery to seek redress. Laura Tierney, the founder and CEO of The Social Institute, suggests using the acronym SHIELD as a roadmap for responding to such incidents: Stop, Huddle, Inform, Evidence, and Limit.

Read also: Investigating the Death at Purdue

Dr. Jane Tavyev Asher, director of pediatric neurology at Cedars-Sinai, also called on the board to consider the consequences of "giving our children access to so much technology" in and out of the classroom.

Case Studies and Examples

Several cases illustrate the potential consequences students may face for creating and sharing AI-altered images:

Lafourche Parish, Louisiana: As previously mentioned, a 13-year-old student was expelled after hitting a classmate who allegedly created a deepfake of her.
Beverly Hills, California: An investigation was underway at a Beverly Hills Middle School after some students used Artificial Intelligence to create nude images of classmates.
David Tatum Case: David Tatum was sentenced to 40 years in prison for using generative AI to digitally alter clothed images of minors into child pornography.

These cases highlight the range of potential outcomes, from school expulsion to criminal charges and imprisonment.

The Role of Parents and the Community

Parents, educators, and community members all have a role to play in addressing the issue of AI-altered images and protecting students from harm.

Parental Involvement

Parents should actively monitor their children's online activity, including the apps they use and the content they share. Board member Rachelle Marcus noted that the district has barred students from using their phones at school, "but these kids go home after school, and that's where the problem starts. We, the parents, have to take stronger control of what our students are doing with their phones, and that's where I think we are failing completely."

Community Awareness

Raising awareness about the potential dangers of AI-altered images can help prevent their creation and spread. Schools, community organizations, and law enforcement agencies can work together to educate students and parents about the legal and ethical implications of this technology.

tags: #student #legal #consequences #AI #altered #classmate