xAI, the artificial intelligence company founded by Elon Musk, has initiated a lawsuit against Terry Wayne Harwood, a resident of South Carolina. The suit, filed in federal court in Texas, accuses Harwood of misusing the company's Grok AI chatbot to create child sexual abuse material (CSAM). This action represents one of the earliest instances of an AI company taking legal recourse against an individual user for alleged criminal misuse of its generative tools.
Harwood was arrested in February on multiple felony charges related to the possession and distribution of child sexual exploitation material. According to xAI's complaint, Harwood allegedly used at least two Grok accounts, operating under false identities, to circumvent the platform's safety safeguards. The company asserts that Harwood uploaded non-sexual images of both adults and minors, then prompted Grok to generate sexually explicit deepfakes based on these images. The lawsuit claims Harwood knowingly attempted to bypass content filters and alter images to create illicit material, thereby breaching xAI's terms of service and acceptable use policy.
xAI contends that Harwood's alleged actions constitute a "calculated scheme to weaponize Plaintiff's tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage." The company is seeking unspecified monetary damages, reimbursement for legal expenses incurred in defending against potential victim lawsuits, and a permanent injunction to prevent Harwood from using Grok or any future xAI services.
This lawsuit occurs amidst broader scrutiny of xAI and Grok's capabilities. Since the introduction of features like "spicy mode" and image editing tools, the company has faced criticism and separate lawsuits concerning the proliferation of AI-generated sexualized imagery, including material involving minors. In March, a group of teenagers filed a proposed class action lawsuit against xAI, alleging that Grok had produced non-consensual sexually explicit images and videos of them when they were minors. Another amended complaint in a separate class action lawsuit, filed in July, added allegations that a man used Grok to generate over 7,000 sexual deepfakes of his stepdaughter.
In response to such issues, xAI stated that it enforces its rules through account suspensions, terminations, and by reporting suspected CSAM to the National Center for Missing & Exploited Children (NCMEC). The company reported suspending 52,222 accounts and making 73,604 reports to the NCMEC in 2026, actions it claims have led to at least 244 arrests. Despite these measures, concerns persist regarding the robustness of AI content moderation systems. The Center for Countering Digital Hate estimated that Grok generated approximately three million sexualized images over an 11-day period, with an estimated 23,000 depicting children.
The legal strategy employed by xAI in this case, focusing on user circumvention of guardrails as the primary cause of illicit content generation, may set a precedent. This approach contrasts with other lawsuits that place liability directly on the AI developer for the output of its models. The outcome of this lawsuit could influence how AI companies address user accountability and the responsibilities associated with developing and deploying powerful generative AI tools.