Why the FTC is examining ChatGPT’s claims about people

The FTC is investigating OpenAI over ChatGPT’s handling of user data and its potential to spread false, harmful claims about individuals. Its questions include a March chat history leak, safeguards around software updates and whether users understand that ChatGPT can produce false information.

WTF Index TERMINATOR
◄ Terminator 3 Idiocracy 2 ►

The investigation highlights privacy risks and harmful false claims generated by ChatGPT, with a modest lean toward AI-enabled harm.

Why the FTC is examining ChatGPT’s claims about people

The FTC is investigating OpenAI’s ChatGPT over concerns about user data and misinformation about individuals, according to The Washington Post and The New York Times. The inquiry puts two issues in focus: how the company protects information and how it responds when its chatbot makes damaging claims that are not true.

What the FTC wants to know

In a detailed 20-page letter, the agency asked OpenAI about potential risks to users. It also requested information about data security incidents and the precautions the company takes before software updates.

The FTC is seeking more detail about a chat history leak that happened in March. It is also asking whether ChatGPT users know that the system can generate false information. Together, those questions concern both the handling of data and the expectations people may bring to a conversational AI tool.

The source article does not describe the letter as a finding that OpenAI violated any rules. It reports an investigation and questions from the agency. Those questions can help show what regulators are examining, but they do not establish the outcome.

False claims about individuals raise the stakes

ChatGPT can communicate in a human-like way, but the source notes that the AI does not understand the content it generates. That gap matters when an answer presents invented or inaccurate details about a real person in a convincing form.

At least two publicly known cases illustrate the concern. In one, ChatGPT accused a law professor of a sexual assault he didn’t commit. In another, it generated false claims about an Australian mayor who allegedly went to prison for bribery.

These examples show why misinformation about individuals is different from a plainly mistaken answer about a general topic. A false allegation can cause harm to the person described, while the system’s fluent presentation may make it harder for a reader to recognize that the claim is unreliable.

The FTC’s question about user awareness addresses one part of that problem: whether people understand that ChatGPT can be wrong. The article does not say what users currently know or what changes the agency may seek.

A first major regulatory challenge for OpenAI

The investigation is described as OpenAI’s first significant regulatory challenge. The company’s co-founder, Sam Altman, had previously welcomed AI legislation in congressional testimony, pointing to the industry’s rapid growth and potential risks such as job losses and the spread of disinformation.

Altman reacted to the FTC inquiry on Twitter, saying it was disappointing that it “starts with a leak and does not help build trust.” He also pointed to GPT-4’s safety work, describing “years of safety research” and an additional 6-month phase after initial training to optimize alignment and safety.

Altman added: “We protect user privacy and design our systems to learn about the world, not about individuals,” he writes. His comments set out the company’s stated approach, while the investigation seeks information about how its systems and data practices work in practice.

What the inquiry leaves open

The questions reported so far concern data security, safeguards before updates, the March chat history leak and user understanding of false outputs. The source article does not report a final decision or specify what action, if any, the FTC may take.

For users, the cases described offer a practical reason to treat claims about real people with care. A confident-sounding answer is not proof that an allegation is true. For OpenAI, the agency’s inquiry means explaining its protections and how it addresses the risk that ChatGPT will generate harmful falsehoods.