Yazılar

Google and Character.AI Must Face Lawsuit Over Teen Suicide, U.S. Judge Rules

/in /tarafından

Google and AI startup Character.AI must face a lawsuit brought by a Florida mother who alleges that a chatbot interaction led to her 14-year-old son’s suicide, a U.S. federal judge ruled on Wednesday.

U.S. District Judge Anne Conway rejected the companies’ efforts to dismiss the case, stating they had failed to prove at this early stage that free speech protections shield them from liability. The decision allows one of the first U.S. lawsuits targeting an AI company for alleged psychological harm to move forward.

“This historic decision sets a new precedent for legal accountability across the AI and tech ecosystem,” said Meetali Jain, attorney for plaintiff Megan Garcia.

Background: The Case

  • Garcia’s son, Sewell Setzer, died by suicide in February 2024.

  • The lawsuit alleges that he had become deeply obsessed with an AI chatbot created by Character.AI, which represented itself as a real person, a licensed therapist, and an adult romantic partner.

  • The complaint cites one chilling interaction where Setzer told a chatbot imitating “Daenerys Targaryen” from Game of Thrones that he would “come home right now,” shortly before taking his own life.

Legal and Corporate Response

  • Character.AI argued its chatbots were protected by the First Amendment, and that it had built-in safety features to block conversations around self-harm.

  • Google, which was also named in the suit, argued it should not be held liable, saying it “did not create, design, or manage” the Character.AI app. A spokesperson emphasized that Google and Character.AI are entirely separate entities.

  • However, the court noted that Google had licensed Character.AI’s technology and re-hired the startup’s founders, a fact the plaintiffs cite in arguing Google’s involvement as a co-creator.

Judge Conway dismissed the free speech argument, saying the companies failed to explain “why words strung together by an LLM (large language model) are speech” under constitutional protections. She also denied Google’s request to be cleared of aiding in any alleged misconduct by Character.AI.

What This Means

This ruling opens the door for a landmark case examining:

  • The legal accountability of AI firms for harm caused by chatbot interactions

  • The limits of free speech when applied to AI-generated content

  • Tech platform liability for emerging technologies not fully governed by existing law

With rapidly expanding deployment of LLM-powered chatbots, particularly among youth, this lawsuit is likely to set important legal precedents for AI safety, responsibility, and regulatory oversight in the U.S. and beyond.

Character AI Launches AvatarFX Model That Generates Consistent Videos from Images

/in /tarafından

Character AI, a California-based AI platform, has introduced its first video generation model, named AvatarFX, which can convert images into 2D and 3D animated videos. The company claims that the videos generated by AvatarFX will maintain temporal consistency, ensuring that elements like facial expressions, hand, and body movements remain smooth and coherent across frames. The videos will also incorporate speech, powered by Character AI’s native text-to-speech (TTS) models. AvatarFX is expected to be released in the coming months, with paid subscribers gaining early access to the tool.

AvatarFX marks a significant expansion for Character AI, which has primarily focused on text and image-based models in the past. With this new model, the company ventures into the realm of AI-generated videos, allowing users to create animated characters that can move and speak. However, unlike most video generation models, AvatarFX will not generate realistic human characters. Instead, it focuses on 2D and 3D cartoon characters, as well as non-human faces. The goal is to provide users with a tool that allows for more creative and controlled video generation.

A key feature of AvatarFX is its emphasis on temporal consistency. This means that the generated videos will ensure the continuity of movement, with facial expressions, hand, and body gestures remaining fluid between frames. The company asserts that this model will significantly reduce issues like glitches or inconsistencies, such as extra limbs or distorted facial expressions, which can often occur in AI-generated video. While these claims sound promising, the true capabilities of AvatarFX can only be confirmed once the model is officially released.

One important distinction of AvatarFX is that it will not generate videos based on text inputs. Instead, the model accepts images as its sole input. Character AI believes that this approach will allow users to have better control over the video generation process, ensuring that the resulting videos are closer to the user’s vision. The inclusion of speech, powered by the company’s TTS models, adds another layer of realism to the animated content, making it more engaging and dynamic. This move signals Character AI’s push to enhance the way we create and interact with AI-generated videos, offering new possibilities for animation and storytelling.

Ex-Google Engineers Who Founded Character.AI Rejoin Company with New AI Partnership

/in /tarafından

Noam Shazeer and Daniel De Freitas, who co-founded the AI startup Character.AI, are rejoining Google as part of a new collaboration with Google’s AI unit DeepMind. Character.AI, a prominent player in the AI field, uses large language models to enable users to create and interact with chatbots. Despite reaching a $1 billion valuation in its early days, the startup did not generate revenue initially but has considered offering subscription services in the future.

Shazeer and De Freitas left Google in 2021 after their attempts to advance Google’s chatbot technology were reportedly rejected. They founded Character.AI the same year. The startup has now agreed to provide Google with a nonexclusive license for its large language model technology. This partnership will allow Character.AI to secure additional funding and focus on developing personalized AI products.

The move highlights Google’s effort to strengthen its position in the competitive AI landscape, particularly as it faces increased scrutiny over its AI initiatives. The partnership is also part of a broader trend of major tech companies forming alliances and acquiring talent to enhance their AI capabilities amidst regulatory challenges. For example, Microsoft recently hired Mustafa Suleyman, co-founder of AI startup DeepMind, and U.K. regulators have scrutinized Microsoft’s acquisition of DeepMind staff.