Yazılar

Open-source AI models exposed to criminal misuse, researchers warn

Open-source artificial intelligence models are increasingly vulnerable to criminal misuse, as hackers can take control of computers running large language models outside the safeguards used by major AI platforms, according to new research released on Thursday. Researchers warned that compromised systems could be used for spam campaigns, phishing, disinformation, fraud, and other illicit activities while evading standard security controls.

The study was conducted over 293 days by cybersecurity firms SentinelOne and Censys, and examined thousands of internet-accessible deployments of open-source large language models. The researchers identified a wide range of potentially harmful use cases, including hacking, harassment, hate speech, theft of personal data, scams, and in some instances severe illegal content. They said hundreds of models appeared to have safety guardrails deliberately removed.

While thousands of open-source AI variants exist, a significant share of publicly accessible systems were based on models such as Meta’s Llama and Google DeepMind’s Gemma. The analysis focused on models deployed using Ollama, a tool that allows organizations to run their own AI systems. System prompts were visible in about a quarter of observed deployments, and 7.5% of those prompts could potentially enable harmful activity.

Researchers said roughly 30% of the identified systems were hosted in China and about 20% in the United States. Industry experts stressed that responsibility for mitigating risks must be shared across developers, deployers, and security teams, warning that unchecked open-source capacity poses growing global security concerns.

EU starts proceedings to assist Google in complying with tech rules

The European Commission has launched formal proceedings aimed at assisting Google in complying with the European Union’s Digital Markets Act, a landmark set of rules designed to curb the market power of large technology companies. The move signals closer engagement between EU regulators and Alphabet’s Google as the bloc enforces its new digital competition framework.

The Commission said the proceedings are intended to clarify how Google can meet its obligations under the DMA, which requires designated gatekeepers to ensure fair competition and greater openness in digital markets. Google has already taken steps to comply, including licensing certain search data to competitors and maintaining that its Android operating system is open by design.

However, Google warned that additional requirements could have unintended consequences. A senior company lawyer said some rules appear to be driven by complaints from rivals rather than consumer interests, and argued that excessive constraints could undermine user privacy, security and innovation.

The case highlights the balancing act facing EU regulators as they seek to rein in Big Tech while avoiding measures that could disrupt services used by millions of consumers and businesses across Europe.

Indian tourist state of Goa weighs social media ban for children

India’s top tourist state of Goa is considering a potential ban on social media use for children, drawing inspiration from Australia’s recent restrictions amid growing concerns over the impact of online platforms on young users’ mental health. The proposal comes as India remains one of the world’s largest markets for social media, with millions of users estimated to be under 18.

Goa’s information technology minister said state authorities are studying Australia’s law, which restricts social media access for children under 16, to assess whether a similar approach could be adopted locally. Officials said details of any proposal would follow after further review.

The discussion highlights the absence of nationwide rules in India governing minors’ access to social media, despite increasing debate over screen time, online safety and psychological well-being. Another Indian state, Andhra Pradesh, has also indicated it is exploring comparable measures after reviewing global regulatory efforts.

Australia last year became the first country to implement a nationwide social media ban for children under 16, a move that deactivated millions of teen accounts within weeks. Other countries, including France and several in Southeast Asia, are closely watching the outcome as they consider similar policies.