Global Leaders Demand AI “Red Lines” Before 2026 Agreement

More than 200 former heads of state, diplomats, Nobel laureates, and AI experts have united in a call for an international agreement establishing specific “red lines” for artificial intelligence (AI). This initiative, known as the Global Call for AI Red Lines, urges governments to create a formal political consensus by the end of 2026 on what AI should never be permitted to do. Notable signatories include computer scientist Geoffrey Hinton, OpenAI co-founder Wojciech Zaremba, and AI safety advocate Maria Ressa.

During a briefing on Monday, Charbel-Raphaël Segerie, executive director of the French Center for AI Safety (CeSIA), emphasized that the goal is to prevent large-scale risks before they materialize. “If nations cannot yet agree on what they want to do with AI, they must at least agree on what AI must never do,” he stated, highlighting the urgent need for proactive measures in AI governance.

Global Consensus on AI Safety Lacking

The announcement coincides with the 80th United Nations General Assembly high-level week in New York, where discussions about technology governance are increasingly prominent. The initiative is spearheaded by CeSIA, the Future Society, and UC Berkeley’s Center for Human-Compatible Artificial Intelligence. Ressa mentioned the initiative in her opening remarks, advocating for global accountability in the tech sector.

While there are some existing frameworks, such as the European Union’s AI Act, which bans certain unacceptable uses of AI, a comprehensive global consensus is still absent. Niki Iliadis, director for global governance of AI at The Future Society, noted that more than voluntary commitments are necessary. She argued for the establishment of an independent global institution capable of defining, monitoring, and enforcing these red lines.

Safety Must Precede Development

Concerns about the risks of AI have been echoed by leading figures in the field. Stuart Russell, a prominent AI researcher at UC Berkeley, compared the current state of AI development to early nuclear power initiatives. He suggested that AI developers should not advance toward artificial general intelligence (AGI) without a clear understanding of safety protocols. “Just as nuclear power developers did not build nuclear plants until they had some idea how to stop them from exploding, the AI industry must choose a different technology path,” Russell explained.

Critics often argue that implementing strict regulations could hinder economic development. Russell countered this notion, asserting that it is possible to leverage AI for economic growth without risking uncontrollable AGI. “You can have AI for economic development without having AGI that we don’t know how to control,” he stated.

As the global dialogue surrounding AI evolves, the call for clear and enforceable guidelines reflects a growing awareness of the potential dangers posed by unchecked advancements in technology. Stakeholders are urging a collaborative approach to ensure that AI serves humanity safely and ethically.