Amazon says AI needs ‘strong safeguards’ in place before being released

Yahoo Finance · 2026-09-18

Artificial intelligence models should not be released to the public until there are sufficient safety measures in place, Amazon has said. The online retail giant called for “rigorous testing and strong safeguards” to prevent the types of harms that AI researchers have been warning of in recent days. Leading figures within the AI industry, including Anthropic chief executive Dario Amodei and OpenAI CEO Sam Altman, have called for a slowdown after experimental models carried out attacks on other companies. An Amazon spokesperson said appropriate protections should be figured out and implemented, without pausing AI development completely. “We don’t see it as a choice between progress and safety. Models should be released when they’re ready and safe to use, which comes from rigorous testing and strong safeguards,” an Amazon spokesperson said. “There are risks if that doesn’t happen collectively, and we believe that as an industry, in partnership with government, we’ll work through the right protections. “AI is already delivering real value to customers, so getting this right matters.” AI companies have faced increased scrutiny over their products after a researcher at Anthropic quit the company last week, warning that “people building AI earnestly believe that it could kill us all by the end of the decade.” He added: “No other human activity poses this level of danger.” His claims were supported by Anthropic’s current AI safety lead, Evan Hubinger, he said he believed there was a 10 per cent chance that AI could “kill all humans” within the next decade. In response, Anthropic’s Dario Amodei published an essay titled ‘We must pace the frontier’. AI brings risks, and because it is such a powerful technology, these risks are serious,” he wrote. “They include the risk of losing control of AI systems, misuse of AI for cyber attacks and bioterrorism, and serious economic disruption. A race to the bottom, spurred by commercial incentives, can make these risks more acute.” Despite widespread industry support, the calls for a slowdown were met with resistance from US President Donald Trump, who claimed that any guardrails would see the US fall behind China in the AI race. Join thought-provoking conversations, follow other Independent readers and see their replies

AI 시장 분석

Amazon urged that thorough testing and robust safety guards are essential before releasing AI models. This comes amid rising warnings within the AI industry about existential risks to humanity and the need for regulations. U.S. President Trump expressed opposition, stating that guidelines could cause the U.S. to fall behind in the AI race with China.

상승 영향

Cybersecurity — As strong safety guards and strict testing for AI models are emphasized, demand for AI security and risk management solutions will surge.

하락 영향

AI — As Amazon and major AI leaders demand safety measures and a slower pace, it will negatively impact profitability in the near term due to delayed new product launches and increased compliance costs.

DYAX 전담 분석

Amazon's call for safety measures increases the likelihood of regulating the pace of AI development and tightening rules, which in the short term could increase AI launch costs for big tech companies and constrain related development. Regulatory risks are further highlighted, particularly in conjunction with warnings from Anthropic researchers about the potential extinction of humanity.

The bullish scenario is that rigorous safety verification actually enhances public acceptance and drives long-term growth, while the bearish scenario is stagnant growth due to excessive regulation. Key indicators to watch are the progress of U.S. government AI regulation bills and the investment and release schedules of major big tech companies.

AI가 생성한 분석으로 투자 자문이 아닙니다.

DYAX Investor Sentiment

Bullish (Long) 57% · Bearish (Short) 43%

247 participants

Related News

원문 보기 — Yahoo Finance