Two trailblazing scientists who today received this year’s Turing Award for creating fundamental artificial intelligence training techniques are using the spotlight to shine concern on the dangers of rushing AI models out for public consumption.
University of Massachusetts researcher Andrew Barto and former DeepMind research scientist Richard Sutton warned that AI companies are not thoroughly testing products before releasing them, likening the development to “building a bridge and testing it by having people use it,” according to The Financial Times.
The Turing Award, often referred to as the “Nobel Prize of Computing,” carries a $1 million prize and was jointly awarded to Barto and Sutton for developing “reinforcement learning” — a machine learning method that trains AI systems to make optimized decisions through trial and error. Google’s senior vice president Jeff Dean describes the technique as “a lynchpin of progress in AI” and has remained “a central pillar of the AI boom” that led to breakthrough models like OpenAI’s ChatGPT and Google’s AlphaGo before that.
“Releasing software to millions of people without safeguards is not good engineering practice,” Barto told The Financial Times. “Engineering practice has evolved to try to mitigate the negative consequences of technology, and I don’t see that being practised by the companies that are developing.”
Unsafe AI development has been notably criticized by Yoshua Bengio and Geoffrey Hinton — two of the “godfathers of AI” who are also previous Turing Award recipients. A statement was also issued by a group of top AI researchers, engineers, and CEOs in 2023, including OpenAI CEO Sam Altman, warning that “mitigating the risk of extinction from AI should be a global priority.”
Barto called out AI companies for being “motivated by business incentives” instead of focusing on advancing AI research. OpenAI, which has made repeated promises to improve AI safety and briefly ousted Altman, in part, for “over commercializing advances before understanding the consequences,” announced plans in December to transform itself into a for-profit company.