Can Autonomous and Intelligent Systems Be Trusted?

As autonomous and intelligent systems find their way into a rapidly expanding number of applications, many business and technology leaders are beginning to ask the same question: Can you trust them?

Although AI technology has been around for decades, many of its current applications are new and need time to mature, observed Deborah Adleman, director and U.S. and Americas data protection leader for global business consulting firm EY. Adleman will lead the session “Can You Trust Your Autonomous and Intelligent Systems?” at Interop on May 22 from 2:30 pm to 3:20 pm.

Ethical considerations, more than anything else, can introduce implications that have historically not been mainstream for technology, including moral behavior, fairness, bias, transparency and respect, Adleman warned. “Other social considerations include workforce disruption, skills retraining, discrimination and environmental effects,” she added.

Understanding the risks

Organizations need to fully understand the full spectrum of risk AI can introduce and establish appropriate continuous monitoring mechanisms, Adleman said. “AI developers and operators also need to recognize that the threats from AI go beyond just operational challenges, and may also lead to customer dissatisfaction, negative media attention, adversarial attacks, employee churn, regulatory scrutiny and reduced profitability,” she explained.

Governments and regulators are just now beginning to work closely with industry to understand exactly how AI is being developed and used, as well as the applicability of current laws and regulations to the technology. “They recognize their role to protect the public, but also want to make sure that they don’t stifle innovation,” Adleman said. “With the fast pace that AI is evolving, they are currently relying more heavily on guiding principles rather than prescriptive rules and have established advisory committees to further study what additional safeguards are needed.”

AI systems are,