Wikiwand AI

Trustworthy AI

AI standards for robustness and data privacy From Wikipedia, the free encyclopedia

Trustworthy AI refers to artificial intelligence systems that are designed to have transparent reasoning, are explainable (XAI), accountable, robust, fair and honest, respectful of data privacy, and steerable or alignable with human goals.[1][2][3][4]

Terminology

Recent work in AI ethics distinguishes trustworthiness and trustability as two different conditions relevant to trustworthy AI. Trustworthiness is concerned with whether an AI system or the institutions deploying it merit trust by being reliable, fair, and accountable. Trustability, on the other hand, is the prior question of whether a given entity is even the kind of thing to which interpersonal trust can coherently apply as opposed to mere instrumental reliance.[5]

Transparency in AI involves making the processes and decisions of such systems understandable to users and stakeholders. Accountability means that protocols for addressing adverse outcomes or algorithmic biases that may arise include designated responsibilities for oversight and remediation. Robustness and security attempt to ensure that AI systems perform reliably under various conditions and are safeguarded against malicious attacks.[6]

Harmlessness can be achieved by refusal training: training the models to avoid problematic requests, and by adding filters to detect and prevent discussion on biased, unethical, or dangerous outputs.[2]

In the field of machine learning research, there have been many similar studies carried out under the notion of trustworthy machine learning.[7][8] The annual conference known as the IEEE Conference on Secure and Trustworthy Machine Learning (SaTML), organized by the IEEE Computer Society Technical Committee on Security and Privacy, has also been held since 2023.[9]

Techniques and ITU standardization

Trustworthy AI creation is a goal of AI governance and policymaking. To achieve transparency and data privacy, several privacy-enhancing technologies (PETs) can be used. These include:[10][11]

A work programme for achieving Trustworthy AI was set up by the International Telecommunication Union (ITU), an agency of the United Nations, initiated under its AI for Good programme.[11] Its origin lies with the ITU-WHO Focus Group on Artificial Intelligence for Health, where a strong need for both privacy and analytics created demand for a standard in these technologies.

In 2020, AI for Good moved online, and the TrustworthyAI seminar series was established to initiate discussions on these topics. This eventually led to standardization activities.[12]

In the European Union, the Ethics Guidelines for Trustworthy AI say that trustworthy AI should be lawful, ethical, and robust. In practice, the guidelines define seven requirements for trustworthy AI: human agency and oversight; technical robustness and safety; privacy and data governance; transparency; diversity, non-discrimination and fairness; societal and environmental well-being; and accountability.[13]

Multi-party computation

Secure multi-party computation (MPC) is being standardized under "Question 5" (the incubator) of ITU-T Study Group 17.[14]

Homomorphic encryption

Homomorphic encryption allows for computing on encrypted data, where the outcomes or result is still encrypted and unknown to those performing the computation, but can be deciphered by the original encryptor. It is often developed with the goal of enabling use in jurisdictions different from the data creation (under, for instance, GDPR).[citation needed]

ITU has been collaborating since the early stage of the HomomorphicEncryption.org standardization meetings, which has developed a standard on homomorphic encryption. The fifth homomorphic encryption meeting was hosted at ITU HQ in Geneva.[citation needed]

Federated learning

Zero-sum masks as used by federated learning for privacy preservation are used extensively in the multimedia standards of ITU-T Study Group 16 (VCEG) such as JPEG, MP3, H.264, and H.265 (commonly known as MPEG).[citation needed]

Zero-knowledge proof

Previous pre-standardization work on the topic of zero-knowledge proof has been conducted in the ITU-T Focus Group on Digital Ledger Technologies.[citation needed]

Differential privacy

The application of differential privacy in the preservation of privacy was examined at several of the "Day 0" machine learning workshops at AI for Good Global Summits.[citation needed]

Mozilla "Rebel Alliance"

In January 2026, the Mozilla Foundation and its subsidiaries announced a strategic shift to deploy their entire $1.4 billion reserve into building what foundation president Mark Surman termed a "rebel alliance" for trustworthy AI.[15] Framed by Surman as a mission-driven alternative to the market dominance of OpenAI and Anthropic, the initiative seeks to establish an open-source AI stack by 2028.[15][16]

The alliance includes several startups funded via Mozilla Ventures, specifically focusing on decentralized governance and transparency:[17]

  • Trail: A firm developing AI compliance frameworks for regulated industries.
  • Transformer Lab: A developer of open-source tools for AI model management.
  • Oumi: A platform for training and deploying open-source models.

The "rebel alliance" terminology is a historical reference to Mozilla's efforts in 1998 to challenge Microsoft's browser monopoly.[15] While the $1.4 billion in funding is significant, it has been contrasted with the tens of billions in capital raised by proprietary competitors like OpenAI.[16][17]

Debate

Some philosophers argue that current AI systems are best understood as tools that are not genuine targets of interpersonal trust. They argue that trust should be directed toward the human and institutional arrangements that govern the systems' design, deployment, and oversight. This stance supports interpreting "trustworthy AI" as trustworthy governance and use of AI rather than trust in the artifacts themselves.[5]

According to Zanotti et al., a common argument is that "An entity X is trustworthy only if X has the right motivations, goodwill and/or adheres to moral obligations towards the trustor" and that AI systems lack these characteristics. Zanotti et al. reject this conclusion, arguing that a definition of trustworthiness for AI systems doesn't have to mirror the definition for humans and could instead be based on reliability coupled with value-laden features, such as fairness, transparency, and respect for human autonomy.[18]

Stuart J. Russell and Peter Norvig indicate that earning trust can involve verification and validation, certification, transparency, and explainability.[19]

See also

References

Related Articles

Timelines

Top Qs

Fact Checks