Operational Use of AI in the UN System
Published 2025-01-10 · By Shahzad Asghar
<p><!DOCTYPE html></p><p><html lang="en"></p><p><head></p><p> <meta charset="UTF-8"></p><p> <meta name="viewport" content="width=device-width, initial-scale=1.0"></p><p> <title>Briefing Document: Operational Use of AI in the UN System</title></p><p> <style></p><p> body {</p><p> font-family: Arial, sans-serif;</p><p> line-height: 1.6;</p><p> margin: 20px;</p><p> padding: 0;</p><p> background-color: #f9f9f9;</p><p> color: #333;</p><p> }</p><p> h1, h2, h3 {</p><p> color: #2c3e50;</p><p> }</p><p> h1 {</p><p> text-align: center;</p><p> margin-bottom: 20px;</p><p> }</p><p> h2 {</p><p> border-bottom: 2px solid #2c3e50;</p><p> padding-bottom: 5px;</p><p> margin-top: 40px;</p><p> }</p><p> .section {</p><p> margin-bottom: 30px;</p><p> }</p><p> .section p {</p><p> margin: 10px 0;</p><p> }</p><p> .section ul {</p><p> margin: 10px 0;</p><p> padding-left: 20px;</p><p> }</p><p> .section ul li {</p><p> margin-bottom: 10px;</p><p> }</p><p> .quote {</p><p> background-color: #f4f4f4;</p><p> padding: 15px;</p><p> border-left: 4px solid #3498db;</p><p> margin: 20px 0;</p><p> font-style: italic;</p><p> }</p><p> .code-block {</p><p> background-color: #f4f4f4;</p><p> padding: 15px;</p><p> border-radius: 5px;</p><p> font-family: "Courier New", Courier, monospace;</p><p> overflow-x: auto;</p><p> margin: 20px 0;</p><p> }</p><p> pre {</p><p> margin: 0;</p><p> }</p><p> code {</p><p> font-family: "Courier New", Courier, monospace;</p><p> font-size: 14px;</p><p> }</p><p> a {</p><p> color: #3498db;</p><p> text-decoration: none;</p><p> }</p><p> a:hover {</p><p> text-decoration: underline;</p><p> }</p><p> </style></p><p></head></p><p><body></p><p> <h1>Briefing Document: Operational Use of AI in the UN System</h1></p><p> <!-- Introduction & Context --></p><p> <div class="section"></p><p> <h2>1. Introduction & Context</h2></p><p> <p></p><p> This document summarises the key findings and recommendations from the "Report on the Operational Use of AI in the UN System". The report examines the increasing adoption of Artificial Intelligence (AI) across various UN agencies, highlighting both the opportunities and challenges presented by this technological shift. The overarching aim is to foster a more coordinated, efficient, and impactful use of AI to support the UN's Sustainable Development Goals (SDGs) and broader mandates.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Quote:</strong> "As AI adoption accelerates within the UN System, a growing number of agencies are leveraging these technologies to enhance their work and support their efforts towards achieving sustainable development."</p><p> </div></p><p> </div></p><p> <!-- Main Themes and Findings --></p><p> <div class="section"></p><p> <h2>2. Main Themes and Findings</h2></p><p> <p></p><p> The report is structured around five main focus areas:</p><p> </p></p><p> <h3>Focus Area #1: AI Activities and Initiatives</h3></p><p> <p></p><p> This section provides an overview of the AI projects and activities across the UN system. It emphasizes the decentralized nature of AI adoption, leading to both innovation and potential duplication of effort. It notes the importance of collaborative efforts like the High-Level Committee on Management (HLCM) Digital and Technology Network (DTN), the High-Level Committee on Programmes (HLCP) Inter-Agency Working Group on AI (IAWG-AI), the UN Innovation Network (UNIN), and the ITU AI for Good Platform.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Finding:</strong> There are over 700 AI projects across 50+ UN entities. These are classified by level of detail and applicability (conceptual, practical, or both), and by target audience and scope (internal, external, or both).</p><p> </div></p><p> <h3>Focus Area #2: AI Use Cases and Solutions</h3></p><p> <p></p><p> This section explores the application of AI across the UN System. It categorises projects by data type (text, mixed/multimodal, quantitative, GIS/geospatial, audio, image/video) and notes the prevalence of custom solutions for thematic work. The PRISM framework, developed by the DTN GenAI CoP, is introduced as a tool for prioritizing AI use cases.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Finding:</strong> Most projects are focused on custom thematic solutions (64%), with text, documents and language being the most used data type (48%).</p><p> </div></p><p> <h3>Focus Area #3: AI Project Platforms</h3></p><p> <p></p><p> The report addresses the need for open-source practices and collaborative platforms. It highlights the UN's presence on platforms like GitHub and Hugging Face and details efforts to establish a UN-wide open-source ecosystem, led by the DTN Open-Source Software Community of Practice (DTN OSS CoP). The Development Data Partnership is presented as an example of a successful collaborative project platform.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Finding:</strong> There is a strong UN presence in open-source platforms, especially Github, and efforts are underway to formalize a UN open-source approach.</p><p> </div></p><p> <h3>Focus Area #4: Emergence of Generative AI</h3></p><p> <p></p><p> This section examines the impact of generative AI, particularly the use of Large Language Models (LLMs) and chatbots. It describes projects that are in pilot or experimental stages. It emphasises the importance of Retrieval Augmented Generation (RAG) techniques. The case study of ITCILO’s AnswerMate is examined as an example of successful implementation.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Finding:</strong> Generative AI, specifically chatbots using RAG techniques, are being rapidly adopted.</p><p> </div></p><p> <h3>Focus Area #5: Adopting and Adapting to AI</h3></p><p> <p></p><p> This section delves into the organisational aspects of AI integration, focusing on governance, strategy, and structure. It notes various approaches across different agencies - from top-down strategies to bottom-up initiatives. The section presents a look at the challenges and opportunities from organisational approaches within organisations such as FAO, IFAD, IMF, UNDP, UNHCR, UNJSPF, UNICEF, and WFP.</p><p> </p></p><p> <div class="quote"></p><p> <strong>Key Finding:</strong> UN agencies are experimenting with approaches to implementing AI, some more centrally structured than others. The approach is dependent on the organisation's individual needs.</p><p> </div></p><p> </div></p><p> <!-- Key Ideas and Facts --></p><p> <div class="section"></p><p> <h2>3. Key Ideas and Facts</h2></p><p> <ul></p><p> <li></p><p> <strong>Decentralization & Collaboration:</strong> While AI adoption is accelerating across the UN, the decentralized nature of the system presents challenges, potentially leading to duplicated effort and missed opportunities.</p><p> <div class="quote"></p><p> "The decentralized nature of the UN System presents challenges in the context of AI adoption, development, and integration. While individual agencies have made significant strides in implementing AI solutions tailored to their specific needs, there is a risk of duplicating efforts and resources..."</p><p> </div></p><p> </li></p><p> <li></p><p> <strong>Interdisciplinary Approach:</strong> Many UN challenges require interdisciplinary approaches, which can benefit from collaborative AI development between agencies.</p><p> <div class="quote"></p><p> "...the complex and multifaceted challenges addressed by the UN may require interdisciplinary approaches that could benefit from collaborative inter-agency development on AI."</p><p> </div></p><p> </li></p><p> <li></p><p> <strong>Importance of Frameworks:</strong> The report highlights the importance of tools and frameworks to make informed decisions about AI projects.</p><p> <ul></p><p> <li><strong>PRISM Framework:</strong> A framework designed for UN organisations to evaluate AI projects and assist in making informed decisions.</li></p><p> <li><strong>WIPO Risk Assessment Framework:</strong> A tool designed to evaluate the risks associated with commercial AI products.</li></p><p> </ul></p><p> </li></p><p> <li></p><p> <strong>Open Source:</strong> The UN recognises the value of open-source practices for the responsible development of software, including the need for security, privacy, and data protection. A focus is on establishing a secure, open-source ecosystem within the UN.</p><p> <div class="quote"></p><p> “Open-source practices are essential to modern software development, with several open-source technologies, projects, and communities having shaped the way of working for all technology professionals, regardless of background or domain.”</p><p> </div></p><p> </li></p><p> <li></p><p> <strong>Generative AI & RAG:</strong> Generative AI technologies, particularly chatbots using RAG (Retrieval Augmented Generation), are increasingly used for knowledge management and improving access to information.</p><p> <div class="quote"></p><p> "In the context of Generative AI chatbots and similar applications, retrieval-augmented generation (RAG) is fast becoming one of the most widely adopted and implemented techniques in projects across the UN System."</p><p> </div></p><p> </li></p><p> <li></p><p> <strong>Data Divide:</strong> The report notes the disproportionate amount of English-language datasets and models on platforms such as Hugging Face, underscoring the need to address digital inclusion.</p><p> </li></p><p> </ul></p><p> </div></p><p> <!-- Recommendations --></p><p> <div class="section"></p><p> <h2>4. Recommendations</h2></p><p> <p></p><p> The report makes several recommendations focused on achieving strategic and cohesive adoption of AI across the UN system:</p><p> </p></p><p> <ul></p><p> <li></p><p> <strong>General Recommendation:</strong> Develop a unified, integrated, and coherent approach to AI technologies and implementation.</p><p> </li></p><p> <li></p><p> <strong>Specific Recommendations:</strong></p><p> <ul></p><p> <li>Create a normative guidance/model policy for the use of AI within the UN System.</li></p><p> <li>Promote mechanisms for pooling technical capacity and knowledge sharing.</li></p><p> <li>Centralise and standardise cataloging efforts of AI activities, initiatives, use cases and solutions.</li></p><p> <li>Continue knowledge sharing in AI communities of practice, supporting their activities with sufficient resources.</li></p><p> <li>Encourage the use of the PRISM framework for evaluating and prioritizing AI use cases.</li></p><p> <li>Support the development of a project-hosting platform for the UN System and promote responsible open-source practices.</li></p><p> <li>Develop a risk assessment framework for AI use in the UN System, providing guidance on common risks and mitigations.</li></p><p> <li>Strengthen and leverage collective bargaining agreements with AI technology vendors.</li></p><p> <li>Explore partnerships with public and private entities to mobilise resources for AI development.</li></p><p> <li>Conduct targeted assessments and develop business cases for UN system-wide AI assets.</li></p><p> <li>Actively engage in wider AI-adjacent platforms to continue investment in AI growth.</li></p><p> <li>Consider recommendations regarding AI governance contained in the United Nations System White Paper on AI Governance.</li></p><p> <li>Extend the scope of existing communities and working groups to cover the AI domain holistically.</li></p><p> <li>Actively contribute to the development of AI-related components for system-wide use (code, datasets, models).</li></p><p> </ul></p><p> </li></p><p> </ul></p><p> </div></p><p> <!-- Conclusion --></p><p> <div class="section"></p><p> <h2>5. Conclusion</h2></p><p> <p></p><p> The report provides a comprehensive overview of AI adoption within the UN, highlighting both the potential and the challenges. The key message is that a more collaborative, coordinated, and strategic approach is needed to fully realize the benefits of AI while ensuring ethical and responsible implementation across the UN system. The report emphasizes the need for unified frameworks, shared resources, and a focus on responsible AI development and deployment.</p><p> </p></p><p> </div></p><p></body></p><p></html></p>