Safety risks
What happens when we lose control of the very systems we built? This is not a thought experiment or a movie plot. It is a live problem that top scientists and policymakers are trying to solve right now. The papers in this section look at the real timelines for artificial general intelligence, the intense global race to build it, and the nightmare scenario of these tools falling into the wrong hands. We need rules before the technology completely outpaces our ability to manage it.
Recognition
AI Treaty (n.d.)
Urging an International AI Treaty: An Open Letter
Altman, S., Brockman, G. & Sutskever, I. (2023)
Governance of Superintelligence. OpenAI, 22 May
Center for AI Safety (n.d.)
Statement on AI Risk
Future of Life Institute (2023)
Pause Giant AI Experiments: An Open Letter
Future of Life Institute (2025)
Statement on Superintelligence
PauseAI (n.d.)
Quotes
The Bletchley Declaration by Countries Attending the AI Safety Summit (2025)
The Bletchley Declaration by Countries Attending the AI Safety Summit, 1–2 November 2023 (updated 13 February 2025)
Ventura, T. (2024)
State Department Warns of Extinction-Level AI Threat | David Wood. YouTube
United Nations Press (2023)
International Community Must Urgently Confront New Reality of Generative, Artificial Intelligence, Speakers Stress as Security Council Debates Risks, Rewards. UN Press, 18 July
AI NGOs, Research Organizations, Ethical AI Organizations
AI Ethicist
AI Governance Library, (2025)
AI Governance Library
Welcome to the Artificial Intelligence Incident Database
AI Incident Database
AISafety.com, (2025)
AISafety
Information Hub | Convergence Analysis
Convergence Analysis
Interactive AI Safety Ecosystem Hub (List & Map), (2025)
David Veksler
AI Risk Repository, (2024)
MIT
AI Watch, (2025)
Issa Rice
Timelines
AI Digest (2025)
A New Moore’s Law for AI Agents
Altman, S., Brockman, G. & Sutskever, I. (2024)
Governance of Superintelligence
Chollet, F. (2017)
The Implausibility of Intelligence Explosion
Cotra, A. & Narayanan, A. (2025)
Does AI Progress Have a Speed Limit? Asterisk
Erdil, E. (2025)
The Case for Multi-Decade AI Timelines
Fist, T., Burga, T. & Hwang, T. (2025)
Preparing for Launch. Institute for Progress
Grace, K. (2024)
Survey of 2,778 AI Authors: Six Parts in Pictures
Grace, K., Stewart, H., Sandkühler, J. F., Thomas, S., Weinstein-Raun, B., Brauner, J. & Korzekwa, R. C. (2024)
Thousands of AI Authors on the Future of AI. arXiv preprint arXiv:2401.02843
Kapoor, S., Narayanan, A., Kokotajlo, D., Lifland, E. & Larsen, T. (2025)
Common Ground Between AI 2027 & AI as Normal Technology
Karnofsky, H. (n.d.)
The “Most Important Century” Blog Post Series. Cold Takes
Kokotajlo, D., Alexander, S., Larsen, T., Lifland, E. & Dean, R. (2025)
AI 2027
MacAskill, W. & Moorhouse, F. (2025)
Preparing for the Intelligence Explosion. Forethought
Newman, S. (2025)
GPT-5: The Case of the Missing Agent. Second Thoughts
PauseAI (n.d.)
Why We Might Have Superintelligence Sooner Than Most Think
Pueyo, T. (2025)
The Most Important Time in History Is Now
Sarah (2025)
Why Do People Disagree About When Powerful AI Will Arrive?BlueDot
Sevilla, J., Besiroglu, T., Cottier, B., You, J., Roldán, E., Villalobos, P. & Erdil, E. (2024)
Can AI Scaling Continue Through 2030? Epoch AI
Toner, H. (2025)
“Long” Timelines to Advanced AI Have Gotten Crazy Short
Urban, T. (2017)
The Artificial Intelligence Revolution: Part 1. Wait But Why
Wood, D. (2025)
Scenarios for 2030.London Futurists
Safety Risks General
Aguirre, A. (2025)
Keep the Future Human
Anthropic (2025)
System Card: Claude Opus 4 & Claude Sonnet 4. May
Bostrom, N. (2002)
Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards. Journal of Evolution and Technology, 9
Bostrom, N. (2014)
Superintelligence: Paths, Dangers, Strategies. Oxford: Oxford University Press
Buchanan, B. & Imbrie, A. (2022)
The New Fire: War, Peace, and Democracy in the Age of AI. Cambridge, MA: MIT Press
Center for AI Safety (2024)
AI Safety, Ethics, and Society Textbook: Table of Contents
Center for AI Safety (2024)
An Overview of Catastrophic AI Risks. Safe.ai
Eisenpress, B. (2024)
Catastrophic AI Scenarios. Future of Life Institute
Yudkowsky, E. & Soares, N. (2025)
If Anyone Builds It, Everyone Dies. New York: Random House
FAR.AI (2024)
Richard Ngo – Reframing AGI Threat Models [Alignment Workshop]. YouTube
Karnofsky, H. (2022)
Racing Through a Minefield: The AI Deployment Problem. Cold Takes
Kraus, J. (2025)
The Case for AI Doom Rests on Three Unsettled Questions. Lawfare
Leonhard, G. (n.d.)
#HaltAGI: Why We Should Not Seek to Create Artificial General Intelligence. YouTube playlist
Leonhard, G. (2023)
AI and the Future of Humanity: Analysis, Insights and Foresight on Artificial Intelligence. FuturistGerd.com
London Futurists (2025)
London Futurists Podcast. Buzzsprout
MacAskill, W. & Moorhouse, F. (2025)
Preparing for the Intelligence Explosion. Forethought
McKee, D. (2023)
Uncontrollable: The Threat of Artificial Superintelligence and the Race to Save the World. Independently published
Ord, T. (2021)
The Precipice: Existential Risk and the Future of Humanity. London: Hachette Books
PauseAI (n.d.)
The Existential Risk of Superintelligent AI
Russell, S. (2019)
Human Compatible: AI and the Problem of Control. London: Allen Lane
Swoboda, T., Uuk, R., Lauwaert, L., Rebera, A. P., Oimann, A.-K., Chomanski, B. & Prunkl, C. (2025)
Examining Popular Arguments Against AI Existential Risk: A Philosophical Analysis
Tegmark, M. (2017)
Life 3.0: Being Human in the Age of Artificial Intelligence. London: Allen Lane
UK Government (2023)
Future Risks of Frontier AI: Which Capabilities and Risks Could Emerge at the Cutting Edge of AI in the Future? Technology & Science Insights and Foresight.
Uuk, R., Gutierrez, C. I., Guppy, D., Lauwaert, L., Kasirzadeh, A., Velasco, L., Slattery, P. & Prunkl, C. (2024)
A Taxonomy of Systemic Risks from General-Purpose AI. RAND Working Paper Series (forthcoming)
Wood, D. (2025)
Removing the pressure to rush. dw2
Bengio, Y., Clare, S., Prunkl, C., Mindermann, S., Privitera, D., Murray, M., Andriushchenko, M., Bucknall, B., et al. (2026)
International AI Safety Report 2026 (DSIT 2026/001, 2026)
Race
Bremmer, I. & Suleyman, M. (2023)
The AI Power Paradox. Foreign Affairs, 16 August
Cimpeanu, T., Santos, F. C., Pereira, L. M., Lenaerts, T. & Han, T. A. (2020)
Artificial Intelligence Development Races in Heterogeneous Settings. arXiv (Cornell University)
Gruetzemacher, R., Avin, S., Fox, J. & Saeri, A. K. (2025)
Strategic Insights from Simulation Gaming of AI Race Dynamics. Futures, 103563
Han, A., Pereira, L. M., Santos, F. C. & Lenaerts, T. (2019)
To Regulate or Not: A Social Dynamics Analysis of the Race for AI Supremacy. arXiv (Cornell University)
Katzke, C. & Futerman, G. (2025)
The Manhattan Trap: Why a Race to Artificial Superintelligence Is Self-Defeating. Convergence Analysis
Kilian, K. A. (2025)
Beyond Accidents and Misuse: Decoding the Structural Risk Dynamics of Artificial Intelligence. AI & Society
Naudé, W. & Dimitri, N. (2019)
The Race for an Artificial General Intelligence: Implications for Public Policy. AI & Society, 35, pp. 367–379
Neufville, R. de & Baum, S. D. (2021)
Collective Action on Artificial Intelligence: A Primer and Review. Technology in Society, 66, 101649
Tan, D. (2025)
The Suicide Region: Option Games and the Race to Artificial General Intelligence. arXiv (Cornell University)
Alignment Problem/Rogue AI
Bremmer, I. & Suleyman, M. (2023)
The AI Power Paradox. Foreign Affairs, 16 August
Cimpeanu, T., Santos, F. C., Pereira, L. M., Lenaerts, T. & Han, T. A. (2020)
Artificial Intelligence Development Races in Heterogeneous Settings. arXiv (Cornell University)
Gruetzemacher, R., Avin, S., Fox, J. & Saeri, A. K. (2025)
Strategic Insights from Simulation Gaming of AI Race Dynamics. Futures, 103563.
Han, A., Pereira, L. M., Santos, F. C. & Lenaerts, T. (2019)
To Regulate or Not: A Social Dynamics Analysis of the Race for AI Supremacy. arXiv (Cornell University)
Katzke, C. & Futerman, G. (2025)
The Manhattan Trap: Why a Race to Artificial Superintelligence Is Self-Defeating. Convergence Analysis
Kilian, K. A. (2025)
Beyond Accidents and Misuse: Decoding the Structural Risk Dynamics of Artificial Intelligence. AI & Society
Naudé, W. & Dimitri, N. (2019)
The Race for an Artificial General Intelligence: Implications for Public Policy. AI & Society, 35, pp. 367–379
Neufville, R. de & Baum, S. D. (2021)
Collective Action on Artificial Intelligence: A Primer and Review. Technology in Society, 66, 101649
Tan, D. (2025)
The Suicide Region: Option Games and the Race to Artificial General Intelligence. arXiv (Cornell University)
Misuse
Bremmer, I. & Suleyman, M. (2023)
The AI Power Paradox. Foreign Affairs, 16 August
Cimpeanu, T., Santos, F. C., Pereira, L. M., Lenaerts, T. & Han, T. A. (2020)
Artificial Intelligence Development Races in Heterogeneous Settings. arXiv (Cornell University)
Gruetzemacher, R., Avin, S., Fox, J. & Saeri, A. K. (2025)
Strategic Insights from Simulation Gaming of AI Race Dynamics. Futures, 103563
Han, A., Pereira, L. M., Santos, F. C. & Lenaerts, T. (2019)
To Regulate or Not: A Social Dynamics Analysis of the Race for AI Supremacy. arXiv (Cornell University)
Katzke, C. & Futerman, G. (2025)
The Manhattan Trap: Why a Race to Artificial Superintelligence Is Self-Defeating. Convergence Analysis
Kilian, K. A. (2025)
Beyond Accidents and Misuse: Decoding the Structural Risk Dynamics of Artificial Intelligence. AI & Society
Naudé, W. & Dimitri, N. (2019)
The Race for an Artificial General Intelligence: Implications for Public Policy. AI & Society, 35, pp. 367–379
Neufville, R. de & Baum, S. D. (2021)
Collective Action on Artificial Intelligence: A Primer and Review. Technology in Society, 66, 101649
Tan, D. (2025)
The Suicide Region: Option Games and the Race to Artificial General Intelligence. arXiv (Cornell University)
Gradual Disempowerment
Altman, S. (2021)
Moore’s Law for Everything
Carr, N. (2013)
All Can Be Lost: The Risk of Putting Our Knowledge in the Hands of Machines. The Atlantic, November
Carr, N. (2016)
The Glass Cage: Who Needs Humans Anyway? New York: Vintage
Cevasco, L., Corvalan, J. & Le Fevre Cervini, E. (2019)
Artificial Intelligence and Work – Building a New Employment Paradigm. Buenos Aires: Editorial Astra
Chase, C. (2018)
The Economic Singularity. Oxford: Three C’s Publishing
Cheng, D. (2025)
A Taxonomy of Jobs Deeply Resistant to TAI Automation. Convergence Analysis
Cheng, D., Turan, D., Bullock, J., Yelizarova, A., McKernon, E., Sharma, Y. & Foster, A. (2025)
Threshold 2030: AI Risk, Capability Forecasting, and Global Readiness. Convergence Analysis
Drago, L. & Laine, R. (2025)
The Intelligence Curse
Ford, M. (2016)
Rise of the Robots: Technology and the Threat of Mass Unemployment. London: Oneworld Publications
Grey, C. (2014)
Humans Need Not Apply. YouTube
Hammond, S. (2023)
AI and Leviathan: Part I
Innerarity, D. (2024)
Artificial Intelligence and Democracy. UNESCO Office Montevideo & Latin American Social Sciences Council
Korinek, A. (2024)
Economic Policy Challenges for the Age of AI. GovAI
Korinek, A. & Suh, D. (2024)
Scenarios for the Transition to AGI. GovAI
Kulveit, J., Douglas, R., Ammann, N., Turan, D., Krueger, D. & Duvenaud, D. (2025)
Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development. arXiv (Cornell University)
Peppiatt, C. (2024)
The Future of Work: Inequality, Artificial Intelligence, and What Can Be Done About It: A Literature Review. arXiv preprint
Perspectives, A. P. & Krier, S. (2025)
AGI, Government, and the Free Society. [online]. AI Policy Perspectives
Schaake, M. (2024)
The Tech Coup: How to Save Democracy from Silicon Valley. Princeton, NJ: Princeton University Press
Susskind, D. (2020)
A World Without Work. London: Allen Lane
Susskind, R. & Susskind, D. (2015)
The Future of the Professions: How Technology Will Transform the Work of Human Experts. Oxford: Oxford University Press
Timcke, S. (2025)
AI, Inequality, and Democratic Backsliding. Tech Policy Press
Military
Abraham, Y. (2024)
‘Lavender’: The AI machine directing Israel’s bombing spree in Gaza. +972 Magazine
Arkin, R. C., (2018)
‘Lethal Autonomous Systems and the Plight of the Non-Combatant’. In: Perspectives on Lethal Autonomous Weapons Systems (LAW), Springer, pp. 215–243
Breene, K. (2016)
What if robots go to war? World Economic Forum
Future of Life Institute, (2015)
Autonomous Weapons: An Open Letter from AI & Robotics Researchers
Future of Life Institute (2023)
Lethal Autonomous Weapons Pledge - Future of Life Institute. Future of Life Institute
Future of Life Institute. (2025)
Educating about Autonomous Weapons - Future of Life Institute
O’Neill, C., (2016)
Weapons of Math Destruction. New York: Penguin Random House
Stop Killer Robots. (n.d.)
Stop Killer Robots
Tim Ventura (2023)
AI & Autonomous Weapons | David Wood. YouTube
Trager, R., (2022)
Deliberating Autonomous Weapons. GovAI
United States, Executive Office of the President [Donald Trump] (2019)
Executive Order 13859: Maintaining American Leadership in Artificial Intelligence, Federal Register 84 pp.3967-3972
U.S. Department of Defense, (2023)
DoD Directive 3000.09: Autonomy in Weapon Systems. Office of the Under Secretary of Defense for Policy, 25 January 2023. Approved by Deputy Secretary Kathleen H. Hicks
Technical Solutions
Bai, Y., Saurav Kadavath, Kundu, S., Askell, A., Kernion, J., Jones, A., Chen, A., Goldie, A., Azalia Mirhoseini, McKinnon, C., Chen, C., Olsson, C., Olah, C., Hernandez, D., Drain, D., Ganguli, D., Li, D., Tran-Johnson, E., Perez, E. and Kerr, J. (2022)
Constitutional AI: Harmlessness from AI Feedback. arXiv (Cornell University)
Barnett, P., Scher, A. and Abecassis, D. (2025)
Technical Requirements for Halting Dangerous AI Activities. arXiv (Cornell University)
Bengio, Y., Cohen, M., Fornasiere, D., Ghosn, J., Greiner, P., MacDermott, M., Mindermann, S., Oberman, A., Richardson, J., Richardson, O., Rondeau, M.-A., St-Charles, P.-L. and Williams-King, D. (2025)
Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path? arXiv (Cornell University)
Buterin, V. (2025)
d/acc: one year later. Eth.limo
Center for AI Safety (2024)
4.1: Safety Engineering | AI Safety, Ethics, and Society Textbook. Aisafetybook.com
Chen, Y., Tucker, M., Panickssery, N., Wang, T., Mosconi, F., Gopal, A., Denison, C., Petrini, L., Leike, J., Perez, E. & Sharma, M., (2025)
Enhancing Model Safety through Pretraining Data Filtering. Anthropic Alignment Science
Goertzel, B., (2012)
‘Should Humanity Build a Global AI Nanny to Delay the Singularity Until It’s Better Understood?’ Journal of Consciousness Studies, 19(1–2), pp. 96–111
metr.org. (n.d.)
Model Evaluation & Threat Research. METR
O’Brien, K., Casper, S., Anthony, Q., Korbak, T., Kirk, R., Davies, X., Mishra, I., Irving, G., Gal, Y. & Biderman, S., (2025)
‘Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs’. arXiv preprint arXiv:2508.06601
Reuel, A. & Bucknall, B., (2024)
Open Problems in Technical AI Governance. GovAI
Russell, S., (2019)
Human Compatible: AI and the Problem of Control. London: Allen Lane
Scher, A. & Thiergart, L., (2024)
Mechanisms to Verify International Agreements About AI Development. November. Machine Intelligence Research Institute
Soares, N., Fallenstein, B., Yudkowsky, E. & Armstrong, S., (2015)
‘Corrigibility’. In: AAAI Workshops: Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, Texas, 25–26 January 2015. AAAI Publications
Vaintrob, L. and Cotton-Barratt, O. (2025)
AI Tools for Existential Security. Forethought
Corporate Governance
Anthropic (2023)
Anthropic’s Transparency Hub. [online] Anthropic.com
Eitel-Porter, R., Dongha, P. and Vogel, M. (2025)
Governing the Machine. Bloomsbury Publishing
Future of Life Institute, (2024)
FLI AI Safety Index 2024. Future of Life Institute
Homewood, A., Williams, S., Dreksler, N., Lidiard, J., Garfinkel, B. & Schuett, J., (2025)
Third-Party Compliance Reviews for Frontier AI Safety Frameworks. GovAI
Longpre, S., Anderljung, M. et al., (2025)
In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AI. GovAI
McDonnell, B. and Rozenshtein, A. (2024)
The Promise and Perils of Nontraditional Corporate AI Governance. Lawfare
METR (2023a)
Key Components of an RSP. Metr.org
METR (2023b)
Responsible Scaling Policies (RSPs). Metr.org
Schuett, J., Dreksler, N., Anderljung, M., McCaffary, D., Heim, L., Bluemke, E. & Garfinkel, B., (2023)
Towards Best Practices in AGI Safety and Governance. GovAI
Stein-Perlman, Z. (2025)
AI Lab Watch. Ailabwatch.org
Titus, J. (2024)
Can Preparedness Frameworks Pull Their Weight? Federation of American Scientists
Williams, S., Dreksler, N., Homewood, A., Anderljung, M. & Freun, J., (2025)
Assessing Risk Relative to Competitors: An Analysis of Current AI Company Policies. Gov.AI
Global Governance
AI Treaty (n.d.)
Urging an International AI Treaty: An Open Letter
Alaga, J. & Schuett, J., (2023)
Coordinated Pausing: An Evaluation-Based Coordination Scheme for Frontier AI Developers. GovAI
Alexander, C. (2024)
An Interview with OpenAI CEO Sam Altman - HKS Student Policy Review. HKS Student Policy Review
Amodei, D., (2023)
Written Testimony for “Oversight of A.I.: Principles for Regulation” before the U.S. Senate Judiciary Committee, Subcommittee on Privacy, Technology, and the Law, 25 July 2023
Anderljung, M., Barnhart, J., Leung, J., Korinek, A., O’Keefe, C., Whittlestone, J., Avin, S., Brundage, M., Bullock, J., Cass-Beggs, D., Chang, B., Collins, T., Fist, T., Hadfield, G., Hayes, A., Ho, L., Hooker, S., Horvitz, E., Kolt, N. and Schuett, J. (2023)
Frontier AI Regulation: Managing Emerging Risks to Public Safety. arXiv.org
Barnett, P. and Scher, A. (2025)
AI Governance to Avoid Extinction: The Strategic Landscape and Actionable Research Questions. arXiv (Cornell University)
Barnett, P. and Thiergart, L. (2024)
What AI evaluations for preventing catastrophic risks can and cannot do. arXiv (Cornell University)
Barten, O. (2023)
AI Policy Proposals. Existential Risk Observatory, November
Bradford, K. (2024)
Belaboring the Algorithm: Artificial Intelligence and Labor Unions. Yale Journal on Regulation
Brundage, M. (2024)
My recent lecture at Berkeley and a vision for a ‘CERN for AI’
Buchanan, B., (2020)
The AI Triad and What It Means for National Security Strategy. Center for Security and Emerging Technology (CSET)
Bullock, J.B., Hudson, V.M., Korinek, A., Young, M.M. and Dean, M. (2023)
The Oxford Handbook of AI Governance. Oxford University Press
Carnegie Council for Ethics in International Affairs (2018)
Wendell Wallach: AI & Governance
Carnegie Council for Ethics in International Affairs (2024)
The Intersection of AI, Ethics, & Humanity, with Wendell Wallach. Carnegiecouncil.org
Carter, S. R., Wheeler, N. E., Chwalek, S., Isaac, C. R. & Yassif, J., (2023)
The Convergence of Artificial Intelligence and the Life Sciences: Safeguarding Technology, Rethinking Governance, and Preventing Catastrophe. NTI | Bio
Cath, C. (2018)
Governing artificial intelligence: Ethical, legal and technical opportunities and challenges. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 376(2133)
Center for AI Safety (2022)
8.1: Governance | AI Safety, Ethics, and Society Textbook. Aisafetybook.com
Cheng, D. & McKernon, E., (2024)
2024 State of the AI Regulatory Landscape. Convergence Analysis
Coeckelbergh, M. (2022)
The Political Philosophy of AI. John Wiley & Sons
Council of Europe, (2024)
Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law
Council of Europe, (2024)
Methodology for the Risk and Impact Assessment of Artificial Intelligence Systems from the Point of View of Human Rights, Democracy and the Rule of Law (HUDERIA)
European Union Agency for Fundamental Rights, (2020)
Getting the Future Right: Artificial Intelligence and Fundamental Rights. Publications Office of the European Union
Future of Life Institute (2022)
AI Alignment Podcast: Machine Ethics and AI Governance with Wendell Wallach - Future of Life Institute. Future of Life Institute
Future of Life Institute (2024)
High-level summary of the AI Act | EU Artificial Intelligence Act. Artificialintelligenceact.eu
Gandhi, D., Joshi, H., Hartman, L. and Hassani, S. (2025)
Approaches to Responsible Governance of GenAI in Organizations. arXiv (Cornell University)
Glenn, J.C. (2025)
Global Governance of the Transition to Artificial General Intelligence. De Gruyter
Glenn, J.C. (2025)
Global Governance of the Transition to Artificial General Intelligence: Issues and Requirements. Berlin: De Gruyter
Hale, A. & Whitfield, R., (2024)
AI Governance and Baruch: An Irresistible Force and an Immovable Object. One World Trust
Heim, L. (2023)
Video and Transcript of Presentation on Introduction to Compute Governance. Blog - Lennart Heim
Heim, L. & Koessler, L., (2024)
Training Compute Thresholds: Features and Functions in AI Regulation. GovAI
Heim, L., Fist, T., Egan, J., Huang, S., Zekany, S., Trager, R., Osborne, M. A., & Zilberman, N., (2024)
Governing Through the Cloud. GovAI
Hendrycks , D., Schmidt, E. and Wang, A. (2025)
Superintelligence Strategy. Nationalsecurity.ai
United Nations High-Level Advisory Body on AI (2024)
Interim Report on AI Governance. United Nations. Available via UN, WIRED and The Guardian summaries
Institute for Global Change (2025)
How Leaders in the Global South Can Devise AI Regulation that enables Innovation. Tony Blair Institute
International Organization for Standardization (ISO), (2025)
ISO Policy Brief: Harnessing International Standards for Responsible AI Development and Governance. ISO
International Organisations and the Global Governance of AI (2024)
Chapter in Global Governance of AI: Challenges and Opportunities. NCBI Bookshelf
Ishkhanyan, A. (2025)
‘The sovereignty–internationalism paradox in AI governance: Digital federalism and global algorithmic control’, AI and Ethics, pp. 1–14
Janjeva, A., Mulani, N., Powell, R., Whittlestone, J. & Avin, S., (2023)
Strengthening Resilience to AI Risk: A Guide for UK Policymakers. Centre for Emerging Technology and Security (CETaS) and the Centre for Long-Term Resilience
Karnofsky, H., (2024)
If-Then Commitments for AI Risk Reduction. Carnegie Endowment for International Peace
KGRAdb (2025)
Didier Coeurnelle on AI Governance. YouTube
Klein, E. & Patrick, S., (2024)
Envisioning a Global Regime Complex to Govern Artificial Intelligence. Carnegie Endowment for International Peace
Lu, S. (2024)
Regulating Algorithmic Harms. Florida Law Review, forthcoming 2025. University of Michigan Law & Economics Research Paper No. 24-031; University of Michigan Public Law Research Paper No. 24-031
Maarten Herbosch (2025)
How Existing Liability Frameworks Can Handle Agentic AI Harms. Lawfare
Maas, M. (2023)
Advanced AI Governance: A Literature Review of Problems, Options, and Proposals. Institute for Law & AI, AI Foundations Report 4
Maas, M. (2023)
Concepts in Advanced AI Governance: A Literature Review of Key Terms and Definitions. Institute for Law & AI, AI Foundations Report 3
Maas, M. M. (2025)
Architectures of Global AI Governance: From Technological Change to Human Choice. Oxford: Oxford University Press
MacAskill , W. and Moorhouse, F. (2025)
Preparing for the Intelligence Explosion. Forethought
Marcus, G. F., (2024)
Taming Silicon Valley: How We Can Ensure That AI Works for Us. Cambridge, MA: MIT Press
Mila – Quebec Artificial Intelligence Institute and UNESCO (2023)
Missing links in AI governance. UNESCO Publishing
Miotti, A. and Wasil, A. (2023)
Taking control: Policies to address extinction risks from advanced AI. arXiv.org
Modi, N. (2025)
Remarks to BRICS summit: Advocated for cooperative AI governance among Global South peers. Economic Times
Nobel, P., Rozenshtein, A.Z. and Sharma, C. (2026)
Unbundling AI Openness. Wisconsin Law Review (forthcoming)
OECD (2019; updated 2024)
OECD AI Principles: Intergovernmental Standard on Artificial Intelligence
OECD, (2020)
‘The OECD Artificial Intelligence Policy Observatory’
OECD (2024)
Futures of Global AI Governance: Co-Creating an Approach for Transforming Economies and Societies. Paris: OECD
Okolo, C.T. (2023)
AI in the Global South: Opportunities and challenges towards more inclusive governance. Brookings Institution
One World Trust, (2021)
AI Global Governance – What Are We Aiming For? Conclusions and Recommendations
Ord, T., (2025)
Inference Scaling and AI Governance. Gov.AI
Park, S. (2023)
Bridging the Global Divide in AI Regulation: A Proposal for a Contextual, Coherent, and Commensurable Framework
PauseAI (n.d.)
Building the Pause Button. PauseAI
PauseAI (n.d.)
The Feasibility of a Pause. PauseAI
Png, M.-T. (2022)
‘At the Tensions of South and North: Critical Roles of Global South Stakeholders in AI Governance’, in Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’22), pp. 1–12
Ponzio, R., Yusuf, N. and Durch, W. (eds.) (2025)
Global Governance Innovation Report 2025. Washington, D.C.: The Stimson Center
Schaake, M., (2024)
The Tech Coup: How to Save Democracy from Silicon Valley. Princeton, NJ: Princeton University Press
SingularityNET (2023)
David Wood - Vital Decentralization | The adaptive, resilient pathway to sustainable abundance. YouTube
Smith, B. W., (2020)
‘New Technologies and Old Treaties’. AJIL Unbound, 114, pp. 152–157
Smuha, N. A. (ed.), (2025)
The Cambridge Handbook of the Law, Ethics and Policy of Artificial Intelligence. Cambridge University Press
Transnational Working Group on AI and Disruptive Technologies of the World Federalist Movement and Institute for Global Policy, (2020)
Effective, Timely and Global: The Urgent Need for Good Global Governance of AI. World Federalist Movement / Institute for Global Policy
Villalobos, J. J. & Maas, M. M., (2025)
Beyond a Piecemeal Approach: Prospects for a Framework Convention on AI. Forthcoming in: Hacker, P., Engel, A., Hammer, S. & Mittelstadt, B. (eds) The Oxford Handbook on the Foundations and Regulation of Generative AI. Oxford University Press
Vöneky, S., (2020)
‘How Should We Regulate AI? Current Rules and Principles as Basis for “Responsible Artificial Intelligence”’, in: Bruns, B. et al. (eds.) Legal Theory and Interpretation in a Dynamic Society, vol. 19, 1st ed. 2021, pp. 279–310
Wasil, A. (2024)
Do We Want an ‘IAEA for AI’? Lawfare
WFM/IGP (2025)
Transnational Working Group on the Global Governance of AI and other disruptive technologies (TWG on AI)
White & Case (n.d.)
AI Watch: Global regulatory tracker | White & Case LLP. [online] www.whitecase.com
Wills, P., (2025)
Regulatory Supervision of Frontier AI Developers. GovAI
Winter, C. and Bullock, C. (2024)
The Governance Misspecification Problem. Institute for Law & AI, Working Paper No. 3-2024
Mulitilateral fora
Artificial Intelligence & Equality Initiative, (2023)
‘A Framework for the International Governance of AI’. Carnegie Council for Ethics in International Affairs
Bak-Coleman, J., Bergstrom, C. T., Jacquet, J., Mickens, J., Tufekci, Z. & Roberts, T., (2023)
‘Create an IPCC-like Body to Harness Benefits and Combat Harms of Digital Tech’. Nature, 617(7961), pp. 462–464
Bullock, C. et al. (2024)
Existing Authorities for Oversight of Frontier AI Models. Institute for Law & AI, Working Paper No. 1-2024
Cihon, P., Maas, M. M. & Kemp, L., (2020)
‘Fragmentation and the Future: Investigating Architectures for International AI Governance’. Global Policy
Erdélyi, O. J. & Goldsmith, J., (2022)
‘Regulating Artificial Intelligence: Proposal for a Global Solution’. Government Information Quarterly, 39(4), p. 101748
Garcia, E., (2020)
‘Multilateralism and Artificial Intelligence: What Role for the United Nations?’
Ho, L., Barnhart, J. & Trager, R., et al., (2023)
International Institutions for Advanced AI’. arXiv.
Jelinek, T., Wallach, W. & Kerimi, D., (2020)
‘Policy Brief: The Creation of a G20 Coordinating Committee for the Governance of Artificial Intelligence’. AI and Ethics
Kemp, L., Cihon, P., Maas, M. M., Belfield, H., Cremer, Z., Leung, J. & Ó hÉigeartaigh, S., (2019)
‘UN High-Level Panel on Digital Cooperation: A Proposal for International AI Governance’. Centre for the Study of Existential Risk & Leverhulme Centre for the Future of Intelligence
Maas, M. & Villalobos, J.J., (2023)
International AI Institutions: A Literature Review of Models, Examples, and Proposals. AI Foundations Report 1. Institute for Law & AI
Miailhe, N. (2018)
‘Why we need an intergovernmental panel for artificial intelligence’
Mulgan, G. & Siddarth, D., (2023)
‘The World Needs a Global AI Observatory’. Noema, 29 June
Mulgan, G., Malone, T. & Siddarth, D., et al., (2023)
‘The Case for a Global AI Observatory (GAIO)’. Carnegie Council for Ethics in International Affairs
Roberts, H., (2023)
‘Opinion—A New International AI Body Is No Panacea’. E-International Relations (blog), 11 August
Sepasspour, R., (2023)
‘A Reality Check and a Way Forward for the Global Governance of Artificial Intelligence’. Bulletin of the Atomic Scientists, 10 September. p. 311
Siegmann, C. & Anderljung, M., (2022)
The Brussels Effect and Artificial Intelligence: How EU Regulation Will Impact the Global AI Market. GovAI
Stix, C., (2022)
‘Foundations for the Future: Institution Building for the Purpose of Artificial Intelligence Governance’. AI Ethics, 2, pp. 463–476
The Economist, (2023)
‘The World Needs an International Agency for Artificial Intelligence, Say Two AI Experts’. The Economist, 18 April 2023
Bilateral
Araya, D. & He, A., (2024)
United States–China Multilateralism in the Age of Military AI. CIGI Paper No. 309, December 2024. Centre for International Governance Innovation
Guest, O. (2023)
Prospects for AI safety agreements between countries. [online] Rethink Priorities
Mishra, N.C. (2024)
From Competition to Cooperation: Can US-China Engagement Overcome Geopolitical Barriers in AI Governance? [online] Tech Policy Press
Scher, A. and Barnett, P. (2025)
An International Agreement to Prevent the Premature Creation of Artificial Superintelligence. arXiv (Cornell University)
Siddik, M., (2025)
Toward ASI Stability: A Treaty Framework for US–China Cooperation on Artificial Superintelligence. Convergence Analysis
Weitz, R. (2024)
China and the United States Begin Official AI Dialogue. [online] China-US Focus.
US
California Legislature, (2025)
Assembly Bill 621 - Deepfake Pornography (Chapter 673, Statutes of 2025; approved and filed 13 October 2025). State of California. Available
California Legislature, (2025)
Assembly Bill 853 - California AI Transparency Act (Chapter 674, Statutes of 2025; approved and filed 13 October 2025). State of California
California Legislature, (2025)
California Senate Bill 53 - Artificial Intelligence Models: Large Developers (Chapter 138, Statutes of 2025; chaptered 29 September 2025). State of California
Cullen O'Keefe (2024)
Chips for Peace: How the U.S. and Its Allies Can Lead on Safe and Beneficial AI. Lawfare
Curl, J. (2025)
California Enacted AI Bills. Now Officials Must Define Them. Lawfare
Cybersecurity and Infrastructure Security Agency (n.d.)
Recent U.S. Efforts on AI Policy | CISA
Fischer, S-C., Leung, J., Anderljung, M., O’Keefe, C., Torges, S., Khan, S. M. & Garfinkel, B., (2021)
AI Policy Levers: A Review of the U.S. Government’s Tools to Shape AI Research, Development, and Deployment. GovAI
Fist, T., Burga, T. and Hwang, T. (2025)
Preparing for Launch | IFP. Institute for Progress
Frazier, K., Rozenshtein, A. and DiResta, R. (2025)
Lawfare Daily: Scaling Laws: Renée DiResta and Alan Rozenshtein on the ‘Woke AI’ Executive Order. Lawfare
Kraus, J. (2025)
OMB Releases Guidance on Trump’s ‘Woke AI’ Executive Order. Lawfare
National Institute of Standards and Technology (2023)
AI Risk Management Framework. NIST
The White House, (2025)
America’s AI Action Plan
Tim Ventura (2025)
America’s AI Action Plan | David Wood
Trump, D. J., (2025)
Ensuring a National Policy Framework for Artificial Intelligence (Executive Order, 11 December 2025). The White House
Van Beek, J. (2025)
Recommendations for the U.S. AI Action Plan - Future of Life Institute. Future of Life Institute
White & Case (2024)
AI Watch: Global regulatory tracker - United States | White & Case LLP
China
China Electronics Standardization Institute (CESI), (2021)
Artificial Intelligence Standardization White Paper (2021 Edition). Translated by CSET, 29 September 2021
Department of International Cooperation, Ministry of Science and Technology (MOST), P.R. China, (2017)
Next Generation Artificial Intelligence Development Plan. China Science & Technology Newsletter, No. 17 (15 September 2017). Organizer: China Association for International Science and Technology Cooperation
Ministry of Foreign Affairs of the People's Republic of China (2025)
Global AI Governance Action Plan. Fmprc.gov.cn
Sheehan, M., (2023)
China’s AI Regulations and How They Get Made. Carnegie Endowment for International Peace
THE DIGITAL TRADE & DATA GOVERNANCE HUB (2017)
China AI Strategy
Webster, G., Creemers , R., Kania , E. and Triol, P. (2021)
China’s ‘New Generation Artificial Intelligence Development Plan’ (2017) - DigiChina. DigiChina
White & Case (2024)
AI Watch: Global regulatory tracker - China | White & Case LLP
Xiao, R. (2025)
China’s Approach to AI Development and Governance | The National Bureau of Asian Research (NBR). Nbr.org


