AI Safety Orgs

The following is a list of AI safety organizations that do Technical Safety, Policy/Governance, or offer a Research Program/Fellowship. Note that many of these organizations do a mix, including public communication.

Last updated 2024-05-21

AIGS Canada

  • Focus: Policy/Governance
  • Location: Ottawa (Canada)
  • Description:

Aligned AI

  • Focus: Technical Safety
  • Location: Oxford (UK)
  • Description:

Alignment Research Center (ARC)

  • Focus: Technical Safety
  • Location: Berkeley (US)
  • Description:

ALTER

  • Focus: Technical Safety, Policy/Governance
  • Location: Israel
  • Description:

Anthropic

  • Focus: Technical Safety
  • Location: SF, New York, Seattle (US), London (UK), Dublin (IE),
  • Description:

Astera

  • Focus: Technical Safety
  • Location: Berkeley (US)
  • Description:

Apart Research

  • Focus: Technical Safety
  • Location: Remote
  • Description: A research accelerator for ambitious individuals across the world to speed up their impact in technical AI safety with senior advising, project management, and a highly collaborative environment. They host regular hackathons/sprints.

Apollo Research

  • Focus: Technical Safety
  • Location: London (UK)
  • Description:

Center for AI Risk Management & Alignment (CARMA)

  • Focus: Technical Safety, Policy/Governance
  • Location: Remote, Berkeley (US)
  • Description:

Center for AI Safety (CAIS)

  • Focus: Technical Safety, Policy/Governance
  • Location: SF (US)
  • Description:

Center for Human-Compatible AI (CHAI)

  • Focus: Technical Safety, Research Program/Fellowship
  • Location: Berkeley (US)
  • Description:

Center on Long-Term Risk

  • Focus: Technical Safety, Policy/Governance
  • Location: London (UK)
  • Description:

Centre for the Governance of AI

  • Focus: Policy/Governance
  • Location: Oxford (UK)
  • Description:

Conjecture

  • Focus: Technical Safety, Policy/Governance, Research Program/Fellowship
  • Location: London (UK)
  • Description:

DeepMind

  • Focus: Technical Safety, Policy/Governance, Research Program/Fellowship
  • Location: London (UK), Mountain View, New York (US), Montreal, Toronto (Canada), Paris (France), and Zürich (Switzerland)
  • Description:

EleutherAI

  • Focus: Technical Safety
  • Location: Remote, Seattle (US)
  • Description:

Epoch AI

  • Focus: Technical Safety, Policy/Governance
  • Location: Remote (US)
  • Description:

FAR AI

  • Focus: Technical Safety
  • Location: Berkeley (US)
  • Description:

Forecasting Research Institute

  • Focus: Policy/Governance
  • Location: Remote, Oakland (US)
  • Description:

Future of Humanity Institute

  • Focus: Technical Safety, Policy/Governance, Research Program/Fellowship
  • Location: Oxford (UK)
  • Description:

Future of Life Institute

  • Focus: Policy/Governance
  • Location: Cambridge (US)
  • Description:

Institute for Ethics in AI

  • Focus: Policy/Governance
  • Location: Oxford (UK)
  • Description:

Institute for AI Policy & Strategy

  • Focus: Policy/Governance, Research Program/Fellowship
  • Location: Remote, SF (US)
  • Description:

Leap Labs

  • Focus: Technical Safety
  • Location: London (UK)
  • Description:

Machine Intelligence Research Institute

  • Focus: Technical Safety
  • Location: Berkeley (US)
  • Description:

Montreal AI Ethics Institute

  • Focus: Policy/Governance
  • Location: Montreal (Canada)
  • Description:

NYU Alignment Research Group

  • Focus: Technical Safety
  • Location: New York (US)
  • Description:

OpenAI

  • Focus: Technical Safety, Policy/Governance
  • Location: SF (US), London (UK)
  • Description:

Ought

  • Focus: Technical Safety
  • Location: SF (US)
  • Description:

Redwood Research

  • Focus: Technical Safety
  • Location: Berkeley (US)
  • Description:

Scale

  • Focus: Technical Safety
  • Location: SF (US)
  • Description:

Timaeus

  • Focus: Technical Safety
  • Location: Amsterdam (Netherlands)
  • Description: