Note: As of late 2017/2018, Issa is working on AI Watch, which is partly motivated by cause prioritization.

Summary

Importance

<importance rating>

Tractability

<tractability rating>

Neglectedness

<neglectedness rating>

AI Impacts is an informational site that “aims to improve our understanding of the likely impacts of human-level artificial intelligence”.

The main EA organization working in this field seems to be MIRI, which does relevant math research and sponsors forecasting projects like AI Impacts. FHI might also have more information.

Superintelligence: Paths, Dangers, Strategies by Nick Bostrom lays out a foundation for navigating scenarios where machine brains surpass human brains in general intelligence.

Artificial General Intelligence

How large do you think the first Strong AI be(lines of code, servers etc)? • /r/artificial

Artificial Intelligence • /r/artificial

Comparative Table of Cognitive Architectures (started on October 27, 2009; last update: June 18, 2012)

Importance

FIXME

Tractability

FIXME

Neglectedness

FIXME

Organizations

• Center for Human-Compatible Artificial Intelligence
• Center for Security and Emerging Technology
  
• Future of Humanity Institute
• Future of Life Institute
• Human-Centered Artificial Intelligence Standford University
• Machine Intelligence Research Institute
• OpenAI
  
• Median Group
• Modeling Cooperation
• Meta Ethical AI
  
• Center on Long-Term Risk
• Self-Aware Systems
• Anthropic
• AGI4ALL
• Alignment Research Center
• AGI Safety Fundamentals
• Conjecture
• The Alignment Fund
• Stanford Center for AI Safety
• FAR AI
• AIGS Canada
• Apart Research

Field overview

• An overview of 11 proposals for building safe advanced AI

Events

On AI Safety:

• AI Safety
• SafeAI
• Artificial Intelligence Safety Engineering

Related events:

• International Joint Conference on Artificial Intelligence

Grants

• Berkeley Existential Risk Initiative: Individual Grants Program

See also

• AI strategy
• Views on AI safety
• Simulation hypothesis

External links

• AI Safety Training: A database of training programs, conferences, and other events for AI existential safety.
• General resources on AI safety
• Artificial General Intelligence: Coordination & Great Powers

• AI alignment landscape by Paul Christiano

• Some relevant timelines:
  • Timeline of AI safety
  • Timeline of Machine Intelligence Research Institute
  • Timeline of Center for Applied Rationality
  • Timeline of Berkeley Existential Risk Initiative
  • Timeline of Future of Humanity Institute
  • Timeline of Foundational Research Institute
  • Timeline of OpenAI
• CarlShulman comments on How does MIRI Know it Has a Medium Probability of Success?
• Don’t Worry, Smart Machines Will Take Us With Them
• Jeff Kaufman’s posts on AI safety:
  • “Looking into AI Risk”
  • “Superintelligence Risk Project”
  • “Conversation with Dario Amodei”
  • “Conversation with Michael Littman”
  • “Superintelligence Risk Project Update”
• artificial intelligence index - 2018 annual report

• AI Safety Ideas