Artificial Intelligence Safety and Security

The history of robotics and artificial intelligence in many ways is also the history of humanity’s attempts to control such technologies. From the Golem of Prague to the military robots of modernity, the debate continues as to what degree of independence such entities should have and how to make sure that they do not turn on us, its inventors. Numerous recent advancements in all aspects of research, development and deployment of intelligent systems are well publicized but safety and security issues related to AI are rarely addressed. This book is proposed to mitigate this fundamental problem. It is comprised of chapters from leading AI Safety researchers addressing different aspects of the AI control problem as it relates to the development of safe and secure artificial intelligence. The book is the first edited volume dedicated to addressing challenges of constructing safe and secure advanced machine intelligence. The chapters vary in length and technical content from broad interest opinion essays to highly formalized algorithmic approaches to specific problems. All chapters are self-contained and could be read in any order or skipped without a loss of comprehension.

Preface: Introduction to AI Safety and Security Acknowledgments Editor Contributors Part I Concerns of Luminaries Chapter 1 Why the Future Doesn’t Need Us Bill Joy Chapter 2 The Deeply Intertwined Promise and Peril of GNR Ray Kurzweil Chapter 3 The Basic AI Drives Stephen M. Omohundro Chapter 4 The Ethics of Artificial Intelligence Nick Bostrom and Eliezer Yudkowsky Chapter 5 Friendly Artificial Intelligence: The Physics Challenge Max Tegmark Chapter 6 MDL Intelligence Distillation: Exploring Strategies for Safe Access to Superintelligent Problem-Solving Capabilities K. Eric Drexler Chapter 7 The Value Learning Problem Nate Soares Chapter 8 Adversarial Examples in the Physical World Alexey Kurakin, Ian J. Goodfellow, and Samy Bengio Chapter 9 How Might AI Come About?: Different Approaches and Their Implications for Life in the Universe David Brin Chapter 10 The MADCOM Future: How Artificial Intelligence Will Enhance Computational Propaganda, Reprogram Human Culture, and Threaten Democracy … and What can be Done About It Matt Chessen Chapter 11 Strategic Implications of Openness in AI Development Nick Bostrom Part II Responses of Scholars Chapter 12 Using Human History, Psychology, and Biology to Make AI Safe for Humans Gus Bekdash Chapter 13 AI Safety: A First-Person Perspective Edward Frenkel Chapter 14 Strategies for an Unfriendly Oracle AI with Reset Button Olle Häggström Chapter 15 Goal Changes in Intelligent Agents Seth Herd, Stephen J. Read, Randall O’Reilly, and David J. Jilk Chapter 16 Limits to Verification and Validation of Agentic Behavior David J. Jilk Chapter 17 Adversarial Machine Learning Phillip Kuznetsov, Riley Edmunds, Ted Xiao, Humza Iqbal, Raul Puri, Noah Golmant, and Shannon Shih Chapter 18 Value Alignment via Tractable Preference Distance Andrea Loreggia, Nicholas Mattei, Francesca Rossi, and K. Brent Venable Chapter 19 A Rationally Addicted Artificial Superintelligence James D. Miller Chapter 20 On the Security of Robotic Applications Using ROS David Portugal, Miguel A. Santos, Samuel Pereira, and Micael S. Couceiro Chapter 21 Social Choice and the Value Alignment Problem Mahendra Prasad Chapter 22 Disjunctive Scenarios of Catastrophic AI Risk Kaj Sotala Chapter 23 Offensive Realism and the Insecure Structure of the International System: Artificial Intelligence and Global Hegemony Maurizio Tinnirello Chapter 24 Superintelligence and the Future of Governance: On Prioritizing the Control Problem at the End of History Phil Torres Chapter 25 Military AI as a Convergent Goal of Self-Improving AI Alexey Turchin and David Denkenberger Chapter 26 A Value-Sensitive Design Approach to Intelligent Agents Steven Umbrello and Angelo F. De Bellis Chapter 27 Consequentialism, Deontology, and Artificial Intelligence Safety Mark Walker Chapter 28 Smart Machines ARE a Threat to Humanity Kevin Warwick Index

Dr. Roman V. Yampolskiy is a Tenured Associate Professor in the department of Computer Engineering and Computer Science at the Speed School of Engineering, University of Louisville. He is the founding and current director of the Cyber Security Lab and an author of many books including Artificial Superintelligence: a Futuristic Approach. During his tenure at UofL, Dr. Yampolskiy has been recognized as: Distinguished Teaching Professor, Professor of the Year, Faculty Favorite, Top 4 Faculty, Leader in Engineering Education, Top 10 of Online College Professor of the Year, and Outstanding Early Career in Education award winner among many other honors and distinctions. Yampolskiy is a Senior member of IEEE and AGI; Member of Kentucky Academy of Science, former Research Advisor for MIRI and Associate of GCRI. Dr. Yampolskiy’s main areas of interest are AI Safety, Artificial Intelligence, Behavioral Biometrics, Cybersecurity, Genetic Algorithms, and Pattern Recognition. Dr. Yampolskiy is an author of over 150 publications including multiple journal articles and books. His research has been cited by 1000+ scientists and profiled in popular magazines both American and foreign (New Scientist, Poker Magazine, Science World Magazine), dozens of websites (BBC, MSNBC, Yahoo! News), on radio (German National Radio, Swedish National Radio) and TV. Dr. Yampolskiy’s research has been featured 1000+ times in numerous media reports in 30 languages.