About the Book
The history of robotics and artificial intelligence in many ways is also the history of humanity’s attempts to control such technologies. From the Golem of Prague to the military robots of modernity, the debate continues as to what degree of independence such entities should have and how to make sure that they do not turn on us, its inventors. Numerous recent advancements in all aspects of research, development and deployment of intelligent systems are well publicized but safety and security issues related to AI are rarely addressed. This book is proposed to mitigate this fundamental problem. It is comprised of chapters from leading AI Safety researchers addressing different aspects of the AI control problem as it relates to the development of safe and secure artificial intelligence. The book is the first edited volume dedicated to addressing challenges of constructing safe and secure advanced machine intelligence.
The chapters vary in length and technical content from broad interest opinion essays to highly formalized algorithmic approaches to specific problems. All chapters are self-contained and could be read in any order or skipped without a loss of comprehension.
Table of Contents:
Preface: Introduction to AI Safety and Security
Acknowledgments
Editor
Contributors
Part I Concerns of Luminaries
Chapter 1 Why the Future Doesn’t Need Us
Bill Joy
Chapter 2 The Deeply Intertwined Promise and Peril of GNR
Ray Kurzweil
Chapter 3 The Basic AI Drives
Stephen M. Omohundro
Chapter 4 The Ethics of Artificial Intelligence
Nick Bostrom and Eliezer Yudkowsky
Chapter 5 Friendly Artificial Intelligence: The Physics Challenge
Max Tegmark
Chapter 6 MDL Intelligence Distillation: Exploring Strategies for Safe Access to Superintelligent Problem-Solving Capabilities
K. Eric Drexler
Chapter 7 The Value Learning Problem
Nate Soares
Chapter 8 Adversarial Examples in the Physical World
Alexey Kurakin, Ian J. Goodfellow, and Samy Bengio
Chapter 9 How Might AI Come About?: Different Approaches and Their Implications for Life in the Universe
David Brin
Chapter 10 The MADCOM Future: How Artificial Intelligence Will Enhance Computational Propaganda, Reprogram Human Culture, and Threaten Democracy … and What can be Done About It
Matt Chessen
Chapter 11 Strategic Implications of Openness in AI Development
Nick Bostrom
Part II Responses of Scholars
Chapter 12 Using Human History, Psychology, and Biology to Make AI Safe for Humans
Gus Bekdash
Chapter 13 AI Safety: A First-Person Perspective
Edward Frenkel
Chapter 14 Strategies for an Unfriendly Oracle AI with Reset Button
Olle Häggström
Chapter 15 Goal Changes in Intelligent Agents
Seth Herd, Stephen J. Read, Randall O’Reilly, and David J. Jilk
Chapter 16 Limits to Verification and Validation of Agentic Behavior
David J. Jilk
Chapter 17 Adversarial Machine Learning
Phillip Kuznetsov, Riley Edmunds, Ted Xiao, Humza Iqbal, Raul Puri, Noah Golmant, and Shannon Shih
Chapter 18 Value Alignment via Tractable Preference Distance
Andrea Loreggia, Nicholas Mattei, Francesca Rossi, and K. Brent Venable
Chapter 19 A Rationally Addicted Artificial Superintelligence
James D. Miller
Chapter 20 On the Security of Robotic Applications Using ROS
David Portugal, Miguel A. Santos, Samuel Pereira, and Micael S. Couceiro
Chapter 21 Social Choice and the Value Alignment Problem
Mahendra Prasad
Chapter 22 Disjunctive Scenarios of Catastrophic AI Risk
Kaj Sotala
Chapter 23 Offensive Realism and the Insecure Structure of the International System: Artificial Intelligence and Global Hegemony
Maurizio Tinnirello
Chapter 24 Superintelligence and the Future of Governance: On Prioritizing the Control Problem at the End of History
Phil Torres
Chapter 25 Military AI as a Convergent Goal of Self-Improving AI
Alexey Turchin and David Denkenberger
Chapter 26 A Value-Sensitive Design Approach to Intelligent Agents
Steven Umbrello and Angelo F. De Bellis
Chapter 27 Consequentialism, Deontology, and Artificial Intelligence Safety
Mark Walker
Chapter 28 Smart Machines ARE a Threat to Humanity
Kevin Warwick
Index
About the Author :
Dr. Roman V. Yampolskiy is a Tenured Associate Professor in the department of Computer Engineering and Computer Science at the Speed School of Engineering, University of Louisville. He is the founding and current director of the Cyber Security Lab and an author of many books including Artificial Superintelligence: a Futuristic Approach. During his tenure at UofL, Dr. Yampolskiy has been recognized as: Distinguished Teaching Professor, Professor of the Year, Faculty Favorite, Top 4 Faculty, Leader in Engineering Education, Top 10 of Online College Professor of the Year, and Outstanding Early Career in Education award winner among many other honors and distinctions. Yampolskiy is a Senior member of IEEE and AGI; Member of Kentucky Academy of Science, former Research Advisor for MIRI and Associate of GCRI.
Dr. Yampolskiy’s main areas of interest are AI Safety, Artificial Intelligence, Behavioral Biometrics, Cybersecurity, Genetic Algorithms, and Pattern Recognition. Dr. Yampolskiy is an author of over 150 publications including multiple journal articles and books. His research has been cited by 1000+ scientists and profiled in popular magazines both American and foreign (New Scientist, Poker Magazine, Science World Magazine), dozens of websites (BBC, MSNBC, Yahoo! News), on radio (German National Radio, Swedish National Radio) and TV. Dr. Yampolskiy’s research has been featured 1000+ times in numerous media reports in 30 languages.
Review :
"Artificial intelligence: Safety and Security is a timely and ambitious edited volume. It comprises 28 chapters organized under three distinct themes: security, artificial intelligence and safety. Edited by Roman V. Yampolskiy, the contributions are well integrated and challenge common conceptions. Yampolskiy has assembled a diverse team of leading scholars.
In sum, the book provides valuable insight into the cyber ecosystem. It can be read in any order without missing the essence of the subject matter, yet the chapters speak to each other. The chapters provide insight into new research areas and experimental designs. The book is a must-read for computer scientists, security experts, mathematicians, students and individuals who are interested in learning more about the progress of the artificial intelligence field. It will also be of interest to hackers and the intelligence community."
-International Affairs, Volume 95, Issue 3, May 2019, Pages 728–729, https://doi.org/10.1093/ia/iiz016
"There are those of us who philosophize and debate the finer points surrounding the dangers of artificial intelligence. And then there are those who dare go in the trenches and get their hands dirty by doing the actual work that may just end up making the difference. So if AI turns out to be like the terminator then Prof. Roman Yampolskiy may turn out to be like John Connor – but better. Because instead of fighting by using guns and brawn he is utilizing computer science, human intelligence and code."
-Nikola Danaylov (author of Conversations with the Future: 21 Visions for the 21st Century)
"Artificial Intelligence Safety and Security is an interesting read to learn about risks associated with the rapid growth of autonomous AI systems around us. While benefits of such systems are going to be enormous, so will be the risks if their power is left unchecked. A skillfully edited volume by my Computer Science and Engineering University of Louisville colleague, Dr. Roman Yampolskiy."
-Jacek ZURADA, Ph.D., Candidate for IEEE President, IEEE Life Fellow, Professor of Electrical and Computer Engineering Department, University of Louisville
"This amazing and brand-new book with 47 contributors and more than 470 densely packed pages will immediately be recognized as indispensable in the AI safety and AI futurology literature. Among the 28 chapters, the first 11 more or less have the status of modern classics. The remaining 17 are new …"
-Olle Häggström, Professor of mathematical statistics at Chalmers University
"Yampolskiy (Univ. of Louisville) furnishes readers with a thoughtful discussion of the state of the art regarding the safety and security of artificial intelligence (AI). To fully appreciate this text, readers must read the editor's preface. In it, he lays out the history of AI with a focus on its failures and how these might have been prevented, previewing themes to be explored in depth in the coming 28 chapters, contributed by 46 researchers in the field of AI. [. . . .] This text offers a comprehensive look at an emerging field; it is best suited for specialists."
-J. Beidler, emeritus, University of Scranton, Pennsylvania, United States of America
"Artificial intelligence: Safety and Security is a timely and ambitious edited volume. It comprises 28 chapters organized under three distinct themes: security, artificial intelligence and safety. Edited by Roman V. Yampolskiy, the contributions are well integrated and challenge common conceptions. Yampolskiy has assembled a diverse team of leading scholars.
In sum, the book provides valuable insight into the cyber ecosystem. It can be read in any order without missing the essence of the subject matter, yet the chapters speak to each other. The chapters provide insight into new research areas and experimental designs. The book is a must-read for computer scientists, security experts, mathematicians, students and individuals who are interested in learning more about the progress of the artificial intelligence field. It will also be of interest to hackers and the intelligence community."
-International Affairs, Volume 95, Issue 3, May 2019, Pages 728–729, https://doi.org/10.1093/ia/iiz016
"There are those of us who philosophize and debate the finer points surrounding the dangers of artificial intelligence. And then there are those who dare go in the trenches and get their hands dirty by doing the actual work that may just end up making the difference. So if AI turns out to be like the terminator then Prof. Roman Yampolskiy may turn out to be like John Connor – but better. Because instead of fighting by using guns and brawn he is utilizing computer science, human intelligence and code."
-Nikola Danaylov (author of Conversations with the Future: 21 Visions for the 21st Century)
"Artificial Intelligence Safety and Security is an interesting read to learn about risks associated with the rapid growth of autonomous AI systems around us. While benefits of such systems are going to be enormous, so will be the risks if their power is left unchecked. A skillfully edited volume by my Computer Science and Engineering University of Louisville colleague, Dr. Roman Yampolskiy."
-Jacek ZURADA, Ph.D., Candidate for IEEE President, IEEE Life Fellow, Professor of Electrical and Computer Engineering Department, University of Louisville
"This amazing and brand-new book with 47 contributors and more than 470 densely packed pages will immediately be recognized as indispensable in the AI safety and AI futurology literature. Among the 28 chapters, the first 11 more or less have the status of modern classics. The remaining 17 are new …"
-Olle Häggström, Professor of mathematical statistics at Chalmers University
"Yampolskiy (Univ. of Louisville) furnishes readers with a thoughtful discussion of the state of the art regarding the safety and security of artificial intelligence (AI). To fully appreciate this text, readers must read the editor's preface. In it, he lays out the history of AI with a focus on its failures and how these might have been prevented, previewing themes to be explored in depth in the coming 28 chapters, contributed by 46 researchers in the field of AI. [. . . .] This text offers a comprehensive look at an emerging field; it is best suited for specialists."
-J. Beidler, emeritus, University of Scranton, Pennsylvania, United States of America
