Difficulty of AI alignment


by Eliezer Yudkowsky May 25 2017 updated May 25 2017

How hard is it exactly to point an Artificial General Intelligence in an intuitively okay direction?

This page attempts to list basic propositions in computer science which, if they are true, would be ultimately responsible for rendering difficult the task of getting good outcomes from a sufficiently advanced Artificial Intelligence.



By saying that these propositions would, if true, seem to imply "difficulties", we don't mean to imply that these problems are unsolvable. We could distinguish possible levels of "difficulty" as follows: