Value identification problem

by Eliezer Yudkowsky May 31 2015 updated Dec 15 2015

The subproblem category of value alignment which deals with pinpointing valuable outcomes to an advanced agent and distinguishing them from non-valuable outcomes. E.g., the Edge Instantiation and Ontology Identification problems are argued to be foreseeable difficulties of value identification. A central foreseen difficulty of value identification is Complexity of Value.