Value identification problem

https://arbital.com/p/value_identification

by Eliezer Yudkowsky May 31 2015 updated Dec 15 2015


The subproblem category of value alignment which deals with pinpointing valuable outcomes to an advanced agent and distinguishing them from non-valuable outcomes. E.g., the Edge Instantiation and Ontology Identification problems are argued to be foreseeable difficulties of value identification. A central foreseen difficulty of value identification is Complexity of Value.