Linguistic conventions in value alignment

by Eliezer Yudkowsky Apr 27 2015 updated Dec 17 2015

How and why to use precise language and words with special meaning when talking about value alignment.

A central page to list the language conventions in value alignment theory. See also Glossary (Value Alignment Theory).

Language dealing with wants, desires, utility, preference, and value.

We need a language rich enough to distinguish at least the following as different intensional concepts, even if their extensions end up being identical:

So far, the following reserved terms have been advocated for the subject of value alignment:

'Terminal' and 'instrumental' have their standard contrasting meanings.