{
localUrl: '../page/diamond_maximizer.html',
arbitalUrl: 'https://arbital.com/p/diamond_maximizer',
rawJsonUrl: '../raw/5g.json',
likeableId: '2338',
likeableType: 'page',
myLikeValue: '0',
likeCount: '7',
dislikeCount: '0',
likeScore: '7',
individualLikes: [
'AlexFlint',
'AndrewMcKnight',
'FlorentBerthet',
'PaulChristiano',
'NateSoares',
'JohnMaxwell',
'StephanieZolayvar'
],
pageId: 'diamond_maximizer',
edit: '11',
editSummary: '',
prevEdit: '10',
currentEdit: '11',
wasPublished: 'true',
type: 'wiki',
title: 'Diamond maximizer',
clickbait: 'How would you build an agent that made as much diamond material as possible, given vast computing power but an otherwise rich and complicated environment?',
textLength: '3893',
alias: 'diamond_maximizer',
externalUrl: '',
sortChildrenBy: 'likes',
hasVote: 'false',
voteType: '',
votesAnonymous: 'false',
editCreatorId: 'EliezerYudkowsky',
editCreatedAt: '2015-12-17 22:58:47',
pageCreatorId: 'EliezerYudkowsky',
pageCreatedAt: '2015-04-27 23:59:15',
seeDomainId: '0',
editDomainId: 'EliezerYudkowsky',
submitToDomainId: '0',
isAutosave: 'false',
isSnapshot: 'false',
isLiveEdit: 'true',
isMinorEdit: 'false',
indirectTeacher: 'false',
todoCount: '17',
isEditorComment: 'false',
isApprovedComment: 'true',
isResolved: 'false',
snapshotText: '',
anchorContext: '',
anchorText: '',
anchorOffset: '0',
mergedInto: '',
isDeleted: 'false',
viewCount: '477',
text: 'A difficult, far-reaching open problem in [2v] is to specify an [ unbounded] formula for an agent that would, if run on an [ unphysically large finite computer], create as much diamond material as possible. The goal of 'diamonds' was chosen to make it physically crisp as to what constitutes a 'diamond'. Supposing a crisp goal plus hypercomputation avoids some problems in value alignment, while still invoking many others, making it an interesting intermediate problem.\n\n### Importance\n\nThe diamond maximizer problem is to give an [ unbounded] description of a computer program such that, if it were instantiated on a sufficiently powerful but [ physical computer], the result of running the program would be the creation of an immense amount of diamond - around as much diamond as is physically possible for an agent to create.\n\nThe fact that this problem is still extremely hard shows that the value alignment problem is not just due to the [5l]. As a thought experiment, it helps to distinguish value-complexity-laden difficulties from those that arise even for simple goals.\n\nIt also helps to [ illustrate the difficulty of value alignment] by making the more clearly visible point that we can't even figure out how to create lots of diamond using unlimited computing power, never mind creating [55 value] using [ bounded computing power].\n\n### Problems avoided\n\nIf we can crisply define exactly what a 'diamond' is, in theory it seems like we should be able to avoid issues of [2w Edge Instantiation], [47 Unforeseen Maximums], and trying to convey [5l complex values] into the agent.\n\nThe amount of diamond is defined as the number of carbon atoms that are covalently bonded, by electrons, to exactly four other carbon atoms. A carbon atom is any nucleus containing six protons and any number of neutrons, bound by the strong force. The utility of a universal history is the total amount of Minkowskian interval spent by all carbon atoms being bound to exactly four other carbon atoms. More precise definitions of 'bound', or the amount of measure in a quantum system that is being bound, are left to the reader - any crisp definition will do, so long as we are confident that it has no [47 unforeseen maximum] at things we don't intuitively see as diamonds.\n\n### Problems challenged\n\nSince this diamond maximizer would hypothetically be implemented on a very large but physical computer, it would confront [ reflective stability], the [ anvil problem], and the problems of making [ subagents].\n\nTo the extent the diamond maximizer might need to worry about other agents in the environment that have a good ability to model, or that it may need to cooperate with other diamond maximizers, it must resolve [ Newcomblike problems] using some [ logical decision theory]. This would also require it to confront [ logical uncertainty] despite possessing immense amounts of computing power.\n\nTo the extent the diamond maximizer must work well in a rich real universe that might operate according to any number of possible physical laws, it faces a problem of [ naturalized induction] and [5c ontology identification]. See the article on [5c ontology identification] for the case that even for the goal of 'make diamonds', the problem of [ goal identification] remains difficult.\n\n### Unreflective diamond maximizer\n\nAs a further-simplified but still unsolved problem, an **unreflective diamond maximizer** is a diamond maximizer implemented on a [ Cartesian hypercomputer] in a [ causal universe] that does not face any [ Newcomblike problems]. This further avoids problems of reflectivity and logical uncertainty. In this case, it seems plausible that the primary difficulty remaining is *just* the [5c ontology identification problem]. Thus the open problem of describing an unreflective diamond maximizer is a central illustration for the difficulty of ontology identification.',
metaText: '',
isTextLoaded: 'true',
isSubscribedToDiscussion: 'false',
isSubscribedToUser: 'false',
isSubscribedAsMaintainer: 'false',
discussionSubscriberCount: '4',
maintainerCount: '1',
userSubscriberCount: '0',
lastVisit: '2016-02-27 03:57:48',
hasDraft: 'false',
votes: [],
voteSummary: 'null',
muVoteSummary: '0',
voteScaling: '0',
currentUserVote: '-2',
voteCount: '0',
lockedVoteType: '',
maxEditEver: '0',
redLinkCount: '0',
lockedBy: '',
lockedUntil: '',
nextPageId: '',
prevPageId: '',
usedAsMastery: 'false',
proposalEditNum: '0',
permissions: {
edit: {
has: 'false',
reason: 'You don't have domain permission to edit this page'
},
proposeEdit: {
has: 'true',
reason: ''
},
delete: {
has: 'false',
reason: 'You don't have domain permission to delete this page'
},
comment: {
has: 'false',
reason: 'You can't comment in this domain because you are not a member'
},
proposeComment: {
has: 'true',
reason: ''
}
},
summaries: {},
creatorIds: [
'EliezerYudkowsky',
'NateSoares',
'AlexeiAndreev'
],
childIds: [],
parentIds: [
'ontology_identification'
],
commentIds: [
'1b5',
'7t'
],
questionIds: [],
tagIds: [
'value_alignment_open_problem'
],
relatedIds: [],
markIds: [],
explanations: [],
learnMore: [],
requirements: [],
subjects: [],
lenses: [],
lensParentId: '',
pathPages: [],
learnMoreTaughtMap: {},
learnMoreCoveredMap: {},
learnMoreRequiredMap: {},
editHistory: {},
domainSubmissions: {},
answers: [],
answerCount: '0',
commentCount: '0',
newCommentCount: '0',
linkedMarkCount: '0',
changeLogs: [
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '5350',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '0',
type: 'deleteParent',
createdAt: '2016-01-16 22:39:14',
auxPageId: 'ai_alignment',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '4127',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '11',
type: 'newEdit',
createdAt: '2015-12-17 22:58:47',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '4109',
pageId: 'diamond_maximizer',
userId: 'NateSoares',
edit: '10',
type: 'newEdit',
createdAt: '2015-12-17 22:27:33',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '4108',
pageId: 'diamond_maximizer',
userId: 'NateSoares',
edit: '9',
type: 'newEdit',
createdAt: '2015-12-17 22:26:51',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '3883',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '0',
type: 'deleteParent',
createdAt: '2015-12-16 05:20:32',
auxPageId: 'value_alignment_open_problem',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '3881',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '8',
type: 'newTag',
createdAt: '2015-12-16 05:20:31',
auxPageId: 'value_alignment_open_problem',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '3787',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '8',
type: 'newEdit',
createdAt: '2015-12-15 23:06:57',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '3786',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '0',
type: 'newAlias',
createdAt: '2015-12-15 23:06:56',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '308',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '1',
type: 'newParent',
createdAt: '2015-10-28 03:46:51',
auxPageId: 'ontology_identification',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '375',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '1',
type: 'newParent',
createdAt: '2015-10-28 03:46:51',
auxPageId: 'ai_alignment',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '432',
pageId: 'diamond_maximizer',
userId: 'AlexeiAndreev',
edit: '1',
type: 'newParent',
createdAt: '2015-10-28 03:46:51',
auxPageId: 'value_alignment_open_problem',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1931',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '7',
type: 'newEdit',
createdAt: '2015-05-05 22:22:25',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1930',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '6',
type: 'newEdit',
createdAt: '2015-05-05 22:21:35',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1929',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '5',
type: 'newEdit',
createdAt: '2015-05-05 22:09:58',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1928',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '4',
type: 'newEdit',
createdAt: '2015-05-05 22:01:57',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1927',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '3',
type: 'newEdit',
createdAt: '2015-05-05 22:01:48',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1926',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '2',
type: 'newEdit',
createdAt: '2015-05-05 22:01:27',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '1925',
pageId: 'diamond_maximizer',
userId: 'EliezerYudkowsky',
edit: '1',
type: 'newEdit',
createdAt: '2015-04-27 23:59:15',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
}
],
feedSubmissions: [],
searchStrings: {},
hasChildren: 'false',
hasParents: 'true',
redAliases: {},
improvementTagIds: [],
nonMetaTagIds: [],
todos: [],
slowDownMap: 'null',
speedUpMap: 'null',
arcPageIds: 'null',
contentRequests: {}
}