{ localUrl: '../page/paperclip.html', arbitalUrl: 'https://arbital.com/p/paperclip', rawJsonUrl: '../raw/7ch.json', likeableId: '0', likeableType: 'page', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], pageId: 'paperclip', edit: '5', editSummary: '', prevEdit: '4', currentEdit: '5', wasPublished: 'true', type: 'wiki', title: 'Paperclip', clickbait: 'A configuration of matter that we'd see as being worthless even from a very cosmopolitan perspective.', textLength: '4382', alias: 'paperclip', externalUrl: '', sortChildrenBy: 'likes', hasVote: 'false', voteType: '', votesAnonymous: 'false', editCreatorId: 'EliezerYudkowsky', editCreatedAt: '2017-01-11 20:55:01', pageCreatorId: 'EliezerYudkowsky', pageCreatedAt: '2017-01-10 21:11:02', seeDomainId: '0', editDomainId: 'EliezerYudkowsky', submitToDomainId: '0', isAutosave: 'false', isSnapshot: 'false', isLiveEdit: 'true', isMinorEdit: 'false', indirectTeacher: 'false', todoCount: '0', isEditorComment: 'false', isApprovedComment: 'false', isResolved: 'false', snapshotText: '', anchorContext: '', anchorText: '', anchorOffset: '0', mergedInto: '', isDeleted: 'false', viewCount: '432', text: '[summary: A 'paperclip', in the context of [2v AI alignment], is any configuration of matter which would seem very boring and pointless even from a very [7cl cosmopolitan] perspective. If some bizarre physics catastrophe, spreading out at the speed of light, permanently transformed all matter it touched into paperclips, this would be morally equivalent to a physics catastrophe that destroys the reachable universe outright. There is no deep missing moral insight we could have, no broadening of perspective and understanding, that would make us realize that little bent pieces of metal are a wonderful use of a cosmic endowment that could otherwise be transformed into intelligent life. This is why we consider actual non-metaphorical paperclips as the case in point of 'paperclips'.]\n\nA 'paperclip', in the context of [2v AI alignment], is any configuration of matter which would seem boring and [55 valueless] even from a very [7cl cosmopolitan] perspective.\n\nIf some bizarre physics catastrophe, spreading out at the speed of light, permanently transformed all matter it touched into paperclips, this would be morally equivalent to a physics catastrophe that destroys the reachable universe outright. There is no deep missing moral insight we could have, no broadening of perspective and understanding, that would make us realize that little bent pieces of metal without any thought or internal experiences are the best possible use of our [7cy cosmic endowment]. It's true that we don't know what epiphanies may lie in the future for us, but that *particular* paperclip-epiphany seems *improbable.* If you are tempted to argue with this statement as it applies to actual non-metaphorical paperclips, you are probably being overly contrary. This is why we consider actual non-metaphorical paperclips as the case in point of 'paperclips'. \n\nFrom our perspective, any entity that did in fact go around transforming almost all reachable matter into literal actual nonmetaphorical paperclips, would be doing something incredibly pointless; there would almost certainly be no hidden wisdom in the act that we could perceive on deeper examination or further growth of our own intellectual capacities. By the definition of the concept, this would be equally true of anything more generally termed a [10h paperclip maximizer]. Anything claimed about 'paperclips' or a [10h 'paperclip' maximizer] (such as the claim that [1y such an entity can exist without having any special intellectual defects]) must go through without any change for actual paperclips. Actual paperclips are meant to be a central example of 'paperclips'.\n\nThe only distinction between paperclips and 'paperclips' is that the category 'paperclips' is far *wider* than the category 'actual non-metaphorical paperclips' and includes many more specific configurations of matter. Pencil erasers, tiny molecular smileyfaces, and [5g enormous diamond masses] are all 'paperclips'. Even under the [1y Orthogonality Thesis], an AI maximizing actual non-metaphorical paperclips would be an improbable *actual* outcome of screwing up on [5s value alignment]; but only because there are so many other possibilities. A 'red actual-paperclip maximizer' would be even more improbable than an actual-paperclip maximizer to find in real life; but this is not because redness is antithetical to the nature of intelligent goals. The 'redness' clause is one more added piece of complexity in the specification that drives down the probability of that exact outcome.\n\nThe popular press has sometimes distorted the notion of a paperclip maximizer into a story about an AI running a paperclip factory that takes over the universe. (Needless to say, the kind of AI used in a paperclip-manufacturing facility is unlikely to be a frontier research AI.) The concept of a 'paperclip' is not that it's an explicit goal somebody foolishly gave an AI, or even a goal comprehensible in human terms at all. To imagine a central example of a supposed paperclip maximizer, imagine a research-level AI that did not stably preserve what its makers thought was supposed to be its utility function, or an AI with a poorly specified value learning rule, etcetera; such that the configuration of matter that [47 actually happened to max out the AI's utility function] looks like a [2w tiny] string of atoms in the shape of a paperclip.', metaText: '', isTextLoaded: 'true', isSubscribedToDiscussion: 'false', isSubscribedToUser: 'false', isSubscribedAsMaintainer: 'false', discussionSubscriberCount: '1', maintainerCount: '1', userSubscriberCount: '0', lastVisit: '', hasDraft: 'false', votes: [], voteSummary: 'null', muVoteSummary: '0', voteScaling: '0', currentUserVote: '-2', voteCount: '0', lockedVoteType: '', maxEditEver: '0', redLinkCount: '0', lockedBy: '', lockedUntil: '', nextPageId: '', prevPageId: '', usedAsMastery: 'false', proposalEditNum: '0', permissions: { edit: { has: 'false', reason: 'You don't have domain permission to edit this page' }, proposeEdit: { has: 'true', reason: '' }, delete: { has: 'false', reason: 'You don't have domain permission to delete this page' }, comment: { has: 'false', reason: 'You can't comment in this domain because you are not a member' }, proposeComment: { has: 'true', reason: '' } }, summaries: {}, creatorIds: [ 'EliezerYudkowsky' ], childIds: [], parentIds: [ 'paperclip_maximizer' ], commentIds: [], questionIds: [], tagIds: [], relatedIds: [], markIds: [], explanations: [], learnMore: [], requirements: [], subjects: [ { id: '7275', parentId: 'paperclip_maximizer', childId: 'paperclip', type: 'subject', creatorId: 'EliezerYudkowsky', createdAt: '2017-01-10 21:13:49', level: '2', isStrong: 'false', everPublished: 'true' } ], lenses: [], lensParentId: '', pathPages: [], learnMoreTaughtMap: {}, learnMoreCoveredMap: { '10h': [ '8v4' ] }, learnMoreRequiredMap: {}, editHistory: {}, domainSubmissions: {}, answers: [], answerCount: '0', commentCount: '0', newCommentCount: '0', linkedMarkCount: '0', changeLogs: [ { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '22231', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'newEditGroup', createdAt: '2017-03-02 19:38:48', auxPageId: 'EliezerYudkowsky', oldSettingsValue: '123', newSettingsValue: '2' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21614', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '5', type: 'newEdit', createdAt: '2017-01-11 20:55:01', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21589', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '4', type: 'newEdit', createdAt: '2017-01-10 21:16:09', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21588', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '3', type: 'newEdit', createdAt: '2017-01-10 21:15:55', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21586', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'deleteTeacher', createdAt: '2017-01-10 21:14:53', auxPageId: 'paperclip', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21587', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'deleteSubject', createdAt: '2017-01-10 21:14:53', auxPageId: 'paperclip', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21585', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'newSubject', createdAt: '2017-01-10 21:14:26', auxPageId: 'paperclip_maximizer', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21582', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'newTeacher', createdAt: '2017-01-10 21:14:25', auxPageId: 'paperclip', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21583', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'newSubject', createdAt: '2017-01-10 21:14:25', auxPageId: 'paperclip', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21581', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '2', type: 'newEdit', createdAt: '2017-01-10 21:14:24', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21580', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '0', type: 'newParent', createdAt: '2017-01-10 21:11:03', auxPageId: 'paperclip_maximizer', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21578', pageId: 'paperclip', userId: 'EliezerYudkowsky', edit: '1', type: 'newEdit', createdAt: '2017-01-10 21:11:02', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' } ], feedSubmissions: [], searchStrings: {}, hasChildren: 'false', hasParents: 'true', redAliases: {}, improvementTagIds: [], nonMetaTagIds: [], todos: [], slowDownMap: 'null', speedUpMap: 'null', arcPageIds: 'null', contentRequests: {} }