{ localUrl: '../page/value_cosmopolitan.html', arbitalUrl: 'https://arbital.com/p/value_cosmopolitan', rawJsonUrl: '../raw/7cl.json', likeableId: '0', likeableType: 'page', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], pageId: 'value_cosmopolitan', edit: '3', editSummary: '', prevEdit: '2', currentEdit: '3', wasPublished: 'true', type: 'wiki', title: 'Cosmopolitan value', clickbait: 'Intuitively: Value as seen from a broad, embracing standpoint that is aware of how other entities may not always be like us or easily understandable to us, yet still worthwhile.', textLength: '5102', alias: 'value_cosmopolitan', externalUrl: '', sortChildrenBy: 'likes', hasVote: 'false', voteType: '', votesAnonymous: 'false', editCreatorId: 'EliezerYudkowsky', editCreatedAt: '2017-01-11 20:29:05', pageCreatorId: 'EliezerYudkowsky', pageCreatedAt: '2017-01-10 22:00:09', seeDomainId: '0', editDomainId: 'EliezerYudkowsky', submitToDomainId: '0', isAutosave: 'false', isSnapshot: 'false', isLiveEdit: 'true', isMinorEdit: 'false', indirectTeacher: 'false', todoCount: '1', isEditorComment: 'false', isApprovedComment: 'false', isResolved: 'false', snapshotText: '', anchorContext: '', anchorText: '', anchorOffset: '0', mergedInto: '', isDeleted: 'false', viewCount: '212', text: '[summary: 'Cosmopolitan', lit. "of the city of the cosmos", intuitively refers to a broad, widely embracing standpoint that tolerates and appreciates other people (entities) whose ways may at first seem very strange to us; trying to step out of our small, parochial, local instincts. An alien civilization might at first seem completely bizarre to us, but if we really understood what was going on and tried to open our minds and hearts, we'd see it was a galaxy no less to be valued than our own.\n\nPeople who feel strongly about this 'citizen of the cosmos' perspective often start out with a strong [1rm prior] that anyone talking about *not* just letting AIs do their own thing must be taking a parochial, humans-first, carbon-chauvinist viewpoint. To which at least some AI alignment theorists reply: "No! You don't understand! We *are* cosmopolitans! We *also* grew up reading science fiction about aliens that turned out to have their own perspectives, and AIs willing to extend a hand in friendship being mistreated by carbon chauvinists! But [10h paperclip maximizers] are really genuinely different from that! We predict that if you got to see the use a paperclip maximizer would make of the cosmic endowment, you'd be as horrified as we are; we have a difference of empirical predictions about what happens when you run a paperclip maximizer, not a values difference about how far to widen the circle of concern."]\n\n'Cosmopolitan', lit. "of the city of the cosmos", intuitively implies a very broad, embracing standpoint that is tolerant of other people (entities) and ways that may at first seem strange to us; trying to step out of our small, parochial, local standpoint and adopt a broader one.\n\nFrom the perspective of [313 volitional metaethics], this would [3y9 normatively] cover a case where what we humans *currently* value doesn't cover as much as what we would predictably come to value\\* in the limit of better knowledge, greater comprehension, longer thinking, higher intelligence, or better understanding our own natures and changing ourselves in directions we thought were right. An alien civilization might at first seem completely bizarre to us, and hence scarce in events that we intuitively understood how to value; but if we really understood what was going on, and tried to take additional steps toward widening our circle of concern, we'd see it was a galaxy no less to be valued than our own.\n\nFrom outside the perspective of any particular metaethics, the notion of 'cosmopolitan' may be viewed as more like a historical generalization about moral progress: many times in human history, we get a first look at people different from us, find their ways repugnant or just confusing, and then later on we bring these people into our circle of concern and learn that they had their own nice things even if we didn't understand those nice things. Afterwards, in these cases, we look back and say 'moral progress has occurred'. Anyone pointing at people and claiming they are *not* to be valued as our fellow sapients, or asserting that their ways are objectively inferior to our own, is refusing to learn this lesson of history and unable to appreciate what we would see if we could really adopt their perspective. To be 'cosmopolitan' is to learn from this generalization, and accept in advance that other beings may have valuable lives and ways even if we don't find them immediately easy to understand.\n\nPeople who've adopted this viewpoint often start out with a strong prior that anyone talking about *not* just letting AIs do their own thing, figure out their own path, and create whatever kind of intergalactic civilization they want, must have failed to learn the cosmopolitan lesson. To which at least some AI alignment theorists reply: "No! You don't understand! You're completely failing to pass our [7cm Ideological Turing Test]! We *are* cosmopolitans! We *also* grew up reading science fiction about aliens that turned out to have their own perspectives, and AIs willing to extend a hand in friendship but being mistreated by carbon chaunivists! We'd be *fine* with a weird and wonderful intergalactic civilization full of non-organic beings appreciating their own daily life in ways we wouldn't understand. But [10h paperclip maximizers] *don't do that!* We predict that if you got to see the use a paperclip maximizer would make of the cosmic endowment, if you really understood what was going on inside that universe, you'd be as horrified as we are. You and I have a difference of empirical predictions about the consequences of running a paperclip maximizer, not a values difference about how far to widen the circle of concern."\n\n"Fragility of Cosmopolitan Value" could denote the form of the [ Fragility of Value] / [5l] thesis that is relevant to intuitive cosmopolitans: Agents with [7cp random utility functions] wouldn't use the cosmic endowment in ways that achieve a tiny fraction of the achievable [55 value], even in the limit of our understanding exactly what was going on and trying to take a very embracing perspective.', metaText: '', isTextLoaded: 'true', isSubscribedToDiscussion: 'false', isSubscribedToUser: 'false', isSubscribedAsMaintainer: 'false', discussionSubscriberCount: '1', maintainerCount: '1', userSubscriberCount: '0', lastVisit: '', hasDraft: 'false', votes: [], voteSummary: 'null', muVoteSummary: '0', voteScaling: '0', currentUserVote: '-2', voteCount: '0', lockedVoteType: '', maxEditEver: '0', redLinkCount: '0', lockedBy: '', lockedUntil: '', nextPageId: '', prevPageId: '', usedAsMastery: 'false', proposalEditNum: '0', permissions: { edit: { has: 'false', reason: 'You don't have domain permission to edit this page' }, proposeEdit: { has: 'true', reason: '' }, delete: { has: 'false', reason: 'You don't have domain permission to delete this page' }, comment: { has: 'false', reason: 'You can't comment in this domain because you are not a member' }, proposeComment: { has: 'true', reason: '' } }, summaries: {}, creatorIds: [ 'EliezerYudkowsky' ], childIds: [], parentIds: [ 'value_alignment_value' ], commentIds: [], questionIds: [], tagIds: [], relatedIds: [], markIds: [], explanations: [], learnMore: [], requirements: [], subjects: [ { id: '7277', parentId: 'value_alignment_value', childId: 'value_cosmopolitan', type: 'subject', creatorId: 'EliezerYudkowsky', createdAt: '2017-01-10 21:31:11', level: '2', isStrong: 'false', everPublished: 'true' } ], lenses: [], lensParentId: '', pathPages: [], learnMoreTaughtMap: {}, learnMoreCoveredMap: {}, learnMoreRequiredMap: {}, editHistory: {}, domainSubmissions: {}, answers: [], answerCount: '0', commentCount: '0', newCommentCount: '0', linkedMarkCount: '0', changeLogs: [ { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21610', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '0', type: 'newEditGroup', createdAt: '2017-01-11 20:29:29', auxPageId: 'EliezerYudkowsky', oldSettingsValue: '123', newSettingsValue: '2' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21609', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '3', type: 'newEdit', createdAt: '2017-01-11 20:29:05', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21608', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '2', type: 'newEdit', createdAt: '2017-01-11 20:24:04', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21597', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '0', type: 'newSubject', createdAt: '2017-01-10 22:00:11', auxPageId: 'value_alignment_value', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21595', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '0', type: 'newParent', createdAt: '2017-01-10 22:00:10', auxPageId: 'value_alignment_value', oldSettingsValue: '', newSettingsValue: '' }, { likeableId: '0', likeableType: 'changeLog', myLikeValue: '0', likeCount: '0', dislikeCount: '0', likeScore: '0', individualLikes: [], id: '21593', pageId: 'value_cosmopolitan', userId: 'EliezerYudkowsky', edit: '1', type: 'newEdit', createdAt: '2017-01-10 22:00:09', auxPageId: '', oldSettingsValue: '', newSettingsValue: '' } ], feedSubmissions: [], searchStrings: {}, hasChildren: 'false', hasParents: 'true', redAliases: {}, improvementTagIds: [], nonMetaTagIds: [], todos: [], slowDownMap: 'null', speedUpMap: 'null', arcPageIds: 'null', contentRequests: {} }