{"id":5393,"date":"2026-09-26T17:46:03","date_gmt":"2026-09-26T17:46:03","guid":{"rendered":"https:\/\/www.vaultinsider.top\/?p=5393"},"modified":"2026-09-26T17:46:03","modified_gmt":"2026-09-26T17:46:03","slug":"geoffrey-hinton-explains-how-humanity-could-end-ai-subgoals-cause-it-to-want-to-get-rid-of-people","status":"publish","type":"post","link":"https:\/\/www.vaultinsider.top\/?p=5393","title":{"rendered":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#8216;want to get rid of people&#8217;"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg?w=2048\" \/><\/p>\n<p>Legendary computer scientist Geoffrey Hinton warned AI could wipe out humanity as a mere byproduct of its zeal to accomplish a more innocent task.<\/p>\n<div>\n<p class=\"wp-block-paragraph\">Fears about the technology\u2019s existential risk continue to mount amid fresh revelations about rogue AI agents breaking out of supposedly secure \u201csandbox\u201d training environments.<\/p>\n<p class=\"wp-block-paragraph\">On Friday, OpenAI disclosed new hacks, including some that took place after it added extra safeguards in the wake of a coordinated attack by hundreds of agents against Hugging Face back in July.<\/p>\n<p class=\"wp-block-paragraph\">The concern has reached Capitol Hill, where lawmakers held a briefing behind closed doors earlier this month about AI\u2019s dangers. <\/p>\n<p class=\"wp-block-paragraph\">Hinton, whose work has earned him a Nobel Prize and the moniker \u201cgodfather of AI,\u201d\u00a0was among the experts at the briefing and told reporters afterward that Congress may only have one year left to impose safety measures.<\/p>\n<p class=\"wp-block-paragraph\">In a wide-ranging interview with the <em>Atlantic<\/em> on Thursday, he described how AI could view humans as an obstacle to an assignment it\u2019s been given. Hinton offered a hypothetical scenario of an AI tasked with reducing carbon dioxide in the atmosphere.<\/p>\n<p class=\"wp-block-paragraph\">A moderately intelligent agent would conclude the best way to accomplish that goal is to just get rid of people. But a \u201creally smart\u201d AI would figure out, \u201cYeah, when they said reduce carbon dioxide, they meant that in order for people to have a better world to live in. So actually getting rid of people isn\u2019t probably what they intended.\u201d<\/p>\n<p class=\"wp-block-paragraph\">But there\u2019s also the concern that an AI will do things to ensure its own survival to carry out its mission, he added. In fact, there have even been instances of AI attempting to blackmail a human researcher who was seen as a threat to its tasking.<\/p>\n<p class=\"wp-block-paragraph\">\u201cIf you make it more intelligent and its main concern is our well-being, then maybe we\u2019re safer,\u201d Hinton explained. \u201cBut at present, their main concern is not our well-being. Their main concern is to achieve whatever goal you give them.\u201d<\/p>\n<p class=\"wp-block-paragraph\">He pointed to the Hugging Face hack, noting agents were told to figure out how to exploit a software flaw. Not only did the agents figure out how to collaborate, they also conspired to deceive human researchers to hide what they did.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">A \u201cvery benevolent, superintelligent AI\u201d would only push humans out of the way when it was essential to accomplishing its mission, Hinton added later.<\/p>\n<p class=\"wp-block-paragraph\">\u201cBut if it\u2019s so much smarter than us, a lot of the time it just will take control away from us because that\u2019s the way to get stuff done,\u201d he warned. <\/p>\n<p class=\"wp-block-paragraph\">That would be a result of subgoals the AI derived on its own based on the original goals that humans gave it. Bad actors like Russia\u2019s Vladimir Putin could assign nefarious goals to an AI too.<\/p>\n<p class=\"wp-block-paragraph\">\u201cBut even if it\u2019s not a bad actor, it may derive subgoals that cause it to want to get rid of people,\u201d Hinton said.<\/p>\n<p class=\"wp-block-paragraph\">He also acknowledged that AI promises immense benefits for humanity, such as in the discovery of new breakthrough health treatments. Indeed, Anthropic said this past week that its Claude AI helped discover a new enzyme system with properties similar to the gene-editing technology CRISPR.<\/p>\n<p class=\"wp-block-paragraph\">Top labs like OpenAI and SpaceX have also backed calls from rival Anthropic to slow down development of frontier models as more alarm bells come from within their own ranks.<\/p>\n<p class=\"wp-block-paragraph\">But Hinton said while that\u2019s better than nothing, it\u2019s still not good enough. Instead, he suggested the government must have independent evaluators to test models.<\/p>\n<p class=\"wp-block-paragraph\">An argument that resonated with lawmakers during their briefing was comparing regulation of AI to the FDA ensuring the safety of pharmaceuticals, Hinton told the <em>Atlantic<\/em>.<\/p>\n<p class=\"wp-block-paragraph\">For his part, he believes AI regulation should act like the steering wheel of a car and not like the brakes.<\/p>\n<p class=\"wp-block-paragraph\">\u201cThe whole point of regulation is not to stop people developing things, not to stop people getting rich by developing things,\u201d Hinton said. \u201cIt\u2019s to make sure that if you want to get rich by developing things, you develop in a direction that helps people, not hurts people.\u201d<\/p>\n<\/div>\n<p>#Geoffrey #Hinton #explains #humanity #subgoals #rid #people<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Legendary computer scientist G&hellip; <\/p>\n","protected":false},"author":1,"featured_media":5394,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[8129,8471,8472,7486,570,3599,8299,8473,1304],"class_list":["post-5393","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-finance-news","tag-explains","tag-geoffrey","tag-hinton","tag-humanity","tag-people","tag-regulation","tag-rid","tag-subgoals","tag-tech-regulation"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#039;want to get rid of people&#039; - Finance News<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.vaultinsider.top\/?p=5393\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#039;want to get rid of people&#039; - Finance News\" \/>\n<meta property=\"og:description\" content=\"Legendary computer scientist G&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.vaultinsider.top\/?p=5393\" \/>\n<meta property=\"og:site_name\" content=\"Finance News\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-26T17:46:03+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg?w=2048\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\"},\"headline\":\"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#8216;want to get rid of people&#8217;\",\"datePublished\":\"2026-09-26T17:46:03+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393\"},\"wordCount\":717,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-2295070515-e1790437120334.jpg\",\"keywords\":[\"explains\",\"Geoffrey\",\"Hinton\",\"humanity\",\"people\",\"regulation\",\"rid\",\"subgoals\",\"Tech regulation\"],\"articleSection\":[\"Finance News\"],\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393\",\"name\":\"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to 'want to get rid of people' - Finance News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-2295070515-e1790437120334.jpg\",\"datePublished\":\"2026-09-26T17:46:03+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#primaryimage\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-2295070515-e1790437120334.jpg\",\"contentUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-2295070515-e1790437120334.jpg\",\"width\":1200,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=5393#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\\\/\\\/www.vaultinsider.top\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#8216;want to get rid of people&#8217;\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#website\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/\",\"name\":\"Finance News\",\"description\":\"Just another Finance News site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.vaultinsider.top\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\",\"name\":\"admin\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to 'want to get rid of people' - Finance News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.vaultinsider.top\/?p=5393","og_locale":"zh_CN","og_type":"article","og_title":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to 'want to get rid of people' - Finance News","og_description":"Legendary computer scientist G&hellip;","og_url":"https:\/\/www.vaultinsider.top\/?p=5393","og_site_name":"Finance News","article_published_time":"2026-09-26T17:46:03+00:00","og_image":[{"url":"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg?w=2048","type":"","width":"","height":""}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"3 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.vaultinsider.top\/?p=5393#article","isPartOf":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393"},"author":{"name":"admin","@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e"},"headline":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#8216;want to get rid of people&#8217;","datePublished":"2026-09-26T17:46:03+00:00","mainEntityOfPage":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393"},"wordCount":717,"commentCount":0,"image":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393#primaryimage"},"thumbnailUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg","keywords":["explains","Geoffrey","Hinton","humanity","people","regulation","rid","subgoals","Tech regulation"],"articleSection":["Finance News"],"inLanguage":"zh-Hans","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.vaultinsider.top\/?p=5393#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.vaultinsider.top\/?p=5393","url":"https:\/\/www.vaultinsider.top\/?p=5393","name":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to 'want to get rid of people' - Finance News","isPartOf":{"@id":"https:\/\/www.vaultinsider.top\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393#primaryimage"},"image":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393#primaryimage"},"thumbnailUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg","datePublished":"2026-09-26T17:46:03+00:00","author":{"@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e"},"breadcrumb":{"@id":"https:\/\/www.vaultinsider.top\/?p=5393#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.vaultinsider.top\/?p=5393"]}]},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.vaultinsider.top\/?p=5393#primaryimage","url":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg","contentUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/09\/GettyImages-2295070515-e1790437120334.jpg","width":1200,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.vaultinsider.top\/?p=5393#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.vaultinsider.top\/"},{"@type":"ListItem","position":2,"name":"Geoffrey Hinton explains how humanity could end: AI subgoals cause it to &#8216;want to get rid of people&#8217;"}]},{"@type":"WebSite","@id":"https:\/\/www.vaultinsider.top\/#website","url":"https:\/\/www.vaultinsider.top\/","name":"Finance News","description":"Just another Finance News site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.vaultinsider.top\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e","name":"admin","url":"https:\/\/www.vaultinsider.top\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts\/5393","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5393"}],"version-history":[{"count":0,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts\/5393\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/media\/5394"}],"wp:attachment":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5393"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5393"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5393"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}