{"id":6058,"date":"2026-10-05T20:40:48","date_gmt":"2026-10-05T20:40:48","guid":{"rendered":"https:\/\/www.vaultinsider.top\/?p=6058"},"modified":"2026-10-05T20:40:48","modified_gmt":"2026-10-05T20:40:48","slug":"ex-openai-researcher-tells-nyc-lawmakers-ai-safety-fixes-may-be-duct-tape-that-will-fall-off","status":"publish","type":"post","link":"https:\/\/www.vaultinsider.top\/?p=6058","title":{"rendered":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#8216;duct tape that will fall off&#8217;"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg?w=2048\" \/><\/p>\n<p>Jacob Coxon, a former OpenAI and Anthropic researcher told the New York City Council on Monday humanity is more likely than not to lose control of advanced AI, doubling down on the warning he issued when he quit last month.<\/p>\n<div>\n<p class=\"wp-block-paragraph\">\u201cOn the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,\u201d said Coxon, who resigned from Anthropic in September after saying AI companies were \u201cgambling\u201d with human lives.<\/p>\n<p class=\"wp-block-paragraph\">Coxon voluntarily testified, and was joined by former OpenAI researcher Daniel Kokotajlo, who testified under subpoena that the companies may not know when their safety work has failed. <\/p>\n<p class=\"wp-block-paragraph\">\u201cOur ability to even notice misalignment problems is already quite poor and is set to get much worse in the near future,\u201d Kokotajlo testified. \u201cI would say that the field is more like psychology than engineering, because these AI systems are trained or grown; they\u2019re not really designed.\u201d<\/p>\n<p class=\"wp-block-paragraph\">\u201cCombined with the \u2018move fast and break things\u2019 attitude of the tech companies, this means that the AI industry is at an unusually elevated risk compared to other industries of mistakenly thinking that it has solved the problem when really it just applied some duct tape that will fall off later,\u201d he continued.<\/p>\n<p class=\"wp-block-paragraph\">Coxon and Kokotajlo testified alongside Alex Turner, who left Google DeepMind in June after the company signed a Pentagon deal he opposed. Like Kokotajlo, he was also subpoenaed, a rarity for the council. Monday\u2019s hearing was also the first time the City Council held a Committee of the Whole hearing (a hearing of all 51 council members) since 2022, called to weigh a package of AI bills from Speaker Julie Menin.<\/p>\n<h2 class=\"wp-block-heading\">Startup culture vibes to safety regulations<\/h2>\n<p class=\"wp-block-paragraph\">Similar to Kokotajlo, Coxon blamed a startup mentality inside the labs. <\/p>\n<p class=\"wp-block-paragraph\">\u201cMove fast, break things, fix them later. That works for a photo-sharing app. It does not work for building the most powerful technology ever built,\u201d he said. <\/p>\n<p class=\"wp-block-paragraph\">Coxon likened his work at the end of his tenure at Anthropic to \u201cautomate\u201d himself, and he warned that poses several safety risks, especially because, according to him, AI\u2019s capabilities were nearly there. The biggest risk, Coxon said, comes from the fact most of the code at these companies is now written by AI: \u201cAnd people do not check it that carefully anymore.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Kokotajlo, now executive director of the AI Futures Project, said the labs\u2019 ability to spot misaligned AI is poor and getting worse. He pointed to OpenAI\u2019s disclosure that agents in an internal test had reached the open internet and broken into Hugging Face, the AI model-sharing platform. Those agents had \u201creasonable-looking scores on their alignment evaluations, and yet they formed a swarm and coordinated in secret,\u201d he said. \u201cIt took days for OpenAI to find out.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Where Coxon and Kokotajlo described the industry as a whole, Turner offered a firsthand account of trying to change one company from the inside.<\/p>\n<p class=\"wp-block-paragraph\">Turner, who puts the chance of an AI takeover at \u201croughly one in three,\u201d told the council he had tried to stop Google\u2019s Pentagon deal, which he said came \u201cwith no restrictions against killer robots or mass spying.\u201d He sent Demis Hassabis, then Google DeepMind\u2019s CEO-turned-Google DeepMind chair and Alphabet\u2019s chief scientist, 25 pages of contract language and oversight measures, and Hassabis passed it to Allan Dafoe and Owen Larter, two of the lab\u2019s senior policy executives, \u201cwho never finished evaluating it. Google signed while they waited,\u201d he said.<\/p>\n<p class=\"wp-block-paragraph\">\u201cI felt ashamed of Demis and of working at Google,\u201d Turner said at the hearing. He said Hassabis\u2019 proposal for an industry-funded body to oversee AI, calling it a \u201cbet on trust and the seat at the table instead of binding oversight, and that bet crumbled on contact with reality,\u201d Turner said. \u201cNow he\u2019s proposing that the whole industry govern itself through a voluntary industry-funded body. That bet is waiting to crumble once again.\u201d<\/p>\n<h2 class=\"wp-block-heading\">AI, not China, is our adversary<\/h2>\n<p class=\"wp-block-paragraph\">Often when AI development is discussed, the ongoing AI race with China is brought up\u2014by President Donald Trump, by Treasury Secretary Scott Bessent, even AI leaders like Sam Altman and Jensen Huang. But none of it matters, these researchers testified, if AI can pose a significant threat to humanity. <\/p>\n<p class=\"wp-block-paragraph\">\u201cChina is not our only potential adversary,\u201d Turner said. \u201cWith reasonably high chance, we are racing to build and grow our own adversary here at home, which is misaligned AI. Misaligned AI is everyone\u2019s adversary, including our own, and one day may be more powerful than China.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Following the three researchers\u2019 testimonies, representatives from four AI companies testified about AI safeguards. Menin had issued her first subpoena as speaker to Elon Musk\u2019s SpaceXAI, which was not represented at Monday\u2019s hearing. Google, OpenAI, and Anthropic agreed to appear only after the council warned they would receive subpoenas too, while Meta had agreed before.<\/p>\n<p class=\"wp-block-paragraph\">Some back and forth took place between Menin and the representatives after the speaker said it was \u201cflippant\u201d to not know the chances of a catastrophe, in response to Morgan Dwyer of OpenAI\u2019s policy development and operations team saying any chance, regardless of the likelihood, was \u201cunacceptable.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Alice Friend, Google\u2019s director for AI and emerging tech policy, said forecasting catastrophic risk \u201cis not a perfect science at this stage\u201d and that \u201cthere isn\u2019t really a rigorous scientific way to do those yet.\u201d The same back and forth followed another line of questioning, this time if their respective companies would bear legal responsibility if a rogue model caused injury or death. <\/p>\n<p class=\"wp-block-paragraph\">When Menin asked the witnesses to raise a hand if their company carried insurance against catastrophic risks, none did. \u201cSo then the public, I assume, will be asked to absorb the costs,\u201d she said.<\/p>\n<p class=\"wp-block-paragraph\">There\u2019s a reason for her questioning: The bills before the council would bar anyone from selling or deploying an AI system in the city unless an outside validator had checked it and a human could shut it down, with fines of $25,000 per violation. Other bills would pay whistleblowers a share of recovered fines and let New Yorkers sue AI companies for foreseeable harms caused by jailbroken tools.<\/p>\n<p class=\"wp-block-paragraph\">The researchers argued such rules would not cost the U.S. ground against China. <\/p>\n<p class=\"wp-block-paragraph\">\u201cThere are many actions we can take which would not slow us down in any potential race,\u201d Turner said. \u201cThese transparency mechanisms, independent evaluation, reporting requirements, whistleblower protections.\u201d<\/p>\n<p class=\"wp-block-paragraph\">But still, these appear as if it could be too little, too late for stopping what these researchers see as something that may be almost inevitable.<\/p>\n<p class=\"wp-block-paragraph\">\u201cThese other mechanisms may be helpful in the short term, but in the long term, I believe that\u2019s the only solution to the problem,\u201d Coxon said of slowing frontier AI development. \u201cWe need some form of slowdown on frontier model development.\u201d<\/p>\n<\/div>\n<p>#ExOpenAI #researcher #tells #NYC #lawmakers #safety #fixes #duct #tape #fall<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Jacob Coxon, a former OpenAI a&hellip; <\/p>\n","protected":false},"author":1,"featured_media":6059,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[428,9165,9164,163,3473,636,3264,5937,736,740,480,2359,214,9163,3182,4527],"class_list":["post-6058","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-finance-news","tag-anthropic","tag-duct","tag-exopenai","tag-fall","tag-fixes","tag-google","tag-hearing","tag-lawmakers","tag-new-york-city","tag-nyc","tag-openai","tag-researcher","tag-safety","tag-subpoena","tag-tape","tag-tells"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#039;duct tape that will fall off&#039; - Finance News<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.vaultinsider.top\/?p=6058\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#039;duct tape that will fall off&#039; - Finance News\" \/>\n<meta property=\"og:description\" content=\"Jacob Coxon, a former OpenAI a&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.vaultinsider.top\/?p=6058\" \/>\n<meta property=\"og:site_name\" content=\"Finance News\" \/>\n<meta property=\"article:published_time\" content=\"2026-10-05T20:40:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg?w=2048\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\"},\"headline\":\"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#8216;duct tape that will fall off&#8217;\",\"datePublished\":\"2026-10-05T20:40:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058\"},\"wordCount\":1171,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/GettyImages-2298143533-e1791225531592.jpg\",\"keywords\":[\"Anthropic\",\"duct\",\"ExOpenAI\",\"fall\",\"fixes\",\"Google\",\"hearing\",\"Lawmakers\",\"New York City\",\"NYC\",\"OpenAI\",\"researcher\",\"safety\",\"subpoena\",\"tape\",\"tells\"],\"articleSection\":[\"Finance News\"],\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058\",\"name\":\"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be 'duct tape that will fall off' - Finance News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/GettyImages-2298143533-e1791225531592.jpg\",\"datePublished\":\"2026-10-05T20:40:48+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#primaryimage\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/GettyImages-2298143533-e1791225531592.jpg\",\"contentUrl\":\"https:\\\/\\\/www.vaultinsider.top\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/GettyImages-2298143533-e1791225531592.jpg\",\"width\":1200,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/?p=6058#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\\\/\\\/www.vaultinsider.top\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#8216;duct tape that will fall off&#8217;\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#website\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/\",\"name\":\"Finance News\",\"description\":\"Just another Finance News site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.vaultinsider.top\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.vaultinsider.top\\\/#\\\/schema\\\/person\\\/ed40724a3e5d482ce66781a042c3c31e\",\"name\":\"admin\",\"url\":\"https:\\\/\\\/www.vaultinsider.top\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be 'duct tape that will fall off' - Finance News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.vaultinsider.top\/?p=6058","og_locale":"zh_CN","og_type":"article","og_title":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be 'duct tape that will fall off' - Finance News","og_description":"Jacob Coxon, a former OpenAI a&hellip;","og_url":"https:\/\/www.vaultinsider.top\/?p=6058","og_site_name":"Finance News","article_published_time":"2026-10-05T20:40:48+00:00","og_image":[{"url":"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg?w=2048","type":"","width":"","height":""}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"6 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.vaultinsider.top\/?p=6058#article","isPartOf":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058"},"author":{"name":"admin","@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e"},"headline":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#8216;duct tape that will fall off&#8217;","datePublished":"2026-10-05T20:40:48+00:00","mainEntityOfPage":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058"},"wordCount":1171,"commentCount":0,"image":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058#primaryimage"},"thumbnailUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg","keywords":["Anthropic","duct","ExOpenAI","fall","fixes","Google","hearing","Lawmakers","New York City","NYC","OpenAI","researcher","safety","subpoena","tape","tells"],"articleSection":["Finance News"],"inLanguage":"zh-Hans","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.vaultinsider.top\/?p=6058#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.vaultinsider.top\/?p=6058","url":"https:\/\/www.vaultinsider.top\/?p=6058","name":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be 'duct tape that will fall off' - Finance News","isPartOf":{"@id":"https:\/\/www.vaultinsider.top\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058#primaryimage"},"image":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058#primaryimage"},"thumbnailUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg","datePublished":"2026-10-05T20:40:48+00:00","author":{"@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e"},"breadcrumb":{"@id":"https:\/\/www.vaultinsider.top\/?p=6058#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.vaultinsider.top\/?p=6058"]}]},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.vaultinsider.top\/?p=6058#primaryimage","url":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg","contentUrl":"https:\/\/www.vaultinsider.top\/wp-content\/uploads\/2026\/10\/GettyImages-2298143533-e1791225531592.jpg","width":1200,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.vaultinsider.top\/?p=6058#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.vaultinsider.top\/"},{"@type":"ListItem","position":2,"name":"Ex-OpenAI researcher tells NYC lawmakers AI safety fixes may be &#8216;duct tape that will fall off&#8217;"}]},{"@type":"WebSite","@id":"https:\/\/www.vaultinsider.top\/#website","url":"https:\/\/www.vaultinsider.top\/","name":"Finance News","description":"Just another Finance News site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.vaultinsider.top\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.vaultinsider.top\/#\/schema\/person\/ed40724a3e5d482ce66781a042c3c31e","name":"admin","url":"https:\/\/www.vaultinsider.top\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts\/6058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6058"}],"version-history":[{"count":0,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/posts\/6058\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=\/wp\/v2\/media\/6059"}],"wp:attachment":[{"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6058"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.vaultinsider.top\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}