Tao Zhexuan questions OpenAI: 719 AI mathematical proofs that humans really understand?陶哲轩质疑 OpenAI 公司:719 篇 AI 数学证明,人类真的理解了吗?
IT House October 9th news, OpenAI released 719 AI mathematical answers in October, covering 372 mathematical result families, involving hundreds of open research questions, but after the release was accused of not fully meeting the standards proposed by the "Mathematical and Artificial Intelligence Advisory Group" (AGMAI)...
IT之家 10 月 9 日消息,OpenAI 于 10 月公布 719 份 AI 数学解答,涵盖 372 个数学结果族,涉及数百项开放研究问题,不过发布后被指尚未完全达到“数学与人工智能顾问小组”(AGMAI)提出的标准…
Key Points要点速览
In October, OpenAI released 719 AI mathematical solutions, covering 372 mathematical result families, involving hundreds of open research questions, but after the release, it was accused of not fully meeting the standards proposed by the "Mathematical and Artificial Intelligence Advisory Group" (AGMAI). IT House previously reported that OpenAI initially published a total of 722 AI-generated mathematical manuscripts on GitHub on October 6, involving 372 outcome families and multiple open research questions. However, on October 7, 3 copies were withdrawn due to a symbol error and its chain effect, and the number of public catalogues is now 719. OpenAI said it consulted with the Advisory Group on Mathematics and Artificial Intelligence (AGMAI), chaired by the Princeton Institute for Advanced Study, and consulted its public recommendations prior to the launch. However, from the public information, this release has not fully met the standards proposed by the group. AGMAI previously recommended that cutting-edge AI laboratories stop testing difficult mathematical problems on proprietary, inaccessible models and require disclosure of model names, prompts, inference chains, time-consuming, and computational costs. However, OpenAI still uses proprietary models, and only 10 manuscripts have model inference chains. In terms of human comprehensibility, the panel emphasized that AI-generated proofs should be easy for mathematicians to review and learn from; however, about 42% of the proofs published by OpenAI were reportedly not formalized and did not provide machine-readable metadata linking natural language proofs to formalized products. AGMAI also states that its advisory role does not constitute an endorsement of OpenAI's acquisition or publication of these results and that ultimately it is still up to the mathematical community to assess whether the recommendations have been fully implemented. This incident once again triggered controversy over the transparency, formal verification, peer review, and autonomy of academic research of AI-generated mathematical results. Tao Zhexuan posted on mathstodon on October 7, saying that he is not opposed to AI doing mathematics and has even been an active user of AI-assisted research; but he strongly opposes "using AI to quickly solve famous problems" as the main goal or product display. He believes that this will undermine the understanding, teaching, cooperation and open exploration mechanisms on which the mathematical community operates. Tao Zhexuan pointed out that in traditional mathematics, the breakthrough of a long-term conjecture is not just to “get the answer”: the author will make a report, participate in a seminar, communicate with his peers, and then prove to be simplified, interpreted, included in the textbook, and spawn follow-up questions, collaborators, and new research directions. The current practice of companies such as OpenAI is often driven by prompters to solve problems autonomously; once the goal is "solved", subsequent understanding, reporting, peer discussion and domain construction rarely occur. Tao believes that the publisher may not even be enough to explain the AI's output, answer questions, or interact with the field. He called this situation the “proof of indigestion” in mathematics: AI can generate propositions, proofs, and counterexamples at high speeds, but humans are too late to verify, understand, write, teach, and absorb, resulting in a large number of “proofs that no one can digest.” He is particularly concerned that OpenAI will use millennial puzzles such as the Navier-Stokes equation as benchmarks for model capabilities. In his view, this "how many problems to solve, how fast to solve" as a measure of "understanding and insight"; but speed and quantity itself is not equal to mathematical understanding. Tao Zhexuan stressed that once the problem is publicly "solved", it is almost impossible to return to an "unsolved" state. Even if people later want to find different paths and refine new methods from them, just knowing that the answer exists will "pollute" the exploration process. Therefore, he criticized this as an unsustainable large-scale “harvest”: treating open problems as a resource that can be consumed in bulk will eventually make the entire field of mathematics less fertile than under traditional research methods. IT House Note: Tao Zhexuan is one of the most prestigious mathematicians of our time, a professor of mathematics at the University of California, Los Angeles (UCLA), and a 2006 Fields Medal winner; often referred to as the “Mozart of mathematics.” Related Reading: OpenAI Releases Another Batch of AI Mathematics Research Results, Solving Hundreds of Unresolved Problems
IT之家 10 月 9 日消息,OpenAI 于 10 月公布 719 份 AI 数学解答,涵盖 372 个数学结果族,涉及数百项开放研究问题,不过发布后被指尚未完全达到“数学与人工智能顾问小组”(AGMAI)提出的标准。 IT之家此前报道,OpenAI 于 10 月 6 日最初在 GitHub 发布 722 份 AI 生成数学手稿总数,涉及 372 个结果族及多项开放研究问题。不过于 10 月 7 日因一处符号错误及其连锁影响撤回 3 份,现公开目录为 719 份。 OpenAI 表示,发布前曾咨询普林斯顿高等研究院主持的“数学与人工智能顾问小组”(AGMAI),并参考其公开建议。然而,从公开信息看,此次发布尚未完全达到该小组提出的标准。 AGMAI 此前建议前沿 AI 实验室停止在专有、外界无法访问的模型上测试高难度数学问题, 并要求披露模型名称、提示词、推理链、耗时及计算成本等信息;但 OpenAI 此次仍使用专有模型,且仅 10 份手稿附有模型推理链。 在人类可理解性方面,顾问小组强调 AI 生成证明应便于数学家审查和学习;但据报道,OpenAI 发布的证明中约 42% 未经形式化处理,也未提供将自然语言证明与形式化产物关联的机器可读元数据。 AGMAI 同时声明,其咨询角色不构成对 OpenAI 获取或发布这些结果的认可,最终仍需由数学界评估相关建议是否得到充分执行。该事件再度引发关于 AI 生成数学成果的透明度、形式化验证、同行审查及学术研究自主性的争议。 陶哲轩于 10 月 7 日在 mathstodon 上发布帖子,表示他并不反对 AI 做数学,甚至一直是 AI 辅助研究的积极使用者; 但他强烈反对把“用 AI 快速攻克著名难题”当成主要目标或产品展示 。他认为这会破坏数学共同体赖以运转的理解、教学、合作与开放探索机制。 陶哲轩指出,传统数学中,一个长期猜想的突破并不只是“得到答案”:作者会做报告、参加研讨、与同行交流,随后证明会被简化、解释、纳入教材,并催生后续问题、合作者和新的研究方向。 而 OpenAI 等公司当前的做法,往往是由提示者驱动 AI 自主解题; 目标一旦“解决”,后续的理解、报告、同行讨论和领域建设却很少发生。陶哲轩认为,发布者甚至可能不足以解释 AI 的输出、回答问题或与领域互动。 他把这种状况称为数学界的“证明消化不良”:AI 能高速生成命题、证明和反例, 但人类来不及验证、理解、写作、教学和吸收,结果出现大量“无人能消化的证明”。 他尤其担心的是,OpenAI 把纳维–斯托克斯方程等千禧年难题当作模型能力基准来攻克。在他看来,这把“解出多少题、多快解出”当成了衡量“理解与洞见”的指标;但速度和数量本身并不等于数学理解。 陶哲轩强调, 问题一旦被公开“解决”,就几乎无法恢复为“未解决”状态。 即使人们后来想寻找不同路径、从中提炼新方法,仅仅知道答案存在,也会“污染”这一探索过程。 因此,他批评这是一种不可持续的大规模“收割”:把开放问题当作可批量消耗的资源,最终会让整个数学领域变得不如传统研究方式下那样肥沃。 IT之家注:陶哲轩是当代最负盛名的数学家之一、加州大学洛杉矶分校(UCLA)数学教授,也是 2006 年菲尔兹奖得主;常被称为“数学界的莫扎特”。 相关阅读: 《 OpenAI 发布又一批 AI 数学研究成果,攻破数百个悬而未决难题 》
想马上用起来?去「AI工具」栏挑一个直接下载,或在「AI教程」里跟着图文步骤做一遍。
去 AI工具 → 看 AI教程 →阅读与点赞数据保存在你的浏览器本地,欢迎留下你的想法。
今日正能量学一点,用一点;今天种下的种子,会长成明天的能力。去免费下载专区 →广告
评论 文明发言,让讨论更有价值