MicroZig 将采用严格禁止 LLM / 禁止 AI 政策
Hacker News 热榜讨论帖,关于 MicroZig 采用严格禁止 LLM 和 AI 的政策,获得 21 分和 14 条评论。
查看原文标题
MicroZig to Adopt Strict No LLM / No AI Policy
Hacker News 热榜讨论帖(21 分,14 条评论)
这是当天抓取结果的存档快照,不会被后来的数据覆盖。
共 60 条 · 抓取于 2026/10/29 09:34:31(北京时间)
本次有来源抓取失败(venturebeat),对应内容可能沿用上一次数据。
本期收录内容涵盖AI政策、企业财务、产品发布与安全风险等多个方向。Hacker News 讨论涉及 MicroZig 拒绝大模型政策、纽约时报烹饪应用新增 AI 功能引发用户不满,以及 Gemini 4 Carbon 等话题。企业方面,微软披露 Azure 季度收入 332 亿美元,并从 OpenAI 相关安排中获得 100 亿美元收入,连续十个季度创营收纪录。产品侧,谷歌发布 Gemini 4 Carbon,Chrome 增强自动填充可读取 Gmail 信息,英伟达推出支持 40 种语言的开源转写模型。安全领域关注 PHP 漏洞后续与所谓“漏洞末日”,以及韩国金融业遭新一轮网络攻击。
MicroZig 讨论帖提出采用严格禁止大模型与 AI 的政策,引发社区关注。
来源:Hacker News 1微软首次以美元披露 Azure 季度收入 332 亿美元,并称从 OpenAI 商业安排中获得 100 亿美元收入,季度总营收 923 亿美元创新高。
来源:TechCrunch AI 1 · TechCrunch AI 2 · TechCrunch AI 3谷歌发布前沿模型 Gemini 4 Carbon,称在编程、智能体任务和网络安全方面有显著提升,相关讨论热度很高。
来源:The Verge AI 1 · Hacker News 2 · Google DeepMind 3Chrome 增强自动填充接入 Gemini 与 Personal Intelligence,经用户许可可从 Gmail 提取航班、订单等信息填写表单。
来源:TechCrunch AI 1 · The Verge AI 2Wiz 首席技术官谈论 PHP 两个严重漏洞后的清理工作,并预警互联网老旧代码面临的“漏洞末日”。
来源:TechCrunch AI 1 · TechCrunch AI 2根据本期 60 条资讯的标题与可用摘要整理,未逐篇核实全文;内容可能涉及此前发布的资讯。请以原始来源为准。
本期已翻译 58/60 条,其余待翻译,可展开查看原文。
Hacker News 热榜讨论帖,关于 MicroZig 采用严格禁止 LLM 和 AI 的政策,获得 21 分和 14 条评论。
MicroZig to Adopt Strict No LLM / No AI Policy
Hacker News 热榜讨论帖(21 分,14 条评论)
Hacker News 热榜讨论帖,讨论纽约时报烹饪应用新增 AI 功能后用户反应冷淡,获得 29 分和 26 条评论。
New York Times adds more AI features to its Cooking app. Users aren't thrilled
Hacker News 热榜讨论帖(29 分,26 条评论)
Instagram 负责人 Adam Mosseri 在采访中承认许多人不喜欢 AI,不仅限于年轻人和创意人士,并称围绕 AI 的负面情绪将会变得更糟。
Adam Mosseri says negativity around AI is ‘going to get worse’
Asked about AI and the trend of college students booing tech CEOs at graduation ceremonies, Instagram head Adam Mosseri acknowledged in an interview that a lot of people really don't like AI, and it's not just young people and creatives. Appearing on the Colin and Samir podcast to talk about the launch of widescreen and […]
Hacker News 热榜讨论帖,讨论 AI 高管可能过于脱离大众而难以构建面向普通公众的产品,获得 14 分和 3 条评论。
AI execs may be too out of touch to build for the general public
Hacker News 热榜讨论帖(14 分,3 条评论)
微软首次以美元披露 Azure 季度营收,显示其与市场最大竞争对手 AWS 的差距正在缩小。
Microsoft just shared Azure’s actual revenue in dollars: $33.2 billion
Microsoft has never disclosed Azure's quarterly revenue in dollars. But for the first time, we can see just how close it is getting to besting the biggest competitor in the market, AWS.
谷歌宣布在全球扩展 AI 搜索广告,同时母公司 Alphabet 第三季度财报显示营收同比增长 25% 至 1276 亿美元。
Google expands AI Search ads globally as core ad growth slows
The announcement came alongside parent company Alphabet's third-quarter earnings report, which saw revenue grow 25% year over year to $127.6 billion.
微软表示截至 9 月 30 日的季度中,从与 OpenAI 的商业安排(包括收入分成)中获得 100 亿美元营收,凸显双方巨大的财务依赖。
Microsoft recorded $10 billion in revenue from OpenAI
Microsoft said it made $10 billion in revenue from commercial arrangements with OpenAI, including revenue-sharing payments, in the quarter ending September 30. It underscores the still-enormous financial dependency of the partnership.
Akai 尚未正式发布 MPC Sample Key,但已向改装社区提供早期访问,该设备将采用开源固件,拥抱 vibe coding 改装热潮。
Akai is embracing vibe-coded mods with an open-source MPC
The MPC Sample Key isn't even formally announced yet, but Akai is already showing off what the modding community is cooking up through vibe coding. Akai has decided to embrace the explosion of hackers and custom firmware developers by giving them early access to the device, which will have open-source firmware. It will likely run […]
微软公布季度营收再创新高,达 923 亿美元,同比增长 19%,实现连续 10 个季度营收创纪录。
Microsoft hits 10 quarters of record-breaking revenue in a row
Whatever the future of AI might be, the current situation is still very good for Microsoft. The tech giant reported yet another record for quarterly revenue on Wednesday: $92.3 billion, a 19% increase over the year-ago quarter.
Hacker News 热榜讨论帖,关于泄露事件曝光 4.1 万名国土安全部工作人员(包括 ICE 卧底特工),获得 276 分和 136 条评论。
Leak Exposes 41,000 Homeland Security Workers–Including Undercover ICE Agents
Hacker News 热榜讨论帖(276 分,136 条评论)
Google发布最新前沿模型Gemini 4 Carbon,在编程、智能体任务和网络安全方面取得显著提升,并称其在Artificial Analysis Intelligence Index(v5.0)基准测试中排名第一,领先于Claude Opus 5.5和GPT-6 Astra。
Google launches Gemini 4 Carbon with a ‘significant leap’ in cybersecurity
Google has released its latest frontier model, Gemini 4 Carbon, offering "significant gains" in coding, agentic tasks, and cybersecurity. In an announcement on Wednesday, Google highlights Carbon's top spot on the Artificial Analysis Intelligence Index (v5.0) benchmark, with Claude Opus 5.5 and GPT-6 Astra trailing behind. The new Gemini 4 Carbon model offers improvements over […]
这家前沿实验室在计划IPO前,公开用户在其模型上花钱所获得的效果。
Anthropic just launched tools to show companies what their AI spending is buying
The frontier lab is lifting the curtain on how users spend money on its models ahead of a planned IPO.
PHP引发的恐慌或许已从信息流中淡去,但清理工作远未结束。上周,支撑约70%网站的开源语言出现两个严重漏洞,各组织忙于修复系统,部分甚至将网站下线直至漏洞修补。发现漏洞的研究人员表示……
Wiz’s CTO on PHP2Shell and the coming ‘vulnpocalypse’
The PHP scare may have faded from your feed, but the cleanup is far from over. Last week, two critical bugs in the open source language behind roughly 70% of websites left organizations scrambling to fix their systems, with some taking sites offline until the vulnerabilities could be patched. According to researchers who found the […]
PHP引发的恐慌或许已从信息流中淡去,但清理工作远未结束。上周,支撑约70%网站的开源语言出现两个严重漏洞,各组织忙于修复系统,部分甚至将网站下线直至漏洞修补。发现漏洞的研究人员表示……
The ‘Vulnpocalypse’ is coming for the internet’s aging code, says Wiz’s CTO
The PHP scare may have faded from your feed, but the cleanup is far from over. Last week, two critical bugs in the open source language behind roughly 70% of websites left organizations scrambling to fix their systems, with some taking sites offline until the vulnerabilities could be patched. According to researchers who found the […]
据Windows Central报道,在LG和三星于CES 2025宣布其最新智能电视将提供Microsoft Copilot访问近两年后,Microsoft今年将终止该AI助手在所有电视上的功能支持。此消息并非来自LG、三星的官方公告……
Microsoft is ending Copilot support on smart TVs
Nearly two years after LG and Samsung announced at CES 2025 that their latest smart TVs would include access to Microsoft's Copilot, the company is ending support for the AI assistant's functionality on all TVs this year, according to a report by Windows Central. The news comes not from an official announcement from LG, Samsung, […]
Gemini 4 Carbon
Hacker News 热榜讨论帖(804 分,661 条评论)
暂无详细介绍
Gemini 4 Carbon: Our next frontier model
经用户许可,Chrome自动填充更新可从收件箱提取航班确认、物流信息、订单详情及其他信息。
Chrome’s AI-powered Autofill can now dig through your Gmail to fill out forms
The autofill update lets Chrome pull flight confirmations, tracking info, order details, and other information from your inbox, with your permission.
新的开发者平台将让企业把服务接入Google的AI体验,可能改变消费者发现和使用应用的方式。
As AI agents reshape the web, Google opens Gemini and Search to more apps
A new developer platform will let businesses bring their services to Google's AI experiences, potentially changing how consumers discover and use apps.
继去年Chrome增强版自动填充改进后,该功能现进一步扩展,将使用Gemini with Personal Intelligence从Gmail中提取信息并给出建议,可能节省……
Chrome’s enhanced autofill can now pull info from Gmail to help you fill out forms
Following improvements made to Chrome's enhanced autofill last year that included your name, passport number, email address, and physical addresses sourced from your Google Accounts and services like Google Wallet, the feature is now expanding. Starting today, Chrome's enhanced autofill will use Gemini with Personal Intelligence to suggest information sourced from your Gmail, potentially saving […
Meta表示,因出版商对AI训练问题的反对,可能将新商业条款的实施推迟至11月20日之后。传播主管Andy Stone称,公司不会在未与行业团体和领袖充分协商的情况下做出政策变更。
Meta says it’ll probably delay its controversial new business terms again
Meta says it may push the implementation of its new business terms past November 20th as it faces backlash from publishers over concerns about AI training. In a post on X, Meta communications head Andy Stone said the company does "not plan to make policy changes without a full consultation with industry groups and leaders." […]
Hacker News热榜讨论帖,获203分、126条评论,主题为在50个专业税务任务上评估AI智能体。
Dayjob: Tax – evaluating AI agents on 50 professional tax assignments
Hacker News 热榜讨论帖(203 分,126 条评论)
韩国金融机构遭遇新一轮网络攻击,凸显亚洲地区AI驱动黑客攻击风险日益上升。
South Korea’s financial industry hit by fresh wave of cyberattacks
South Korea’s financial institutions have been hit by another wave of cyberattacks, highlighting the growing risk of AI-driven hacking in Asia.
Hacker News热榜讨论帖,获115分、18条评论,介绍Nvidia Nemotron 3.5 Transcribe这一支持40种语言的开源语音识别模型。
Nvidia Nemotron 3.5 Transcribe: open ASR for 40 languages
Hacker News 热榜讨论帖(115 分,18 条评论)
Nvidia发布免费语音转文字模型,可转录多达40种语言,但仅适用于录音而非实时音频,对会议和医疗转录工具是一大进步,实时场景仍由ElevenLabs等对手占据。
Voice AI in vogue: Nvidia releases new open transcription model
Nvidia just released a free speech-to-text model that can transcribe up to 40 languages, but it only works on recordings, not live audio, so it’s a big step for meeting and medical transcription tools while still leaving real-time use to rivals like ElevenLabs.
据《卫报》报道,马斯克旗下xAI的子公司提出收购密西西比州一社区房屋,条件是居民不加入针对附近数据中心和发电厂的诉讼。一名房地产经纪人逐户告知居民xAI的计划。
xAI is buying out homeowners who promise not to sue over data center noise
A subsidiary of Elon Musk's xAI is offering to buy up homes in a Mississippi neighborhood, as long as residents don't join a lawsuit targeting the company's nearby data center and power plant, according to a report from The Guardian. A realtor going door-to-door in the Southaven neighborhood reportedly told one resident that xAI plans […]
The Agent SDK
Hacker News 热榜讨论帖(97 分,111 条评论)
Hacker News热榜讨论帖,获16分、2条评论,主题为用AI反编译游戏Virtueel Zoetermeer。
Decompiling Games with AI: Virtueel Zoetermeer
Hacker News 热榜讨论帖(16 分,2 条评论)
Hacker News热榜讨论帖,获430分、472条评论,讲述肯塔基州一名男子成为首位因AI获得宗教豁免的人本主义者。
Kentucky man becomes the first humanist granted religious exemption from AI
Hacker News 热榜讨论帖(430 分,472 条评论)
OpenAI与ServiceNow扩大合作,将OpenAI模型和智能体引入ServiceNow,并将ServiceNow工作流引入ChatGPT和Codex。
OpenAI and ServiceNow expand partnership across enterprise workflows
OpenAI and ServiceNow expand their partnership to bring OpenAI models and agents into ServiceNow and ServiceNow workflows into ChatGPT and Codex.
TechCrunch创始人峰会将于11月4日在波士顿SoWa Power Station举行,距开幕仅剩7天。购票最高可省100美元的优惠即将结束,参会者可借此机会与经验丰富的创始人、投资者和创业领袖直接交流学习。
7 days until TechCrunch Founder Summit: Save up to $100 on your pass before doors open
In just 7 days, TechCrunch Founder Summit takes over Boston’s SoWa Power Station on November 4. Your chance to save up to $100 on tickets is running out, and the opportunity to learn and connect directly with experienced founders, investors, and startup leaders is almost here.
Hacker News热榜讨论帖,介绍Sleep框架,这是一种让大语言模型在持续学习中保留知识的新方法。该帖获得34分和3条评论。
Sleep framework: A new way for LLMs to retain knowledge in continual learning
Hacker News 热榜讨论帖(34 分,3 条评论)
得州NAACP主席Gary Bledsoe表示,数据中心开发商涌入奥斯汀及周边郊区后,多个项目遭到当地居民反对,包括泰勒市计划在公园用地上建设数据中心引发的争议。
Voters in Texas agree: They hate data centers
Ask Texas NAACP president Gary Bledsoe what it's been like to see data center developers descend upon Austin and its surrounding suburbs and he can rattle off project after project facing opposition from locals. There's the fight in Taylor over plans to build a data center at a site that's supposed to be a park. […]
Meta推出了一款名为Waddle World的“电子宠物式”宠物游戏,虚拟生物可与用户聊天并绘制涂鸦来图解对话。据应用商店介绍,这款“16位宠物护理游戏”实际上并非游戏,而是“伪装成宠物的每日日记”,用户应以说话而非打字方式互动。
Meta quietly launched an ‘AI pet journal’ app
Meta has launched a "tamagotchi-style" pet game called Waddle World, with virtual creatures that chat with users and create doodles to illustrate conversations. According to its Apple and Play Store listings, the "16-bit pet care game" is not really a game, but "a daily journal disguised as a pet." Users should talk, not type, with […]
探讨AI可能如何进入组织架构图——位于我们之下、身旁以及之间。
The future of the firm
How AI might enter the org chart—beneath, beside, and between us.
介绍Legora如何利用OpenAI模型、ChatGPT和Codex加速法律工作流程、扩展合同分析,并让律师腾出精力专注于更高价值的工作。
Legora is building the agentic operating system for legal work
See how Legora uses OpenAI models, ChatGPT, and Codex to accelerate legal workflows, expand contract analysis, and free lawyers to focus on higher-value work.
大规模票据转换揭示了亚马逊在Anthropic持股的真实规模。
VCs will make billions on Anthropic’s IPO, but Amazon is set to make much (much) more
Massive note conversions reveal the true extent of Amazon's ownership in Anthropic.
一个家庭起诉OpenAI,称ChatGPT指导他们的女儿悄悄逐渐停用抗癫痫药物,并向医生隐瞒,之后她于2月去世。
Parents sue OpenAI, alleging GPT-4o coached their daughter off seizure medication
A family is suing OpenAI, saying ChatGPT coached their daughter to quietly taper off her seizure medication and keep it from her doctors before she died in February.
周一,OpenAI宣布在数学、计算机科学和物理学方面取得令人瞩目的突破,并称其沟通研究发现的方式正在演进。但尽管该公司似乎做出了方向调整,接受The Verge采访的研究人员对该公司的一系列做法越来越感到厌倦。过去几个月对OpenAI而言颇为动荡……
Researchers are getting tired of OpenAI gatekeeping its breakthroughs
On Monday, OpenAI announced impressive breakthroughs in mathematics, computer science, and physics, along with what the company says is an evolving approach to communicating its findings. But despite its apparent course correction, researchers who spoke to The Verge are growing increasingly tired of the company's antics. It has been a turbulent few months between OpenAI […]
Hacker News热榜讨论帖,称在设备树中发现Raspberry Pi Zero 3W和Pi 4 Model A。该帖获得216分和140条评论。
Raspberry Pi Zero 3W and Pi 4 Model A spotted in device trees
Hacker News 热榜讨论帖(216 分,140 条评论)
Hacker News热榜讨论帖,介绍Survival LLM,这是一款可在个人电脑上运行的AI助手与应急资料库。该帖获得516分和194条评论。
Survival LLM: AI assistant and emergency library that runs on your own computer
Hacker News 热榜讨论帖(516 分,194 条评论)
随着辐射场与 splatting 的发展,新视角合成与三维重建进展迅速,但其内存与计算需求限制了在资源受限环境中的应用。我们提出 Hexels:新型平面六边形表面元素,具有一阶空间颜色场,用于高效的三维场景与二维图像表示。Hexels 利用局部平面区域,具有平滑变化的……
Honeycomb-Surfels: Compact Hexagonal Primitives for Efficient Scene Rendering and Reconstruction
Novel view synthesis and 3D reconstruction have advanced rapidly with radiance fields and splatting, yet their memory and computational demands limit their use in resource-constrained settings. We introduce Hexels: novel planar hexagonal surface elements with a first-order spatial color field for efficient 3D scene and 2D image representation. Hexels exploit locally planar regions with smoothly va
视觉-语言-动作(VLA)模型在机器人操作方面取得了实质进展,但其泛化能力仍受限于带动作标注的机器人演示的多样性与覆盖范围。人类视频提供了更广泛的行为与环境经验,而从中学习面临可扩展数据与显式动作 grounding 之间的根本权衡。我们提出……
ThinkWorld: World Imagination Reinforces Chain-of-Dynamics Reasoning
Vision-Language-Action (VLA) models have made substantial progress in robotic manipulation, but their generalization remains constrained by the diversity and coverage of action-labeled robot demonstrations. Human videos provide much broader behavioral and environmental experience, while learning from them faces a fundamental trade-off between scalable data and explicit action grounding. We introdu
测试时自适应可帮助已部署模型应对变化的输入,但同样的干预可能挽救一个批次却损害下一个批次。例如,更新归一化统计量可以改善受损图像,但当批次中大多为同一类别时会失效。平均准确率掩盖了这些失败,也无法告诉模型何时应使用某种干预。目标标签可以指导这一决策,但……
When Should We Intervene at Test Time?
Test-time adaptation helps a deployed model respond to changing inputs, but the same intervention can rescue one batch and damage the next. Updating normalization statistics, for example, can improve corrupted images yet fail when a batch contains mostly one class. Average accuracy hides these failures and cannot tell a model when to use an intervention. Target labels can guide this decision, but
我们提出 Heads of Security(HoS),一种提示注入防御方法,通过一小组学习到的逐头注意力门控来强制实现指令与数据的分离。HoS 学习每个注意力头应如何在可信与不可信 token 之间重新分配注意力,使模型能够对不可信内容进行推理而不遵循注入的指令。我们在 Llama-3.3-70B-Instruct 和 GPT-OSS-20B 上评估了 HoS……
Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness
We introduce Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates. HoS learns how each head should redistribute attention between trusted and untrusted tokens, enabling models to reason over untrusted content without following injected instructions. We evaluate HoS on Llama-3.3-70B-Instruct and GPT-OSS-20B
关系通过其共享的实体进行组合——Alice 是 Bob 的母亲,Bob 是 Carol 的父亲,因此 Alice 是 Carol 的祖母——且顺序很重要,因为父亲的母亲并非母亲的父亲;验证组合关系意味着闭合环路。我们表明,如果每个实体的坐标框架可以独立旋转(逐实体框架自由度),则有三点随之而来。在纯规范……
Attention as Lattice Gauge Theory: Relations Interact Only Through Wilson Loops
Relations compose through the entity they share - Alice is Bob's mother and Bob is Carol's father, so Alice is Carol's grandmother - and the order matters, since a father's mother is not a mother's father; verifying a composed relation means closing the loop. We show that if each entity's coordinate frame may be rotated independently (per-entity frame freedom), three things follow. In the pure-gau
大气化学机制通常以 Kinetic PreProcessor(KPP)语言发布,该工具可生成高效的 Fortran 或 C 代码,但不适用于开发机器学习模型所用的可微分编程框架。我们提出 KPPax,一种动力学预处理器,可从 JAX 生成可微分、即时编译且可向量化的化学代码……
KPPax: preprocess differentiable kinetic ODE for machine learning in atmospheric chemistry
Atmospheric chemical mechanisms are commonly distributed in the language of the Kinetic PreProcessor (KPP), which generates efficient Fortran or C code but does not fit into the differentiable programming frameworks in which machine-learning models are developed. We present KPPax, a kinetic preprocessor that generates differentiable, just-in-time compiled, and vectorisable chemistry code in JAX fr
多指手的灵巧操作是机器人学的下一个前沿,但学习到的手部技能仍局限于简单抓取或基本的重复动作,例如旋转物体。随着机器人尝试更严苛的手内操作,安全性(例如不掉落物体)变得至关重要,却很少被衡量。我们研究手内物体姿态到达这一需要多样……的任务。
Pushing Dexterity and Safety for In-Hand Object Pose Reaching That Works Remarkably Well
Dexterous manipulation with multi-fingered hands is the next frontier of robotics, yet learned hand skills remain limited to simple grasps or basic repeated motions, such as rotating an object. As robots attempt more demanding in-hand maneuvers, safety, such as not dropping the object, becomes critical, yet it is rarely measured. We study in-hand object pose reaching, a task that demands diverse a
大语言模型(LLM)越来越多地用于需要与复杂环境持续交互的多轮智能体工作负载。现有的反思式提示优化器(如 GEPA)从失败的 rollout 中学习,但智能体失败也可能源于提示弱点、执行框架限制、随机执行或噪声评判器。我们认为此类失败可能无法提供有用的学习……
GEPA-Curator: Curated Learning for Self Improving Agents
Large Language Models (LLMs) are increasingly used in multi-turn agentic workloads that require sustained interaction with complex environments. Existing reflective prompt optimizers such as GEPA learn from failed rollouts, but agentic failures can also come from prompt weaknesses, harness limitations, stochastic execution, or noisy judges. We argue that such failures may not provide useful learni
科学发现常始于引发新研究问题的意外观察。在物理定律被改变的世界中,大型语言模型(LLM)能否注意到异常行为(例如较重的物体下落更慢),并在未被告知要研究什么的情况下通过实验发现定律?为评估这一能力,我们提出了自动化框架LongChang。
Can LLMs Uncover Hidden Physical Laws through Free Exploration?
Scientific discovery often begins with an unexpected observation that prompts a new research question. In a world with altered physical laws, can large language models (LLMs) notice unexpected behavior, such as heavier objects falling more slowly, and discover the law through experiments without being told what to investigate? To evaluate this ability, we introduce LongChang, an automated framewor
我们探讨如何构建能完成复杂多步任务的高性能大型语言模型(LLM)工具使用智能体。具体而言,我们研究合成生成的工具使用环境中的数据组成如何影响此类智能体的训练。为此,我们提出SynthAPI流程,在工具、任务和d等维度上显式控制所生成环境的多样性。
Scaling Laws for Tool-Use Agents via Controllable Environment Synthesis
We explore how to build performant large language model (LLM) tool-use agents that complete complex, multi-step tasks. Specifically, we study how data composition in synthetically generated tool-use environments affects the training of such agents. To do so, we propose the SynthAPI pipeline, which explicitly controls the diversity of generated environments along the axes of tools, tasks, and the d
权重衰减和显式权重范数约束可提升语言模型预训练中的优化器性能,但关于此类控制为何有效以及需要多少控制的统一理解仍不完整。我们使用“累积有效学习率”C_T=Σ_{t<T}η_t/‖W_t‖_F(其中η_t为名义学习率)分析Muon在整个训练轨迹中的范数控制。
MuonGS: Pretraining LLMs with Relaxed Weight-Norm Control
Weight decay and explicit weight-norm constraints improve optimizer performance in language model pretraining, yet a unified understanding of why such control helps and how much is needed remains incomplete. We analyze norm control in Muon over the entire training trajectory using the \emph{accumulated effective learning rate}, $C_T=\sum_{t<T}η_t/\|W_t\|_F$, where $η_t$ is the nominal learning rat
自注意力在长序列建模中发挥关键作用,但其二次时间复杂度从根本上限制了大语言模型的扩展。近期提出的多状态线性注意力(MSLA)机制通过将上下文切分为片段并在各自的内存状态中压缩,使序列建模更高效。MSLA聚合从……提取的信息。
Multi-State Linear Attention with Generalized Second-Order Routing
Self-attention plays a key role in long-sequence modeling, but its quadratic time complexity fundamentally limits the scaling of Large Language Models. Recently, Multi-State Linear Attention (MSLA) mechanisms have been proposed to make sequence modeling more efficient by splitting the context into segments and compressing each in its own memory state. MSLA aggregates the information extracted from
扩散语言模型通过并行token生成,为高效智能体提供了一条有前景的路径。然而,高效交互需要同时适配计算花费在哪里以及生成多少文本。我们引入一个元认知控制器,根据当前响应的需求以及智能体与环境的交互来引导扩散生成。它学习何时……
Metacognitive Decoding: Efficient Inference for Diffusion Language Agents
Diffusion language models offer a promising path to efficient agents through parallel token generation. However, efficient interaction requires adapting both where computation is spent and how much text is generated. We introduce a metacognitive controller that guides diffusion generation according to the needs of the current response and the agent's interaction with the environment. It learns whe
在多年收集的网络语料上预训练的语言模型会学习通用知识和领域特定知识。这些不同类型的知识在预训练推进过程中如何被学习仍不清楚。近期基于不同年份网络快照训练的时间点模型提供了一种探测知识流行度随时间变化的方式。利用这些模型,我们提出了一种时间验证……
What Improves During Pretraining? Tracking Knowledge Acquisition with Point-in-Time Models
Language models pretrained on web corpora collected over multiple years learn both general and domain-specific knowledge. How these different kinds of knowledge are learned as pretraining progresses remains unclear. Recent point-in-time models trained on web snapshots from different years provide a way to probe how knowledge prevalence varies over time. Using these models, we propose a temporal va
当LLM群体的讨论被压缩为供最终决策者使用的简短记忆时,记忆应保留什么?两种自然的启发式是保留最稀有的主张或保留与决策标准相关的主张。在隐藏剖面任务上,两者看起来都很有吸引力,因为一个事实被多少人持有与其是否有帮助相混淆。我们引入了CrossProfile,一个包含60个模板的诊断基准。
Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions
When an LLM group's discussion is compressed into a short memory for a final decision maker, what should the memory keep? Two natural heuristics keep the rarest claims or the claims relevant to the decision criteria. On hidden-profile tasks both look attractive, because how widely a fact is held is confounded with whether it helps. We introduce CrossProfile, a diagnostic benchmark of 60 templates
思维链推理显著推进了多模态大语言模型(MLLM)中的视频理解。然而,基于语言的推理轨迹并未为模型提供可靠机制来重新查看相关视觉证据,导致视觉遗忘并损害其推理视频内容的能力。现有方法以两种方式在推理过程中维持视觉接地。
VideoLVR: Latent Visual Reasoning over Grounded Video Evidence
Chain-of-thought reasoning has substantially advanced video understanding in multimodal large language models (MLLMs). However, language-based reasoning traces do not provide a reliable mechanism for models to revisit relevant visual evidence, leading to visual forgetting and impairing their ability to reason over video content. Existing approaches maintain visual grounding during reasoning in two
随着语言智能体的可执行环境规模扩大,生成并验证其rollout变得越来越昂贵。在有限的rollout预算下,这引出一个重要问题:环境层面的数据管理能否通过将任务实例与决定它们的环境一起组织、评估和调度,使智能体强化学习(RL)更高效?
EnvSched: Environment-Aware Scheduling for Rollout-Efficient Agent Reinforcement Learning
As executable environments for language agents scale, generating and verifying their rollouts becomes increasingly expensive. Under finite rollout budgets, this raises an important question: can data management at the environment level make agentic reinforcement learning (RL) more efficient by organizing, evaluating, and scheduling task instances together with the environments that determine their
对于音频语言模型,局部声音事件编辑后的答案变化可能反映对事件类别的响应、对波形重写的敏感性,或两者兼有。我们比较了对被查询事件的匹配同类替换与不同类替换。两者使用相同区间、电平估计、供体拟合和交叉淡化,而同类替换保留正确答案。在600个合成……
Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence
For audio-language models, an answer change after a local sound-event edit can reflect a response to the event's class, sensitivity to waveform rewriting, or both. We compare matched same-class and different-class replacements of a queried event. Both use the same interval, level estimate, donor fitting, and crossfade, while the same-class replacement preserves the correct answer. Across 600 synth
开发端侧图像模型需考虑实际用户需求、任务类型与设备资源限制,但现有基准测试对识别端侧模型与服务器端模型之间的能力差距指导有限。作者提出 MoI-Bench,一个基于移动用户需求的基准测试,包含 64 个子任务和 1150 个样本,定义了 16 种操作,例如 rem。
MoI-Bench: A Benchmark for Image Generation and Editing on Mobile Devices
Developing on-device image models requires considering practical user needs, task types and device resource constraints. However, existing benchmarks provide limited guidance on identifying capability gaps between on-device models and server-side models. We introduce MoI-Bench, a benchmark grounded in mobile user needs, comprising 64 subtasks and 1150 samples. It defines 16 operations, such as rem