安德森角
为什么AI-Gened Text比你想的更难理解
在 Google 上的首选来源中添加 Unite.AI
AI模式可能越来越难以理解，因为其培训越来越能有效解决问题，而不是对人类作出明确解释。
以上未经编辑的句子由ChatGPT根据一份科学论文的ELI5单一判决摘要的请求所写；它至少具备了该新研究* 所解释的几种语言管理特征。 新作的结论是，这个问题影响到所有前沿模型，以及近前沿模型，以及一些也经过测试的开放权重模型。
例如，" 他们的培训越来越能有效地解决问题 " 部分的早期部分就说明了文件的立场，即AI模型有时会给予非活的东西人类的行动(因为 " 培训 " 在上述例子中被描述为积极奖励的东西)。
这可能会妨碍快速解析该短语，因为我们必须在内部承认归属是一种说明方法，而不是从字面上理解(这简单得多).
后一节“日益奖励高效解决问题”也挤压了数个想法，迫使读者想出什么得到奖励，什么得到解决，什么效率提高。
该文件指出：
`[读取]在解析时使用动画作为提示，如果没有额外的上下文，不匹配可能会引起与再分析相联的P600响应'.
`然而，为避免无生命的主体而改写这些句子，可能要求延长句子：例如，“bites”一词代表“一个问题”。
`我们推测，在训练期间，模型可能已经趋于一致，将这种构象作为有效、尽管不是标准的方式来表达本来会占用更多象征意义的含义。 '
说什么？
这是论文的核心 – 由于ChatGPT,Claude和Gemini等现代AI模型被优化用于多种类型的问题解决，而不是特定的通信，它们倾向于以非常压缩的有效载荷的形式交付语言，需要一些解码。
这让我感到惊讶，因为我不断试图说服ChatGPT和它的同龄人少用动词，更压缩，这个问题在文献中得到承认和解决。
相反，论文提出动词是一种拉链炸弹，即使用不长的句子也阻止容易理解。 因此，如果将超长的默认答复长度的双重问题与纸张对过度压缩的看法结合起来，我们可以想象，前沿AI默认答复风格的特征模式是相当不同的(而且，大概这种比较短的样式被部分地用作探测器中AI生成文本的决定因素，尽管论文没有涉及这一点)。
作者还检查了堆叠的名词复合物，以有问题的短语Squad帮助狗咬'为例：
‘在英语中，名词以形容的方式自由修改了其他名词：在"咖啡店"的短语中，咖啡修改了商店，尽管通常作为名词出现。 这个特性可以将多个名词堆放成富含复合词，表示高度具体的含义。
但是，这些堆叠可能会造成括号模糊，如头条小队帮助狗咬伤受害者，并扰乱阅读。
因此，如果LLMs是通过压缩来作动词的，它们是否通过产生过多的压缩文本来响应一个查询而成为双动词？这意味着，不仅在回答您的询问时需要读取大量文本，而且文本本身可能有很多需要解码的"隐含"含义。
2023年的一篇论文认为，LLMs可以不必要地成为动词，因为AI法官在培训期间被使用，因为这些往往奖励更长的答案 — — 即使人类更喜欢在研究测试中更短的答案。
新作"属性"的作者们(参见前引) 边疆模型的一些压缩倾向，为了省取道具而向建筑的处置，这已经是现在一个慷慨的想法了。
让我们看看作者为研究进行的方法、数据和测试。
数据和方法
不寻常的单词组合(用n-克来测量，或用词序列)因其不可预测性被调查，罕见的组合与阅读难度较大有关。
依赖长度(语法上相接的单词之间的距离)也被测量出，因为较长的距离对工作记忆提出了更大的要求——特别是当一个主题及其动词被几个介入词相隔时。
审查了对象相对条款(如 " 承包商所建房屋 " 等建筑)，特别是在省略了 " 承包商所建房屋 " (如 " 承包商所建房屋 " 中的 " 该 " )任择词时。
上文提到的Stacked名词复合体(三个或三个以上的名词合在一起，如 " 恐怖电影音轨生成器 " )也得到了调查，因为其组成词之间的关系可能模糊不清。
副词(作为动词使用的名词，例如 " 叉子 "，而不是 " 把它放在叉子上 " )和与通常与活物相关的动词对齐的无生命主体(如前所述)一起被研究。 两种构造都允许将意义压缩为较少的词，但可能需要读者的额外解释。
参赛者
研究人员收集了来自14个模型的AI生成的对话；Kimi K2.5;GLM 5;Claude Sonnet 5,Opus 5,Opus 5.5和Fable 5;GPT-5.6 Luna, Terra and Sol;Olmo Base，教与想；和Llama Base和教与想。
测试包括一般对话的十个起步提示和编码的五个起步提示，每个任务都需要一个模型来克隆一个真正的公用GitHub寄存器，找到bug，并将其固定在一个沙盒中。
对话限于12个交流，而编码会议限于11个，然后是固定的闭幕电文。 在单独的测试中，要求每个模型根据PERSUADE 2.0数据集的任务写出七篇散文。
为了比较起见，从尽可能与AI出品相匹配的来源中抽取了人文文字：OpenSubtitles(与开源子平台无关的电影和电视字幕集)用于一般对话；StackExchange(问答论坛在线网络)用于编码讨论；以及来自上述PESUADE 2.0数据集的学生作文用于编写任务。 维基百科也被用作额外的比较来源。
在有适当的人类数据的情况下，在人类和AI生成的文本中也测量了同样的语言特征，这些参考文献也用于评估词组的频率。
圆通翻译(英文为日文并回译，使用NLLB-200模式)被用来区分风格偏好和语言必要性。 在修改句子结构的同时，基本上保留了意义，从而可以确定不必要的复杂措辞。
结果
实验1
如下所示，在最初AI生成的文本中，特别是在前沿模型中，发现一些困难的构造更为频繁。 这被解释为倾向于采用不必要的复杂措辞：
在三个场合(聊天、编码和作文)对14个AI模型的6个语言特征进行了比较。 在聊天中测试了12个模型，在编码中测试了9个模型，在作文中测试了全部14个模型：
最初AI生成的文本也与其再翻译版本进行了比较，使得句子结构的差异可以被测量：
边疆和相近边疆模型被发现过度使用不寻常的词组组合，去名动词，无生命主体和有可选词省略的对象相对条款(见上文图). 这些倾向在Llama和Olmo Base中普遍较弱，但在Olmo Think中更为明显。
在散文写作上观察到的差异小于聊天或编码，这归功于散文的单发性，语言压缩性更强，有可能被延伸后发对话所鼓励。
提交人指出：
:"PESUADE散文"在"圆通"翻译下，在多个类别(n-克度量，依赖长度，堆起名词，去名动词)相对于聊天和[编码]显示较小的变化。
我们假设这是因为他们只涉及一个瞬间，我们推测某些模式可能出现在长时间回回对话中(这可能需要更多的信息压缩 )。
翻译后变化最小的是Llama和Olmo Base and Instruct，在词组和动词用法上也最接近学生作文。 相比之下，奥尔莫想被发现行为更像边疆模型。 Claude Opus 5.5在21个比较中19个比Opus 5使用难度更小的构造，其中8个没有重叠95%的置信间隔。
实验2
第二项实验旨在测试产生更短、更清晰的信息反应的潜在压力是否会使模型更倾向于语言构造，使人类更难以理解。
在此，Qwen2.5-1.5B-Instruct使用Group Represent Policy Optimation(GRPO)进行了微调，并负责将结构化，JSON格式化的事件描述转换为英语句子的模式。
经调整的训练的两个方面是：该模式在多大程度上被允许改变其通常的词语选择(β)；以及它因产生较长的答复而受到多大的处罚(λ)。 每个事件都可以用两种语法验证的方式表示，在符号计数上已知的区别。
例如，`他给我们发了相片'需要6个符号，而`他给我们发了相片'需要7个符号。 还使用了单独的测试方法，其中两种说出相同事物的方法要求相同的符号数量，以检查差异是否由句子长度所引起。
对以前未见的句子进行了试验，使用了在培训期间遇到的四种构造；两种未经训练的构造，其中一种是可选用 " 那种 " 一词；另一种是涉及占有者、限定者、被动者和目的条款的无关构造。
测试的目的是确定是否愿意采用较短的措辞，并结转到培训期间从未遇到过的建筑中：
由于对较长答复的处罚有所增加，因此选择更短的措词更为频繁(直接在上文中提及)。 如果没有KL分罚(限制模型偏离其最初的词预测的距离)，变化会很快；随着它，同样的效果被更逐渐地观察到。 没有两种处罚，在培训期间的偏好差别很大，但即使刑期很短，也始终倾向于采用较短的替代办法。
在以前未见的句子中也注意到这种倾向，这些句子涉及任择 " that " 一词。 向更远的语法构造的转移要弱得多，只有在没有KL处罚的情况下才对占有者产生影响。
提交人的结论是：
‘我们把这些结果作为概念的证明，在用GRPO进行强化学习时使用的长度惩罚可以直接影响语法特征。
:"我们注意到，该模型没有被直接指示使用压缩或稠密的语言，也没有直接获得关于能否获得合成交替的信息。
“相反，这种惩罚导致人们突然偏好较短的混合体成员。”
结论
我对AI所生成的文本具有一定时间特点的主播感兴趣，因此，这一新的提议揭示了LLMs所注意到的动词与他们现在同样注意到的压缩倾向之间的明显冲突。
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Anderson's Angle
Why AI-Generated Text Is Harder to Understand Than You Think
Add Unite.AI to your preferred sources on Google
AI models may be becoming harder to understand because their training increasingly rewards solving problems efficiently rather than explaining things clearly to humans.
The above, unedited sentence was written by ChatGPT in response to a request for an ELI5, single-sentence summary of a science paper; and it features at least a few of the language-mangling traits explained in that new study*. The new work concludes that this issue affects all frontier models, as well as near-frontier models, and some open-weights models that were also tested.
For instance, the early part of the segment ‘their training increasingly rewards solving problems efficiently’ exemplifies the paper’s stance that AI models sometimes give non-living things human actions (since ‘training’ is described in the above example as actively rewarding something).
This can impede quick parsing of the phrase, as we have to internally acknowledge the attribution as an illustrative method, rather than take it literally (which is much simpler).
The latter section ‘increasingly rewards solving problems efficiently’ also squeezes several ideas together, forcing readers to work out what’s being rewarded, what’s being solved, and what’s becoming more efficient.
The paper states†:
‘[Readers] use animacy as a cue during parsing, and without additional context, a mismatch may elicit a P600 response†† associated with reanalysis.
‘However, rephrasing these sentences to avoid inanimate subjects would potentially require lengthening the sentence: for example, the word “bites” stands in for “causes an issue”.
‘We speculate that during training, models may have converged to using such constructions as efficient, albeit non-standard, ways of expressing meaning which would otherwise take up more tokens.’
Say What?
This is the core of the paper – that because modern AI models such as ChatGPT, Claude and Gemini are optimized for multiple types of problem-solving rather than specifically for communication, they tend to deliver language in the form of very compressed payloads that need some decoding.
This was a surprise to me, as I am constantly trying to persuade ChatGPT and its peers to be less verbose, and more compressed – a problem that is recognized and addressed in the literature.
Instead, the paper presents verbosity as a kind of zip-bomb that prevents easy understanding even in a sentence that is not very long. Therefore, combining the twin issues of excessive default reply length with the paper’s observation about excessive compression, we can imagine that the characteristic pattern of frontier AI’s default response style is quite distinct (and, presumably, this rather terse style is used in part as a determinant for AI-generated text in detectors, though the paper does not deal with this).
The authors also examine stacked noun compounds, exemplified in the problematic phrase Squad Helps Dog Bite†:
‘In English, nouns freely modify other nouns in an adjectival way: in the phrase coffee shop, coffee modifies shop, despite usually appearing as a noun. This feature enables stacking multiple nouns into rich compound words which denote highly specific meanings.
However, such stacks can introduce bracketing ambiguity, as in the headline Squad Helps Dog Bite Victim, and disrupt reading.’
So if LLMs are verbose via compression, are they being doubly verbose by producing excessive volumes of compressed text in response to a query? That means that not only is there a great deal of text to read through in response to your query, but the text itself may have a lot of ‘implicit’ meaning that needs decoding.
One 2023 paper posited that LLMs can become unnecessarily verbose due to AI judges being used during training, since these often reward longer answers – even when humans preferred shorter ones, in the study’s tests.
The authors of the new work attribute (see earlier quote) some of the compressive tendencies of frontier models to an architectural disposition to save tokens, which is a generous thought these days.
Let’s take a look at the methods, data and tests run by the authors for the study.
Data and Methods
Unusual word combinations (measured through n-grams, or sequences of words) were investigated for their unpredictability, with rare combinations associated with greater reading difficulty.
Dependency length (the distance between grammatically-connected words) was also measured, since longer distances place greater demands on working memory – particularly when a subject and its verb are separated by several intervening words.
Object relative clauses (constructions such as ‘the house the contractors built’) were examined, particularly when optional words were omitted (such as ‘that’ in ‘the house that the contractors built’).
The aforementioned Stacked noun compounds (three or more nouns joined together, as in ‘horror movie soundtrack generator’) were investigated as well, because the relationships between their component words can be ambiguous.
Denominal verbs (nouns used as verbs, such as ‘fork it’ instead of ‘put it on the fork’) were examined, alongside inanimate subjects paired with verbs normally associated with living things (as discussed earlier). Both constructions allow meanings to be compressed into fewer words, but additional interpretation may be required from readers.
The Contenders
The researchers collected AI-generated conversations from 14 models; Kimi K2.5; GLM 5; Claude Sonnet 5, Opus 5, Opus 5.5, and Fable 5; GPT-5.6 Luna, Terra and Sol; Olmo Base, Instruct and Think; and Llama Base and Instruct.
The tests comprised ten starting prompts for general conversation, and five for coding, with each task requiring a model to clone a real public GitHub repository, find bugs, and fix them in a sandbox.
Conversations were limited to 12 exchanges, while coding sessions were limited to 11, followed by a fixed closing message. In a separate test, each model was asked to write seven essays based on assignments from the PERSUADE 2.0 dataset.
For comparison, human-written texts were drawn from sources matched as closely as possible to the three types of AI output: OpenSubtitles (a collection of film and television subtitles unrelated to the open source subs platform) was used for general conversation; StackExchange (the online network of question-and-answer forums) for coding discussions; and student essays from the aforementioned PERSUADE 2.0 dataset for the writing tasks. Wikipedia was also used as an additional comparison source.
Where suitable human data was available, the same linguistic features were measured across human and AI-generated text, with these reference collections also used to assess the frequency of word combinations.
Round-trip translation (English to Japanese and back, using the NLLB-200 model) was used to distinguish stylistic preferences from linguistic necessity. Meaning was largely preserved while sentence structure was changed, allowing unnecessarily complex wording to be identified.
Results
Experiment 1
As shown below, several difficult constructions were found more frequently in the original AI-generated text, particularly among frontier models. This was interpreted as evidence of a preference for unnecessarily complex phrasing:
The six linguistic features were compared across 14 AI models in three settings (chat, coding and essay writing). Twelve models were tested in chat, nine in coding and all 14 in essay writing:
The original AI-generated text was also compared with its retranslated versions, allowing differences in sentence structure to be measured:
Frontier and near-frontier models were found to over-use unusual word combinations, denominal verbs, inanimate subjects and object relative clauses with optional words omitted (see graph above). These tendencies were generally weaker in Llama and Olmo Base, but were more pronounced in Olmo Think.
Smaller differences were observed in essay-writing than in chat or coding, which was attributed to the single-prompt nature of essays, with greater linguistic compression potentially encouraged by extended back-and-forth conversations.
The authors note:
‘The PERSUADE essays show smaller changes under round-trip translation on several categories (n-gram measures, dependency lengths, stacked nouns, denominal verbs) relative to chat and [coding].
‘We hypothesize that this is because they involve a single prompt, unlike the many iterated turns of chat and coding. We speculate that certain patterns may emerge in long back-and-forth conversations (which may demand more information compression).’
The least change after translation was found in Llama and Olmo Base and Instruct, which also came closest to student essays in their word combinations and verb usage. In contrast, Olmo Think was found to behave more like the frontier models. Claude Opus 5.5 was observed to use fewer difficult constructions than Opus 5 in 19 out of 21 comparisons, with non-overlapping 95% confidence intervals in eight of those.
Experiment 2
The second experiment was designed to test whether an underlying pressure to produce shorter and more information-dense responses might cause models to prefer linguistic constructions harder for humans to understand.
Here, Qwen2.5-1.5B-Instruct was fine-tuned using Group Relative Policy Optimization (GRPO), and the model tasked with converting structured, JSON-formatted descriptions of events into English sentences.
The two aspects of training adjusted were how much the model was allowed to change its usual choice of words (β); and how strongly it was penalized for producing longer responses (λ). Each event could be expressed in two grammatically-valid ways, with a known difference in token count.
For example, ‘He sent us a photo’ required six tokens, compared with seven for ‘He sent a photo to us’. A separate test was also used in which two ways of saying the same thing required the same number of tokens, to check whether differences were caused by sentence length.
The effect was tested on previously unseen sentences using four constructions encountered during training; two untrained constructions involving the optional word ‘that’; and unrelated constructions involving possessives, quantifiers, passives and purpose clauses.
The tests were designed to establish whether a preference for shorter wording would be learned and carried over into constructions never encountered during training:
As the penalty for longer responses was increased, shorter wording was chosen more often (illustrated directly above). Without the KL penalty (a restriction on how far the model could depart from its original word predictions), the shift was rapid; with it, the same effect was observed more gradually. Without either penalty, preferences varied widely between training runs, but even a small length penalty produced a consistent preference for shorter alternatives.
This preference was also observed in previously unseen sentence constructions involving the optional word ‘that’. Transfer to more distant grammatical constructions was much weaker, with an effect found only for possessives when the KL penalty was absent.
The authors conclude:
‘We take these results as a proof of concept that a length penalty used during reinforcement learning with GRPO can directly affect grammatical features.
‘We note that the model was not directly instructed to use compressed or dense language, and was not directly given information about the availability of syntactic alternations.
‘Rather, the penalty resulted in an emergent preference for shorter members of syntactic alternations.’
Conclusion
I have been interested in the anchors – both inadvertent and intentional – that characterize AI-generated text for some time. Therefore this new offering sheds some light on the apparent conflict between LLMs’ noted verbosity and their now equally-noted tendency to comp
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.