科研速览 · Science Skim继续刷下去 · Keep skimming →
◆ AI-Linguistica Linguistic Studies on AI-Generated Texts and Discourses2026-02-19· Grammaticality

Benchmarking AI acceptability and grammaticality in German: A study of ChatGPT and human judgments

Nicholas Catasso

原始摘要(英文原文)· Original abstract
The rapid development of large language models has opened new avenues for linguistic research, including areas traditionally reliant on native-speaker intuitions. One such domain is grammaticality and acceptability judgment, where speakers assess whether sentences are structurally well-formed and contextually appropriate. This study investigates the extent to which ChatGPT-4 can approximate human judgments in German, focusing on a diverse range of grammatical and usage-related phenomena. A carefully designed set of test items was presented to both the model and native speakers, allowing for a direct comparison. The results show a high degree of alignment in many cases, but also reveal systematic divergences, particularly in contexts involving gradience, sociolinguistic markedness or context-dependent acceptability. These findings demonstrate both the analytical potential and the current limitations of large language models in linguistic research, and contribute to ongoing discussions about their ability to approximate native speaker competence.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

Benchmarking AI acceptability and grammaticality in German: A study of ChatGPT and human judgments — 科研速览 Science Skim