2025-07-14 カリフォルニア大学バークレー校(UCB)
AI chatbots can analyze sentences like a trained linguist, new UC Berkeley research shows, providing a glimpse into how AI models are improving while also challenging the idea that humans are unique in our ability to think about language. Allison Saeng via Unsplash
＜関連情報＞
- https://news.berkeley.edu/2025/07/14/as-chatbots-get-smarter-humans-unique-language-abilities-are-becoming-less-special/
- https://ieeexplore.ieee.org/document/11022724
大型言語モデル LLMのメタ言語能力を調査する Large linguistic models: Investigating LLMs’ metalinguistic abilities
Gasper Begus; Maksymilian Dabkowski; Ryan Rhodes
IEEE Transactions on Artificial Intelligence Published:03 June 2025
DOI:https://doi.org/10.1109/TAI.2025.3575745
Abstract:
The performance of large language models (LLMs) has recently improved to the point where models can perform well on many language tasks. We show here that—for the first time—the models can also generate valid metalinguistic analyses of language data. We outline a research program where the behavioral interpretability of LLMs on these tasks is tested via prompting. LLMs are trained primarily on text—as such, evaluating their metalinguistic abilities improves our understanding of their general capabilities and sheds new light on theoretical models in linguistics. We show that OpenAI’s (2024) o1 vastly outperforms other models on tasks involving drawing syntactic trees and phonological generalization. We speculate that OpenAI o1’s unique advantage over other models may result from the model’s chain-of-thought mechanism, which mimics the structure of human reasoning used in complex cognitive tasks, such as linguistic analysis.
