Is AI progress slowing down?
https://simonwillison.net/2024/Dec/19/is-ai-progress-slowing-down/#atom-everything
For example, if a model works poorly in translating to a low-resource language because it isn’t aware of idiomatic phrases in that language, the model can’t reason its way out of this.