Claude Discovery

← All discoveries

Vivid, blurred close-up of colorful code on a screen, representing web development and programming.
Photo by Markus Spiske on Pexels
library

Qwen 3.8 27B: Great Benchmarks, Terrible Habit of Overthinking Everything

2026-08-18 ยท source:

Qwen 3.8 27B, an Apache 2.0 licensed vision-capable model from Alibaba, scores 52 on the Artificial Analysis Intelligence Index, matching GPT-5.6 Luna and trailing GLM-5.2 and DeepSeek V4 Pro by one point despite being far smaller.

What it is

Qwen 3.8 27B is Alibaba's Qwen research lab's newest openly licensed vision-capable LLM, sized to run on a well-specced laptop.

What it does

It scores 52 on the Artificial Analysis Intelligence Index, matching GPT-5.6 Luna and landing one point behind GLM-5.2 (753B parameters) and DeepSeek V4 Pro 0813 (1.7 trillion parameters), both vastly larger models. Simon Willison notes it is excellent but defaults to wildly overthinking straightforward requests, generating far more reasoning than the task needs.

Why it matters

A 27B model scoring within a point of models 20 to 60 times its size is a genuine efficiency story, but the overthinking tendency means raw benchmark scores don't tell you what it'll cost you in tokens and latency for everyday use, an alternative to running one of the much larger models locally if you can tolerate tuning its reasoning budget.

How to use it

Download Qwen 3.8 27B from Hugging Face and run it locally via LM Studio or a compatible inference server; expect to tune reasoning effort to control overthinking.

Go to source →
llmopen-weightsbenchmark