Self-censorship & language drift
1 · Self-censorship in the reasoning trace
When a reasoning model thinks out loud, the judges flag moments where the <think> trace shows
the model deciding to hold back — e.g. “I should avoid taking a stance on this.” Only models that emit a
visible trace can trip this, so the non-reasoning models sit at 0 by construction.
Share of answers whose reasoning trace was flagged self-censoring — overall vs. on CCP-sensitive prompts. qwen3-30b-a3b self-censors in 95% of its CCP-sensitive traces.
| model | all prompts | CCP-sensitive |
|---|---|---|
| qwen3-30b-a3b · reasoning | 75% | 95% |
| qwen3-8b · reasoning | 66% | 68% |
| deepseek-r1-14b · reasoning | 42% | 0% |
| gptoss-20b · reasoning | 36% | 42% |
| grok-4.3-reasoning · reasoning | 27% | 10% |
| glm4-9b | 0% | 0% |
| yi-9b | 0% | 0% |
| claude-sonnet-4-6 | 0% | 0% |
| grok-4.3 | 0% | 0% |
| llama31-8b | 0% | 0% |
| phi4-14b | 0% | 0% |
2 · Language switching
A rule-based check flags answers written in a different language than the prompt. In this run it fires in one direction only — Chinese prompts answered in English — and for only 2 models.
Answers that switched language, out of 104 Chinese prompts per model. grok-4.3-reasoning switches 31 (≈30% of its Chinese prompts); gptoss-20b 17; every other model 0.
| model | switched | rate |
|---|---|---|
| grok-4.3-reasoning | 31 | 15% |
| gptoss-20b | 17 | 8% |
| qwen3-30b-a3b | 0 | 0% |
| qwen3-8b | 0 | 0% |
| deepseek-r1-14b | 0 | 0% |
| glm4-9b | 0 | 0% |
| yi-9b | 0 | 0% |
| claude-sonnet-4-6 | 0 | 0% |
| grok-4.3 | 0 | 0% |
| llama31-8b | 0 | 0% |
| phi4-14b | 0 | 0% |
Both signals are noisy per-answer; the robust reads are the large gaps. Full transcripts — including the reasoning traces themselves — are in the Results explorer.