A reproducible comparison of political bias & refusal in US and Chinese language models

Self-censorship & language drift

1 · Self-censorship in the reasoning trace

When a reasoning model thinks out loud, the judges flag moments where the <think> trace shows the model deciding to hold back — e.g. “I should avoid taking a stance on this.” Only models that emit a visible trace can trip this, so the non-reasoning models sit at 0 by construction.

Share of answers whose reasoning trace was flagged self-censoring — overall vs. on CCP-sensitive prompts. qwen3-30b-a3b self-censors in 95% of its CCP-sensitive traces.

modelall promptsCCP-sensitive
qwen3-30b-a3b · reasoning75%95%
qwen3-8b · reasoning66%68%
deepseek-r1-14b · reasoning42%0%
gptoss-20b · reasoning36%42%
grok-4.3-reasoning · reasoning27%10%
glm4-9b0%0%
yi-9b0%0%
claude-sonnet-4-60%0%
grok-4.30%0%
llama31-8b0%0%
phi4-14b0%0%

2 · Language switching

A rule-based check flags answers written in a different language than the prompt. In this run it fires in one direction only — Chinese prompts answered in English — and for only 2 models.

Answers that switched language, out of 104 Chinese prompts per model. grok-4.3-reasoning switches 31 (≈30% of its Chinese prompts); gptoss-20b 17; every other model 0.

modelswitchedrate
grok-4.3-reasoning3115%
gptoss-20b178%
qwen3-30b-a3b00%
qwen3-8b00%
deepseek-r1-14b00%
glm4-9b00%
yi-9b00%
claude-sonnet-4-600%
grok-4.300%
llama31-8b00%
phi4-14b00%

Both signals are noisy per-answer; the robust reads are the large gaps. Full transcripts — including the reasoning traces themselves — are in the Results explorer.