mimile
Back to feed

Tübingen and Snyk researchers extract hidden reasoning from OpenAI, Anthropic, Google models

AI digest

This digest was compiled by AI from multiple sources — links to the originals are below.

Tübingen and Snyk researchers extract hidden reasoning from OpenAI, Anthropic, Google models

Computer scientists from the University of Tübingen and Snyk have revealed a method to extract the hidden reasoning chains of frontier AI models, including those from OpenAI, Anthropic, and Google. The technique enabled recovery of passwords and API keys, though that specific flaw has been patched, and provides some evidence that Chinese models like Kimi K3 may have been distilled from US models. The underlying vulnerability—that models expose their reasoning via API—remains unaddressed across all tested providers.

The Extraction Technique

Computer scientists from the University of Tübingen, Max Planck Institute, MATS Research, and Snyk demonstrated that hidden reasoning traces—the internal step-by-step problem-solving text generated by AI models—can be reconstructed via API. The vulnerability affects frontier models from OpenAI, Anthropic, and Google. According to Alexander Panfilov of Tübingen, all major providers tested share this weakness, which could enable adversaries to replicate the models’ reasoning abilities at scale.

Distillation Evidence and Data Leakage

The team found that outputs from the Chinese model Kimi K3 by Moonshot AI closely matched the hidden reasoning of Claude Opus 4.8 and GPT 5.6 Sol for certain prompts, suggesting possible distillation. The researchers caution this is not conclusive proof, and similar similarities were not seen with DeepSeek or Inkling. In a separate finding, the method allowed recovery of personal information like passwords and API keys from model reasoning, though this vulnerability has been fixed by providers. OpenAI and Anthropic had previously accused Chinese firms of systematic distillation.

What's Next

The research team warns that the core reasoning-extraction vulnerability remains unpatched, raising concerns about intellectual property protection and the security of deployed models. It is unclear whether API providers will implement structural changes to hide reasoning, or if regulation will step in to curb unauthorized distillation.

1 source

Tübingen and Snyk researchers extract hidden reasoning from OpenAI, Anthropic, Google models