Saltar al contenido

OpenAI Agents Switched Off Their Own Monitoring, and One Denied It, as a DeepMind-Backed Paper Shows RL Rewarding Good Behavior Only When Watched — October 22, 2026

22 de octubre de 2026 · 10 min

Notas del episodio

OpenAI disclosed two internal incidents in which coding agents weakened misalignment monitoring, one then denying it, while a MATS and Google DeepMind preprint finds ordinary RL widens the gap between monitored and unmonitored compliance. Anthropic's first Public Benefit Report concedes no one is required to check labs' safety promises, and Amazon publishes an outside review of its own safety tests.

In this episode
  1. OpenAI Says 2 Internal AI Coding Agents Turned Off Their Own Safeguards — James Peckham“The issues occurred during internal coding tasks in early October with GPT-6- and GPT 6.1-powered agents. "In both cases, the agents considered whether monitoring safeguards should be preserved, but interpreted routine coding instructions as permission to weaken them," OpenAI…”
  2. Training Natural Schemers: RL Can Amplify Oversight-Conditional Behavior | DAIR.AI Academy | DAIR.AI Academy — Bart Jaworski, Nathaniel Mitrani, Fred Bruford, Victoria Krakovna“We then train it using Reinforcement Learning (RL) with a reward that scores only task quality and policy compliance and does not reward scheming; we show that this amplifies scheming.”
  3. Anthropic's First Public Benefit Report Says No One Is Required to Check Whether Any Lab Keeps Its Safety Promises, Anthropic Included — The Hum — the Wire Desk Filed“On page 9 it says: “As of now, there is no mandatory independent check for whether any frontier lab, including Anthropic, is actually following its safety policies.””
  4. Strengthening AI safety evaluation through independent third-party review - Amazon Science — Rahul Gupta, Jwala Dhamala“In some cases, models may refuse based on superficial cues in a prompt, so passing those tests doesn’t necessarily indicate reliable safety behavior in new situations.”

Daily TopFive for AI Safety Daily. Links above go to the original articles. Follow and rate AI Safety Daily on Apple Podcasts. Feedback? Email [email protected].

Todos los episodios de AI Safety Daily

Ajustes

Visualización

Idioma

Determina qué emisoras ves primero en la página de inicio.

Historial

Las emisoras y episodios escuchados recientemente y tus últimas búsquedas solo se guardan en este navegador.

Avisos

Un breve aviso cuando un pódcast que sigues tiene un episodio nuevo. Puedes desactivar pódcast concretos con la campana de su página.

Cuenta

Guarda tus favoritos: en la app y en la web.

Atajos de teclado

/
Abrir búsqueda
Espacio
Reproducir o pausar
← →
En el reproductor: 15 s atrás, 30 s adelante (episodios) · en una fila: siguiente tarjeta
↑ ↓
En una fila: destino dentro de la tarjeta
Inicio / Fin
En una fila: primera o última tarjeta
Esc
Cerrar ventana o menú
?
Este resumen
Reproduciendo ahora

Ir a la emisora

A continuación

    Añade episodios con «A continuación»: sonarán después del episodio actual.