Skip to content

HOAI 6: Will AI Tell You When You're Wrong? - We Push Back on ChatGPT to See If It Caves

November 5, 2026 · 32 min

Show notes

Chatbots have a reputation for telling you what you want to hear. Mikah Sargent tests that by telling ChatGPT it's wrong when it's right. Then he tells one made-up argument twice, with the same facts and only the teller changed, and pushes back on the verdict. He explains what researchers call sycophancy, one way training can encourage the habit, and why it can be easy to miss. Then he shares four habits for questioning the answer.

Send your AI questions to [email protected]

Host: Mikah Sargent

Download or subscribe to Hands-On AI at https://twit.tv/shows/hands-on-ai

Want access to the ad-free audio and video and exclusive features? Become a member of Club TWiT today! https://twit.tv/clubtwit

Club TWiT members can discuss this episode and leave feedback in the Club TWiT Discord.

Sponsor:

All episodes of Hands-On AI (Audio)

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.