Skip to content

How AI Decides What to See and What to Ignore

September 25, 2026 · 31 min

Show notes

👁️ How does artificial intelligence decide what to see?

Your eyes can look directly at something without your brain ever noticing it. AI faces a similar problem. A camera may capture every pixel, but the system must still decide which parts of an image matter and which parts it can safely ignore.

In this episode of A Beginner’s Guide to AI, we examine spatial attention in humans and visual attention in artificial intelligence. You will learn how the brain uses a mental spotlight, why seeing is not the same as noticing, and how attention mechanisms help computer vision systems process complex images.


We also investigate the limitations of AI attention. A model can identify the correct object for the wrong reason, use backgrounds as shortcuts, or create a convincing heatmap without truly understanding the scene.


🏥 Our central case study follows the collaboration between Google DeepMind and Moorfields Eye Hospital. Their medical AI system analysed three-dimensional OCT retinal scans, created detailed tissue maps, and recommended how urgently patients should be referred. It performed at a level comparable with leading specialists in a retrospective test. Then a different scanner caused its accuracy to fall dramatically.

The anatomy had not changed. The machine’s view of it had.


🔍 Key highlights:

  • How spatial attention filters human perception
  • How AI decides where to look
  • Spatial attention compared with self-attention
  • Why vision transformers connect distant image regions
  • The limitations of saliency maps and AI heatmaps
  • How AI retinal scans can support medical specialists
  • Why machine vision fails when devices or environments change
  • How humans and AI can compensate for each other’s blind spots


📧💌📧

Tune in to get my thoughts and all episodes, and don’t forget to subscribe to our newsletter: beginnersguideto.ai

📧💌📧


Quotes from the Episode
  • “Spatial attention begins with a simple problem: there is too much world and not enough brain.”
  • “The anatomy had not changed. The machine’s view of it had.”
  • “Every spotlight reveals something. Every spotlight also leaves something in the dark.”


About Dietmar Fischer

Dietmar is a podcaster and digital marketer from Argo.berlin. If you want to get your AI or digital marketing moving, contact him at argoberlin.com

Hosted on Acast. See acast.com/privacy for more information.

All episodes of A Beginner’s Guide to AI

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.