Skip to content

Why 95% of AI Projects Fail: Model Risk & AI Governance | Sandip Wadje, BNP Paribas

August 27, 2026 · 46 min

Show notes

Why do 95% of enterprise AI implementations fail? According to Sandip Wadje, Managing Director at BNP Paribas, many organizations attempt complex reasoning tasks on day one rather than building a mature foundation around data hygiene and simple summarization workflows. In this episode, Ashish sits down with Sandip to explore how global financial institutions navigate Model Risk Management (MRM), GenAI governance, and regulatory expectations across regions like the UK, EU, and US. Sandip breaks down why classical 20-year-old MRM frameworks fall short when applied to non-deterministic black-box LLMs, and why security leaders must focus on output drift and event taxonomies rather than just input prompt filtering. We also examine the concept of the "AI Kitchen" - a cross-functional governance model bringing together IT, CISOs, legal, and Data Protection Officers alongside practical strategies for calculating AI blast radius, cleaning up overprivileged non-human identity (NHI) permissions, and training CSIRT teams for ML SecOps incidents.


Questions asked:

(00:00) Introduction: AI Risk in Regulated Financial Institutions(01:50) Sandip Wadje’s Background at BNP Paribas(02:50) Classical Model Risk Management (MRM) vs. Generative AI(04:40) Governing the Black Box: Finding the Security Delta(08:00) The CMDB Problem: Building an Accurate AI Use Case Inventory(11:30) Why 95% of AI Projects Fail: Summarize, Write, Reason(15:00) Continuous Evaluation (Evals) and Catching Output Drift(18:50) Event Taxonomy: What Happens When AI Decisions Drift?(25:40) Training CSIRT and SOC Teams for ML SecOps Incidents(30:00) Compensating Controls: Remote Browser Isolation & Prompt Monitoring(34:30) Non-Human Identities (NHI) & Cleaning Birthright Permissions(36:30) Balancing a $1M Savings Against a 4% Revenue Fine(38:30) Open-Weight Models vs. Frontier LLMs in Financial Services(41:00) The "AI Kitchen": Cross-Functional AI Governance(44:30) The #1 Rule for AI Security: Understand Your Data First

All episodes of AI Security Podcast

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.