Skip to content

EP 61: "Shadow AI" — And No One's Watching | Rafi Khardalian, Actualyze AI

August 31, 2026 · 18 min

Show notes

This episode was recorded live from the Ai4 conference podcast pavilion, where host Mac Goswami sat down with Rafi Khardalian — CEO & co-founder of Actualyze AI, and a former technology leader at Cisco who helped build its container and Kubernetes platforms — about the governance, security, and orchestration layer most enterprises are missing.

What's Covered:

The Foundation for Enterprise AI — Rafi lays out why a patchwork of point solutions doesn't cut it, and how Actualyze unifies governance and security across every model and provider — at the inference level.

The "Shadow AI" Problem — Employees signing up for AI tools on their own, with no governance, no visibility, no controls. Why fragmentation is a company-wide risk, not a per-team one.

One Endpoint to Govern Them All — By becoming the sole endpoint for all inference, Actualyze can mask PII, catch secrets and passwords, apply guardrails, and allow or block MCP tool calls — enforcing policy in one place instead of trusting each provider.

Why AI ROI Keeps Failing — Rafi's take: the hardest transformation isn't technical, it's cultural. Over-ambitious projects, unbudgeted bills, weak controls — and the trap of building a proprietary LLM you can't scale.

Reliable vs. Impressive — What decades of Kubernetes, OpenStack, and large-scale distributed systems taught him about production reliability over demo magic.

The Next Five Years — Why the over-rotation on frontier models will give way to small, open-weight, and purpose-built models — and why the real bottleneck is organizational readiness, not technology.

Key Quote: "It really comes down to organizational readiness rather than technology readiness. A lot is ready today."

Connect with Rafi:
LinkedIn: https://www.linkedin.com/in/rkhardalian/
Actualyze AI: https://actualyze.ai/

Follow and subscribe to AsembleAI: Spotify | Apple Podcasts | Amazon Music | iHeart Radio | YouTube | Substack

All episodes of Inside AsembleAI: DeepTech, AI & Science

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.