164: Apple Explains Spatial Reframing

Apple’s latest Photos app updates bring a new level of AI powered editing directly into the iPhone experience, including tools for spatial reframing, extending the edges of an image, and removing more complex distractions with Cleanup. In this interview, Apple’s camera team explains how these features use depth estimation, Gaussian splatting, private cloud compute, and new image models to make advanced edits feel simple while still preserving the original photo as much as possible. The conversation also covers Apple’s approach to privacy, its collaboration with Google on model foundations, and the use of metadata and SynthID watermarking to identify AI generated edits.