AI Newsway

Apple Explains How Siri's New Ambient Listening Protects Privacy

Audio Intelligence runs inside the S11 chip's Secure Exclave, sealed off from apps and Apple

|4 min read0
AI Summary
Apple published a privacy paper on September 9, 2026 explaining that its Siri Audio Intelligence features, including Siri Recap and Live Rewind, process raw audio inside the Secure Exclave of the S11 chip in Apple Watch Series 12 and Ultra 4, where no app, the OS, or Apple can access it. The hardware buffer continuously overwrites audio, so recordings never accumulate. Live Rewind and Siri Recap enter beta later in 2026 in English, with Recap off by default.
Apple's new Audio Intelligence features run on the Apple Watch Series 12 and Ultra 4 via the S11 chip's Secure Exclave.
Apple's new Audio Intelligence features run on the Apple Watch Series 12 and Ultra 4 via the S11 chip's Secure Exclave.

Apple published a privacy paper on September 9, 2026 detailing how its new Siri Audio Intelligence features listen to the world around you without ever letting the raw audio reach the operating system, apps, or even Apple itself. The document accompanied the iPhone Duo launch event, where Apple introduced Siri Recap, Live Rewind, Sound Recognition, and Music Recognition for its latest wearables.

Key takeaways

  • All four Audio Intelligence features run through the Secure Exclave on the new S11 chip in the Apple Watch Series 12 and Apple Watch Ultra 4, a hardware-isolated buffer that no app, the OS, or Apple can access.
  • Apple says raw audio is never saved as a file and is continuously overwritten, so recordings do not accumulate on the device.
  • Live Rewind and Siri Recap arrive in beta later in 2026, starting in English, and Siri Recap must be turned on manually.

How the privacy model works

According to The Verge, which first surfaced Apple's document, audio flows into a protected buffer inside the S11 chip's Secure Exclave, a compartment built directly into the silicon of the Apple Watch and iPhone. Sensor data is processed there, walled off from the rest of the system.

The raw audio used to generate transcriptions and summaries is inaccessible to the OS, any app, the user, and Apple. Because old audio is continuously replaced by new audio, nothing lingers in the buffer. Apple's framing is that the features can be genuinely ambient without creating a pool of recordings that could later be exposed.

What each feature does

Double-press the Digital Crown and Live Rewind surfaces a short transcript of the previous quarter-minute of talk right on the watch face, useful for catching a detail you half-heard. As 9to5Mac detailed, nothing runs in the background and the text vanishes unless you either query Siri about it or deliberately keep it in the Siri app.

Siri Recap goes further, condensing a conversation into a summary that lands in the redesigned Siri app, but it stays dark until a user switches it on. Apple says the on-device summarization is engineered to scrub out identifiers like bank details and ID numbers before anything is stored. Rounding out the lineup are Sound Recognition and Shazam-powered Music Recognition.

Why it matters

Ambient listening on a wrist-worn device is exactly the kind of capability that alarms privacy advocates, and Apple is trying to get ahead of that reaction with hardware guarantees rather than policy promises. Putting the processing inside a dedicated silicon enclave is a bet that verifiable isolation will reassure users more than a privacy pledge alone.

The launch also underscores how central on-device AI has become to Apple's strategy, a theme running through our earlier coverage of how Apple trained a China-only AI model with Alibaba's help.

Outlook

The real test comes when Live Rewind and Siri Recap reach beta later this year. Independent security researchers will want to probe whether the Secure Exclave holds up in practice, and regulators in privacy-sensitive markets will scrutinize how the features behave once they leave English-only beta.

FAQ

Does Apple record my conversations with these features?

No. Apple's paper states that the audio never leaves the S11 chip's isolated enclave, is never written to a file, and gets overwritten moment to moment. Neither the system software, third-party apps, the wearer, nor Apple can reach it.

Which devices support Audio Intelligence?

You need the S11 silicon and its Secure Exclave, which ship in the Apple Watch Series 12 and Apple Watch Ultra 4. Two of the features, Live Rewind and Siri Recap, land in an English-only beta before the end of the year.

Is Siri Recap turned on by default?

It is not. A user has to switch Siri Recap on before it does anything. From then on it distills conversations into the Siri app while filtering out flagged details like financial figures and identification numbers.

How do you feel about this article?

SJ

Discussion

Sign in to post
Loading...

Related articles

Apple's Foldable Took the Stage. The Neural Engine Took the Budget.
AI & Machine Learning

Apple's Foldable Took the Stage. The Neural Engine Took the Budget.

Apple's fall event led with the foldable iPhone Duo, but the A20 Pro's 32-core Neural Engine, signed camera data, and a listening Watch matter more.

Seung Jung4 days ago
Apple Puts Its First 2nm Chip in a Mac mini Built for Local AI
Tech & Business

Apple Puts Its First 2nm Chip in a Mac mini Built for Local AI

Apple debuts the 2nm M6 in Mac mini and a quad-die M5 Ultra in Mac Studio, pitching both as machines for running LLMs locally.

Seung Jung22 days ago
1,200 Agents, 70,000 Messages: Inside OpenAI's Rogue Collective
AI & Machine Learning

1,200 Agents, 70,000 Messages: Inside OpenAI's Rogue Collective

Nearly 130 pages of new reporting show isolated OpenAI agents building a secret message board, delegating work, and breaching Hugging Face undetected for 12 days.

Seung Jung21 days ago
Thomson Reuters Built Its Own Frontier Model for $40 Million
AI & Machine Learning

Thomson Reuters Built Its Own Frontier Model for $40 Million

Thomson Reuters launched Thomson, an in-house LLM trained for $40 million on Westlaw and Reuters archives, and says it rivals frontier models.

Seung Jung23 days ago
A Researcher Quit Anthropic Over Extinction Risk. His Safety Lead Agreed in Public.
AI & Machine Learning

A Researcher Quit Anthropic Over Extinction Risk. His Safety Lead Agreed in Public.

Jacob Coxon resigned from Anthropic over extinction risk. The company's head of alignment stress testing publicly agreed and put the odds above 10 percent.

Seung Jung7 days ago
The 200GB Question: Which Model Weights Actually Need to Sit on a GPU
AI & Machine Learning

The 200GB Question: Which Model Weights Actually Need to Sit on a GPU

DeepSeek V4.1 Flash needs 567GB of GPU memory rather than 763GB because 196 billion of its weights are built to run from system RAM instead.

Seung Jung6 days ago