Apple Begins Beta Testing AI Audio Intelligence Tools on Apple Watch

image 73
🔊 Listen to the summary

Apple has initiated developer beta testing for its new “Audio Intelligence” suite on the Apple Watch, introducing AI capabilities designed to recap conversations and review recently spoken words. Initially rolled out in the iOS 27.3 developer beta, the opt-in features are supported on the Apple Watch Series 12 and Apple Watch Ultra 4 following their initial unveiling in September.

The system’s conversational tools include Live Rewind and Siri Recaps. Live Rewind allows wearers to double-press the digital crown to view an on-screen text snippet of whatever was spoken over the previous 15 seconds. Triggering the action plays an audible chime and displays an animation to alert others nearby. If not saved to the Siri app or used with an on-screen “Ask Siri” prompt, the snippet permanently deletes itself after 30 seconds. Meanwhile, Siri Recaps creates high-level summaries and bulleted lists highlighting key details, such as deadlines or pricing, without saving raw audio, identifying speakers, or generating full verbatim transcripts. The system also filters out sensitive data, including financial details, personal identifiers, and language promoting self-harm.

To operate, the features rely on the S11 chip’s secure enclave, which buffers raw audio without granting access to Apple or third parties. When the watch detects conversation, the audio passes to the paired iPhone to be converted into condensed text with filler words removed. That text is encrypted and forwarded to Apple’s Private Cloud Compute to generate the summary, after which cloud-side data is deleted immediately. Saved recaps remain encrypted on user devices, prompt review prompts daily, and automatically delete after seven days if left unsaved.

The Audio Intelligence suite also incorporates background music detection through Shazam and sound recognition alerts for sirens, doorbells, and alarms tailored for deaf and hard-of-hearing users. Apple stated the processing does not impact device battery life and confirmed the features will expand to public beta testers before general availability.

Source: TechCrunch