Apple recently introduced a potentially contentious suite of Audio Intelligence features for beta testing with the initial developer releases of iOS 27.3 and watchOS 27.3. These beta updates equip Apple Watch Series 12 users with four new AI capabilities: detecting significant sounds, identifying music, summarizing discussions, and capturing notes.
Following only a day of using Apple’s Siri Recaps on my Apple Watch, it’s clear that its practical benefits might eventually overcome the unease associated with its AI-driven audio recording and summarization. Nevertheless, I’ve also identified instances where AI-powered note-taking could become excessive, logging trivial information, and noted opportunities for refinement.
The initial two features, sound and song detection, do not pose privacy worries. They are engineered to recognize crucial sounds—such as alarms or doorbells—or to identify music via Shazam’s technology. Sound detection assists individuals who are deaf or hard-of-hearing in daily life, while song identification is a capability iPhones have offered for almost twenty years.
However, it’s the other two features, Live Rewind and Siri Recaps, that have sparked debate. These functionalities record and then either transcribe or summarize conversations occurring near and with the Apple Watch owner. Live Rewind enables users to review what was spoken in the preceding 15 seconds, whereas Siri Recaps condense daily audio, preserving key spoken information as notes.
Apple has diligently addressed privacy for these AI features by performing audio processing and AI model execution on-device whenever feasible. This includes avoiding speaker identification, refraining from storing raw audio files, and redacting sensitive data such as government ID numbers or private account details.
Despite these measures, some individuals remain uneasy with the perception that we are increasingly accepting the concept of technology constantly monitoring our surroundings.
I empathize with both perspectives. While I frequently regret technology’s widespread integration into our daily existence, I nonetheless recognize the merit in Apple’s innovations.
I haven’t had an opportune moment to evaluate Live Rewind thoroughly, and I anticipate it won’t be a frequently used feature for me. Should I miss something, I’d probably opt to ask for a repetition, saying “sorry, what?” or “can you repeat that?” rather than relying on my Apple Watch.
Conversely, Siri Recaps instantly demonstrated its potential to become a regularly utilized tool for retaining crucial information.
Yesterday, I had a chance to test the feature in a practical setting while dropping off my teenager’s car for servicing and collecting a rental. In both locations, staff conveyed extensive verbal information concerning schedules, costs, and regulations. The details were shared too rapidly for manual note-taking. However, upon reviewing Siri Recaps later, it had successfully captured vital information I might need to reference.
Specifically, it recorded the deductible, the estimated repair duration, the rental car’s initial fuel level, and other pertinent details I wished to recall.
A minor grievance is that Siri Recaps blended this car-related data with subsequent household discussions, such as an upcoming errand or the week’s babysitting schedule, which we were coordinating to add to the family calendar with a suitable alert time.
Ideally, I believe these distinct topics should have been stored in a separate note, perhaps labeled “family schedule and errands,” instead of being grouped with the car repair details, even if under a different sub-heading.
Since I configured Siri Recaps for continuous operation, it also recorded trivial items, such as our intention to watch the midterms coverage on TV—information not typically worth noting. This served as a potent reminder that the feature was actively monitoring our daily conversations, a capability that could feel intrusive in more personal contexts.
Consequently, I contemplated deactivating the Recap feature during evening hours at home to prevent casual family dinner conversations from being converted into notes.
Although I valued the Recap for capturing an errand reminder from a family discussion, other saved snippets—like our TV viewing habits—would only be useful if exported to Apple’s Journal app for personal record-keeping.
I would prefer these types of superfluous details to be saved as individual notes—or at minimum, as distinct sections capable of being independently exported or removed daily.
Furthermore, I’d appreciate the ability to simply swipe left on a specific bullet point to delete it from the Siri Recap, eliminating the need to enter edit mode, position the cursor, and then manually remove unwanted text.
Additionally, I wish there was a setting to automatically export any saved Siri Recap (those marked with the bookmark icon) directly to Apple’s Notes app, bypassing an extra manual step.
Such Recaps could be organized into a dedicated folder within the Notes app for convenient access. While I grasp why this isn’t the default, considering Notes’ diverse usage, it would greatly benefit users who prefer Notes as their primary hub for all reminders and tasks.
Despite my initial discomfort with the notion of my Watch constantly ‘listening,’ I acknowledge the practical utility of this automated note-taking functionality in everyday situations.