WWDC 2023: Apple Unveils Cutting-Edge AI Features at WWDC 2023
Apple has made waves at its annual Worldwide Developers Conference (WWDC), announcing a series of new features across its devices that leverage artificial intelligence (AI) and machine learning (ML) technologies. These AI-driven innovations, which were presented at the conference on Monday, are set to enhance the functionality of the iPhone, iPad, Apple Watch, Apple TV, AirPods, and the newly launched Apple Vision Pro headset, all while preserving user privacy and security through on-device processing.
Apple Vision Pro
Perhaps the most talked-about feature is Persona for the Apple Vision Pro. Described as Apple’s first “spatial computing” device, the Vision Pro is an augmented reality headset that overlays graphics onto the wearer’s view of the real world. The Persona feature uses the headset’s built-in cameras to create a lifelike, interactive digital twin of the user. During video calls, the wearer’s expressions and gestures are mapped onto this digital persona in real-time, providing a seamless alternative to traditional video conferencing.
iOS 17
The iPhone’s operating system, iOS 17, is set to receive a smarter autocorrect feature. Using a transformer model, an advanced AI program, the updated autocorrect feature will improve word prediction capabilities and offer in-line sentence suggestions, akin to Gmail’s smart compose feature. This enhancement aims to make iPhone typing more accurate and user-friendly.
Live Voicemail
The newly introduced “Live Voicemail” feature for the iPhone is another standout. When someone leaves a voicemail, the Phone app will display a real-time text transcript of the message on the recipient’s screen. This feature, powered by Apple’s neural engine, effectively transcribes audio into text on-the-go, while preserving user privacy through on-device processing.
speech recognition model
Improvements to the dictation feature on iOS 17 were also announced. A new speech recognition model, powered by on-device ML, is set to increase the accuracy of turning spoken words into written text.
FaceTime call
Apple’s FaceTime has also been revamped with a new presenter mode. Users can now present an app or computer screen to others during a FaceTime call while also displaying a live view of their own face. This feature, which allows users to gesture towards the content as if they were presenting on TV, is also powered by Apple’s neural engine.
Journal for iPhone
Apple announced “Journal for iPhone,” a new app for iOS 17 that allows users to log their daily activities. The app uses on-device ML to suggest personalized entries for users, drawing from various data sources like contacts, pictures, music, workouts, and location data. For privacy, Journal is end-to-end encrypted, and users can control the data used for suggestions and when to schedule notifications for journal prompts. An API is also planned to let developers leverage these personalized writing suggestions in their own apps.
These AI features demonstrate Apple’s ongoing commitment to blending advanced technology with user privacy. The tech giant’s focus on on-device processing minimizes the need to share user data with the cloud, paving the way for a future where AI enriches user experiences while respecting privacy.
