"Is Siri a relic of the past? A roundup of the ultra-detailed changes in iOS 18 that have been brewing for a year

06/11 2024 382

The keynote speech at Apple's Worldwide Developers Conference (WWDC) has come to an end, and the company had plenty to share. For the first time, we got a glimpse of the AI capabilities of Apple devices and some significant updates to the company's operating systems.

If you missed the live broadcast of the keynote speech, you can find the main highlights of the conference below:

01. AI System Coming to Apple's Entire Product Line

With almost all major tech companies jumping on the AI bandwagon, it's no surprise that Apple is introducing its own AI system.

Apple Intelligence, the company's latest personal intelligence system, places powerful generative models at the core of iPhones, iPads, and Macs, providing a plethora of new features for Apple's native apps, such as the ability to generate images or summarize text.

Apple Intelligence places a strong emphasis on security, as the system automatically decides whether to use on-device processing or contact Apple's private cloud computing servers to fulfill user requests.

The system will be available free of charge on iPhone 15 Pro, iPad, and Macs equipped with the M1 chip and later versions.

02. Siri Gets an AI Boost

Apple's push for AI also extends to Siri.

The updated voice assistant will now be more deeply integrated into the iPhone, appearing as a pulsating light along the device's edge. It will give users more control over apps, allowing them to ask Siri to find information in specific emails or even display photos of their friends.

Apple is relying on large language models (LLMs) to help Siri better understand what users say and track follow-up requests and questions.

03. Siri Integrated with ChatGPT

Siri's significant AI upgrade also includes integration with OpenAI's ChatGPT chatbot.

With the new integration, Siri will automatically determine if a query is better suited for ChatGPT. It will seek user consent before sending a request to ChatGPT. Users can access ChatGPT through Siri for free, without the need to register an account.

04. New AI Features for Mail, Messages, Photos, and More

Apple is introducing a series of new AI features in iOS 18 apps, including methods to summarize emails and generate responses.

The company showed off a new Genmoji feature that allows users to create custom emojis based on text prompts, along with a new AI image generator called Image Playground.

Apple is also bringing AI to the Photos app, allowing users to search for photos using natural language. Users can also remove objects from photo backgrounds, similar to Google's magic eraser. Additionally, Apple is adding AI-supported transcription and summarization features to the Notes and Phone apps.

05. iPhone Becomes More "Customizable" in iOS 18

In addition to all the AI features, Apple is introducing a new, more customizable Control Center in iOS 18, including a way to freely place app icons on the Home screen.

In the upcoming update, Apple will also allow users to lock certain apps, preventing them from being accessed when the phone is handed over to someone else.

Other major changes include a redesigned Photos app and a new iPhone gaming mode that minimizes background activities to optimize gaming experiences.

06. iPhone Finally Supports RCS

After announcing support for RCS last year, Apple confirmed that it will arrive with iOS 18. However, no other details were revealed.

iMessage will also receive some upgrades, including scheduling text messages and supporting sending messages via satellite. Apple will also introduce colorful Tapback options and allow users to bold, underline, and italicize text.

07. Apple TV Plus Adds "inSights" Feature

Apple TV Plus is adding a feature that allows users to swipe down on the remote to display actors and their roles in the movie or TV show they are watching.

Users can also find the currently playing song and add it to their Apple Music playlists. Apple TV Plus will automatically display subtitles when users mute the program and supports 21:9 projectors.

08. Tracking User Login Information

As rumored last week, Apple has released a new password app that allows users to track login information across different devices.

The app allows users to generate and store passwords, similar to other password managers like LastPass and 1Password. Passwords will be available on iOS, iPadOS, macOS, visionOS, and even Windows.

09. iPadOS 18 Adds Calculator App with Apple Pencil Support

Over a decade after the iPad's release, it finally has a calculator app.

It comes with a new feature called "Math Notes," allowing users to write equations on the iPad using the Apple Pencil and have the app solve them for them.

Apple will also introduce smart handwriting, using machine learning to improve the appearance of handwriting and perform spell checks on notes.

10. macOS 15 Will Allow Users to "Mirror iPhone"

Apple's next update to MacOS will allow users to mirror their iPhone on a Mac. Users can interact directly with their iPhone on the Mac, view notifications, and hear audio played on the mobile device.

Safari will also introduce a new "Highlights" feature that uses machine learning to pick out interesting parts of a page.

11. Apple Will Automatically Display Widgets in watchOS 11

watchOS 11 will also introduce numerous new features, including the ability to automatically add widgets based on users' needs.

Apple will introduce a new Vitals app that allows users to "get a glance at their most important health metrics" and will also introduce a new cycle tracking feature, real-time activities, and support for the "Check-in" feature, allowing people around the user to track them during workouts.

12. visionOS 2 Adds Spatial Photos and Ultra-Wide Mac Displays

Apple has released visionOS 2, the first major update to its operating system for Vision Pro. One of the new features of Vision Pro is using machine learning to add depth to existing photos. The update will also introduce support for ultra-wide virtual Mac displays, more intuitive gestures, and support for train travel mode.

Apple also plans to bring Vision Pro to more countries, including China, Singapore, Australia, Canada, France, and the United Kingdom.

13. The Next Update for AirPods Pro Will Allow Users to Respond to Siri Discreetly

Apple will introduce Siri interaction features in the next AirPods Pro software update, allowing users to shake their head "yes" or "no" to respond to Siri's announcements. AirPods Pro will also support voice isolation to improve voice quality and reduce background noise.

The Chinese content was compiled by the MetaverseHub team. Please contact us for reprints.

Solemnly declare: the copyright of this article belongs to the original author. The reprinted article is only for the purpose of spreading more information. If the author's information is marked incorrectly, please contact us immediately to modify or delete it. Thank you.