Apple launched Apple Intelligence, the iPhone, iPad, and Mac personal intelligence system that uses generative models and personal context to provide highly valuable and relevant intelligence. Apple Intelligence permeates iOS 18, iPadOS 18, and macOS Sequoia.
It uses Apple hardware to comprehend and create language and graphics, act across apps, and use personal context to simplify and speed up daily chores. With Private Cloud Compute, Apple establishes a new benchmark for AI privacy by flexing and scaling computing power between on-device processing and bigger, server-based models on proprietary Apple silicon servers.
Apple Intelligence
New Language Understanding and Creation Skills
Apple Intelligence offers new ways to improve writing and communication. Users can rewrite, proofread, and summaries Mail, Notes, Pages, and third-party app content with new systemwide Writing Tools in iOS 18, iPadOS 18, and macOS Sequoia.
Writing Tools boost confidence in writing by organizing class notes, proofreading blog posts, and perfecting emails. Apple Intelligence’s Rewrite feature lets users set a tone for their writing based on audience and task.
From perfecting a cover letter to injecting humour and creativity into a party invitation, Rewrite helps produce the proper words. Proofread evaluates grammar, word choice, and sentence structure and suggests modifications with explanations that users can review or quickly accept. Summaries can summaries text into a paragraph, bulleted points, table, or list.
- While writing an email, a user can choose Proofread or Rewrite from the Writing Tools menu.
- The Summarize feature is selected in the Notes app for holistic health notes.
- In Mail, managing emails has never been easier.
- Priority Messages display urgent communications like dinner invitations and boarding passes at the top of the inbox.
- Instead than previewing the first few lines of each email, users can see summaries without opening them.
- Users can tap long threads to get relevant details. Smart Reply suggests rapid responses and identifies email questions to assure answers.
- Deep language understanding extends to notifications.
- Priority alerts display at the top of the stack to highlight what’s most important, while summaries assist users skim long or stacked alerts to see key facts on the Lock Screen, like ongoing group chats.
- Reduce Interruptions, a new Focus, highlights only urgent alerts like a nursery pickup SMS to help users stay focused.
- The Notes and Phone apps may capture, transcribe, and summarize audio.
- Participants are automatically notified when a call is recorded, and Apple Intelligence creates a summary to help recall key points after the call.
- The Notes app on iPad Pro can capture and transcribe audio.
- iPad Pro can summarize audio.
Image Playground Enhances Communication and Self-Expression Fun
Apple Intelligence enables innovative image creation to help consumers express themselves. Users may create amusing graphics in seconds using Image Playground’s Animation, Illustration, or Sketch styles. Images Playground is simple and embedded into apps like Messages. A separate software lets you experiment with different ideas and designs. Users can play with as many images as they wish because all images are made on device.
Users can choose from themes, costumes, accessories, and locales; provide a description to characterize an image; incorporate someone from their personal photo bank; and pick their favorite style with Image Playground.
Messages’ Image Playground lets users easily create amusing graphics for pals and explore personalized conversation-related themes. If a user messages a group about hiking, they’ll receive suggested concepts relating to their friends, destination, and activity, making image creation faster and more relevant.
iPhone 15 Pro
iPhone 15 Pro demonstrates Messages Image Playground
Image Playground presents the user’s mum as a superhero in iPhone 15 Pro Messages.
In Notes, the new Image Wand in the Apple Pencil tool menu opens Image Playground, making notes more visually appealing. Users can generate beautiful graphics from rough sketches and even empty space utilising information from the surrounding region. Keynote, Freeform, Pages, and third-party apps that use the new Image Playground API also support Image Playground.
Genmojis
Create Genmojis for Any Situation
Users can build unique Genmoji to express themselves. Typing a description displays their Genmoji and other options. Photos can be used to create Genmoji of friends and relatives. Genmoji can be used in texts or as stickers or reactions in Tapbacks like emoji.
Genmojis are chosen for the prompt “Smiley relaxing wearing cucumbers.”
In Messages, users can choose Genmoji Tapbacks.
New Photo Features Increase Control
Apple Intelligence makes photo and video searching easier. Use natural language to find photographs like “Maya skateboarding in a tie-dye shirt,” or “Katie with stickers on her face.” Finding certain moments in clips to jump to the relevant segment improves video search. The new Clean Up tool can also remove background distractions without affecting the subject.
Memories lets users create stories by typing a description. Apple Intelligence will use language and picture understanding to select the finest images and videos based on the description, create a plot with chapters based on photo themes, and organize them into a movie with a narrative arc. Apple Music will even suggest songs based on memory. Apple and others do not access user photographs and videos, as with all Apple Intelligence features.
New Era for Siri
Siri
Siri becomes further integrated into the system using Apple Intelligence. With better English understanding, Siri is more natural, contextually relevant, and personal, simplifying and speeding up daily activities. It can track users’ stammering and preserve context between requests. Users can also type to Siri and switch between speech and text to converse as needed. Siri’s new look includes an exquisite flashing light around the screen while engaged.
Siri can now answer hundreds of iPhone, iPad, and Mac queries and provide device assistance anywhere. Mail app users can learn how to schedule emails and switch from Light to Dark Mode.
Siri will eventually understand and act on user content in more apps with display awareness. A buddy can text a user their new address in Messages and say, “Add this address to his contact card.”
Siri can do hundreds of new activities in Apple and third-party apps using Apple Intelligence. Siri will handle requests like “Bring up that article about cicadas from my Reading List” or “Send the photos from the Saturday barbecue to Malia.”
Siri will provide user-specific and device-specific intelligence. A user can say, “Play that podcast that Jamie recommended,” and Siri can find and play the episode without having to remember if it was mentioned in a text or email. Or they can ask Siri, “When is Mom’s flight landing?” and Siri will retrieve the flight data and compare them to real-time flight monitoring to give an arrival time.
Apple Artificial Intelligence
A New AI Privacy Standard
Apple Intelligence must grasp deep personal context and respect user privacy to be helpful. Many Apple Intelligence models operate solely on device, a cornerstone of its processing. Privacy and security of Apple products are extended into the cloud to unlock greater intelligence for sophisticated demands that require more processing power.
Apple Intelligence can increase its computing capability and use larger, server-based models for difficult requests with Private Cloud Compute. Apple servers power these models, ensuring data is never retained or exposed.
Private Cloud Compute cryptographically prevents iPhone, iPad, and Mac from talking to a server unless its software has been publicly logged for scrutiny. Independent experts can analyze Apple silicon server code to verify privacy. Apple Intelligence with Private Cloud Compute redefines AI privacy, enabling trusted AI.
ChatGPT
ChatGPT integrates across Apple platforms
- Apple is adding ChatGPT access to iOS 18, iPadOS 18, and macOS Sequoia, letting users leverage its expertise and image- and document-reading capabilities without switching tools.
- Siri can use ChatGPT’s knowledge as needed. After receiving inquiries, papers, and photographs from ChatGPT, Siri answers directly.
- An iPhone 15 Pro user tells Siri, “He have fresh salmon, lemons, tomatoes.” Help me create a 5-course feast with dishes for all tastes.”
- Siri on iPhone 15 Pro asks, “Do you want me to use ChatGPT to do that?”
- Siri displays ChatGPT results on iPhone 15 Pro. A bullet describes the first course, tomato and basil bruschetta.
- Apple’s systemwide Writing Tools will also include ChatGPT to let users write material for any topic. Compose users can use ChatGPT image capabilities to create graphics in many styles to match their content.
- ChatGPT users’ IP addresses are hidden, and OpenAI won’t store requests. Users who connect to ChatGPT must follow its data-use policies.
GPT-4o-powered ChatGPT will launch later this year on iOS 18, iPadOS 18, and macOS Sequoia. Users can access it for free without an account, while ChatGPT subscribers can connect their accounts and enjoy paid features from these experiences.
