What is Apple Intelligence? A New Era of AI-Powered Features
Apple Intelligence isn’t a single operating system or artificial intelligence model, but rather a suite of generative AI features introduced under a new branding. According to Apple, these features can “generate language and images, take actions across apps, and use personal context to simplify and speed up everyday tasks.”
Exclusive to New Devices
Apple Intelligence will only be available on the latest devices, including the iPhone 15 Pro and newer models, as well as iPads and Macs equipped with at least an M1 chip. This is not just to drive upgrades; Apple notes that the AI capabilities require a “high-performance compute” chip, according to Sribalan Santhanam, Apple’s VP of silicon engineering.
Apple’s new A18 and A18 Pro chips, designed for the iPhone 16, are the company’s first specifically built to support Apple Intelligence. These chips offer up to twice the processing speed for machine learning, along with more memory bandwidth and improved energy efficiency, making them ideal for running large generative models.
First Features: Writing Tools and Audio Summaries
Apple Intelligence’s initial rollout, scheduled for October, will include Writing Tools that will appear across various apps. These tools will help users proofread, rewrite, and summarize text, though Apple is still working on preventing common AI issues, such as hallucinations. Initially, these features will only be available in US English, with expansions to other English-speaking regions by late 2024 and additional languages like Chinese, French, and Spanish coming in 2025.
The system will also enable audio recording and transcription in apps like Notes and Phone, generating summaries of key points from conversations. In addition, it will help prioritize notifications, summarizing important messages rather than showing just the first few lines of an email or text.
Advanced Photo Editing and Siri Enhancements
The photo editor in Apple Intelligence will introduce a “Clean Up” tool, allowing users to easily remove unwanted objects or people from images. Users will also be able to search for specific photos using natural language prompts, such as “Photo of Sarah playing with a dog.”
Siri is also getting a significant upgrade, becoming more “natural, flexible, and integrated.” It will maintain context between requests and even function when users stumble over words. Siri’s look will be revamped with glowing, on-screen edges to signal when it’s active, replacing the familiar swirling ball.
Upcoming Features: Image Creation and Genmojis
Later this year, Apple plans to introduce additional features, including AI-powered image creation. The “Image Playground” will allow users to generate images in various styles like animation, illustration, or sketch. It will be accessible as a standalone app and integrated into other apps like Messages. Another fun addition will be “Genmojis,” or generative AI-created emojis, that users can generate with simple prompts.
Apple is emphasizing that all images generated through Apple Intelligence will be created on the device, keeping data secure and private. More advanced AI functions, however, will be processed via Apple’s new Private Cloud Compute network.
Additionally, Apple has teased a future integration with ChatGPT, though details remain scarce, with Apple promising built-in privacy protections for those who access it through Siri or Writing Tools.
Newer Articles
- How to Generate Human-Friendly Responses with GPT-4V: An In-Depth Review
- Sky’s the Limit: How Donating Airplanes and Helicopters Can Transform Lives and Communities
- AI Market Competition Intensifies: Trust, Governance, and Regional Growth Drive the Future
