What’s new in Apple Intelligence
Dive into the latest key technologies and capabilities.
Foundation Models framework
You now have direct access to the on-device foundation model at the core of Apple Intelligence so you can build experiences that are smart, private, and work without internet connectivity through the Foundation Models framework. With native support for Swift, you can tap into the model with as few as three lines of code. You can use this framework to power intelligent features in your app, with model capabilities, such as text extraction, summarization, and more. Features like guided generation, tool calling, and more are built into the framework, making it easier than ever to implement intelligent experiences right into your existing apps and games.
Visual intelligence
Visual intelligence extends to the screen, in addition to the iPhone camera. People can search, take action, and ask questions about the content on their screen, by pressing the same buttons used to take a screenshot.
With App Intents, you can integrate search capabilities from your app into visual intelligence. This allows people to search visually across your app for the content on their iPhone screen, or for physical objects in their surroundings.
Shortcuts app
Now people can build actions that combine in powerful ways with new intelligent actions in the Shortcuts app. With App Intents, your app’s actions and entities can work with features like Writing Tools, Image Playground, and a new Use Model action that lets people tap directly into Apple Intelligence models on device or with Private Cloud Compute to provide responses that feed into the rest of their shortcut.
Genmoji
People can now mix favorite emoji together with descriptions to make something brand new. They also get more control over Genmoji inspired by family and friends, with options like customizing the hairstyle to match their friend’s latest look.
Image Playground
There’s even more control over images inspired by people, with options like changing their expressions to match the moment. You can also tap into more styles with ChatGPT.
