Home
Finance
Travel
Shopping
Academic
Library
Create a Thread
Home
Discover
Spaces
 
 
  • Visual Intelligence Screenshot Integration
  • ChatGPT Screen Analysis Feature
  • Liquid Glass Design Interface
 
Apple expands visual intelligence for iPhone with ChatGPT integration

At WWDC 2025, Apple unveiled an expansion of its Visual Intelligence technology that now allows iPhone users to analyze and interact with on-screen content across any app, enabling features like image searching, event extraction for calendars, and ChatGPT integration through the same button combination used for screenshots.

User avatar
Curated by
avidreader
3 min read
Published
11,270
603
techcrunch.com favicon
TechCrunch
Apple brings Apple Intelligence to the iPhone screen at WWDC 2025
apple.com favicon
Apple
Apple Intelligence gets even more powerful with new capabilities across Apple devices
cnet.com favicon
cnet
Everything Announced at Apple WWDC 2025: Unified OS Redesign
Apple brings Apple Intelligence to the iPhone screen at WWDC ...
techcrunch.com
Visual Intelligence Screenshot Integration

Visual Intelligence in iOS 26 seamlessly integrates with the screenshot functionality, allowing users to interact with on-screen content in powerful new ways. When users take a screenshot, they'll see new Visual Intelligence options alongside traditional editing tools, enabling them to search for products they spot while browsing social media, instantly add events to their calendar, or send screenshots to ChatGPT for analysis and additional information.123

For developers, Apple is providing tools to integrate their apps with this experience through App Intents, allowing third-party applications to become part of the Visual Intelligence ecosystem. Craig Federighi, Apple's head of software engineering, emphasized that this feature will make it possible to "search visually across your most-used apps using Visual Intelligence with the iPhone camera."14 The system maintains Apple's commitment to on-device processing for privacy while delivering contextual assistance that works automatically with any app.56

techcrunch.com favicon
cnet.com favicon
cnet.com favicon
10 sources
ChatGPT Screen Analysis Feature

Visual Intelligence in iOS 26 introduces powerful ChatGPT integration that allows users to analyze anything on their iPhone screen. Users can highlight objects of interest and ask ChatGPT specific questions about what they're viewing to gain deeper insights and contextual information12. For example, when looking at a photo containing food items, users could ask "what recipe could I make from these?"3 The system works by taking a screenshot and uploading it to ChatGPT, which then uses its knowledge base to provide relevant information back to the user4.

This feature builds upon the ChatGPT integration first introduced in iOS 18.2, but now offers more seamless visual analysis capabilities across the entire operating system4. Developers can leverage this functionality through App Intents, allowing their applications to participate in the visual search experience while maintaining Apple's privacy standards15. The screen analysis capability is particularly valuable for users without the latest iPhone models that include dedicated Visual Intelligence hardware, as it provides similar functionality through software integration4.

apple.com favicon
techcrunch.com favicon
apple.com favicon
8 sources
Liquid Glass Design Interface

Apple's new "Liquid Glass" design language represents a significant visual overhaul across all its operating systems, including iOS 26, iPadOS 26, macOS Tahoe, watchOS 26, and tvOS 26.12 This unified interface features translucent elements with rounded corners that perfectly match Apple's modern hardware design, creating greater harmony between software and devices.2 The glass-like material dynamically refracts light, responds to movement with specular highlights, and adapts its color based on surrounding content through real-time rendering.13

Liquid Glass elements behave with a gel-like flexibility, illuminating from within when touched and morphing between different states as users navigate apps.3 The design creates a distinct functional layer for controls that floats above content, with elements that nest concentrically with the rounded corners of windows and screens.23 This approach prioritizes content visibility while making the interface feel more responsive and alive, with Apple describing the experience as "lively" and "delightful."12 The system also includes accessibility features like Reduced Transparency, Increased Contrast, and Reduced Motion to ensure the interface remains usable for all users.3

appleinsider.com favicon
apple.com favicon
tech.yahoo.com favicon
10 sources
Related
How will Visual Intelligence change my daily iPhone interactions
What new privacy features does Visual Intelligence include for me
How can I use ChatGPT integration to improve my on-screen searches
Discover more
iOS 26 beta pauses FaceTime calls when nudity detected
iOS 26 beta pauses FaceTime calls when nudity detected
Apple's iOS 26 beta contains a previously undisclosed FaceTime feature that automatically freezes video calls when nudity is detected, according to developers testing the software released last month. The feature, discovered by X user @iDeviceHelp, pauses both audio and video streams when the app's on-device machine learning identifies someone undressing during a call. The discovery raises...
4,538
Android users can now edit texts sent to iPhones
Android users can now edit texts sent to iPhones
Android users can now edit text messages sent to iPhones through Google Messages, marking the first time cross-platform message editing has become available between the two operating systems. The feature, which began rolling out Tuesday, allows users to modify Rich Communication Services (RCS) messages within a 15-minute window after sending them to iPhone recipients. The capability represents...
4,508
Siri overhaul could see Apple use OpenAI or Anthropic models
Siri overhaul could see Apple use OpenAI or Anthropic models
Apple is considering partnering with OpenAI and Anthropic to power a revamped version of Siri, potentially abandoning its own artificial intelligence models in favor of external technology, according to a Bloomberg report published Monday. The discussions represent a potential reversal for a company that has built its reputation on controlling every aspect of the user experience. The iPhone...
32,644
Google launches first Apple Watch app in 5 years
Google launches first Apple Watch app in 5 years
Google quietly released its first native Calendar app for Apple Watch today, marking the tech giant's first new smartwatch offering in over five years and bringing one of its most popular productivity tools to Apple's wearable platform. The app, available through version 25.24.1 of Google Calendar, displays upcoming events and Google Tasks in a simplified list format directly on users' wrists....
10,450