Apple has unveiled an update to accessibility features powered by Apple Intelligence. This update focuses on enhancing existing accessibility features, such as VoiceOver, Magnifier, Voice Commands, and Accessibility Reader. It includes features that provide more detailed descriptions of the screen and surroundings, allow users to operate the device using natural language, and automatically generate captions for videos without subtitles. These features are scheduled to be available later this year.
VoiceOver and Magnifier features for the visually impaired or low-vision users are also being enhanced. VoiceOver's image navigation feature provides more detailed descriptions of visual information, such as photos, scanned bills, and personal records. Users can press the iPhone's action button to ask questions about the scene being viewed by the camera and receive answers. The Magnifier app describes the surrounding environment in the same way, and the app can be operated via voice requests such as "Zoom in" or "Turn on the flashlight.".
Voice commands support natural language manipulation through Apple Intelligence. Users can operate elements visible on the screen by verbally describing them, such as "Press the purple folder" or "Press the restaurant guide," without having to memorize button names or numbers precisely. This method helps users select screen elements more easily, even in apps where accessibility labels are not fully established.
Apple Vision Pro adds electric wheelchair control capabilities. Utilizing Vision Pro's eye-tracking system, users can control compatible electric wheelchair drive systems with their eyes. Initially, it supports Tolt and LUCI alternative drive systems in the U.S., supporting both Bluetooth and wired connections.
More and Sources