Apple's new patent shows how its AR glasses could help those with impaired vision see again
Apple is doing something similar with the FaceTime Attention Correction in iOS 13
For example, if a person has a floater that blocks a portion of their view, the glasses can use a warping technique that would allow them to see what they are missing. This would be accomplished by sending the image through a processor. The technology used in the glasses would help track the user’s line of sight to keep the warp effect enabled even when he or she starts looking elsewhere. Those without an obstruction could also benefit as the image could be magnified making it easier to see. Users with normal vision can zoom in on the fine print to make sure that they aren’t getting ripped off before signing a contract.
Many types of visual impairment may result in partial loss of sight, or weakened sight. Visual impairments may be the result of any number of health issues, such as diabetes, old age, retina issues, and the like. As an example, some people develop floaters or blind spots in their eye which cause obstructions in a person’s visual field. The result is that people often have to compensate for blind spots and other obstructions and impairments by viewing only portions of a scene at a time. Thus, the full field of view is never made available at once.
In one embodiment, a method for image warping is described. A method for displaying a warped area includes obtaining an image of a real environment, obtaining a portion of a field of view comprising an obstruction, determining a portion of the image of the real environment corresponding to the obstruction, applying a warping function to an area surrounding the portion of the image of the real environment corresponding to the obstruction to obtain a warped area, and displaying the warped area.”-Apple
Illustration from Apple’s patent; the technology should work with the company’s AR smartglasses