Seeing AI is an artificial intelligence application developed by Microsoft for iOS.[2][3] Seeing AI uses the device camera to identify people and objects, and then the app audibly describes those objects for people with visual impairment.[4]
Capabilities
Seeing AI is primarily used to describe short text, documents, products, people, currency scenery, colors, handwriting and light.[5] The app can scan a barcode to describe a product[6] and uses sounds to assist the user in focusing on the barcode.[7] When the app describes people, it attempts to estimate the person's age, gender, and emotional status.[8] Additionally, in a test run by German journalists in December 2019, Seeing AI apparently used some sort of Facial recognition system to identify people on photographs by name.[9]
Some functions are performed on the device, however more complex functions such as describing a scene or recognizing handwriting require an Internet connection.[10]