pizza100654391orig
Internet

Facebook takes a guess at what's in pictures to help visually impaired

With images an ever-growing proportion of what we share on social networks, Facebook fears that users with visual impairments may be missing out.

Beginning Tuesday, the company is tweaking its timelines so that users of screen readers can hear not just the text on a page, but also a brief description of what any images may contain. Until now, they've heard only the name of the person who posted the photo.

To describe the images, Facebook built a computer vision system with a neural network trained to recognize a number of concepts, including places and the presence of people and objects. It analyzes each image for the presence of different elements, and then composes a short sentence describing it that is included in the web page as the "alt" text of the image.

Users might hear, for example, "Image may contain: two people, smiling, sunglasses, sky, tree, outdoor."

Facebook hedges its description with "may contain", but for more than half the photos on its site, the company reckons it can identify at least one relevant concept with 80 percent accuracy or better.

The new feature is only available in English for now, and can be accessed via the screen reader function on iOS devices.

Here's a video illustrating how the image description function works.

IDG Insider

PREVIOUS ARTICLE

« HP laptop-tablet hybrid is the first with AMD's 'Bristol Ridge' chip

NEXT ARTICLE

Gov't researchers develop wireless car chargers that are faster than plug-ins »
author_image
IDG News Service

The IDG News Service is the world's leading daily source of global IT news, commentary and editorial resources. The News Service distributes content to IDG's more than 300 IT publications in more than 60 countries.

  • Mail

Poll

Do you think your smartphone is making you a workaholic?