Facebook’s AI Can Caption Photos for the Blind on Its Own

MATT KING IS blind, so he can’t see the photo. And though it was posted to his Facebook feed with a rather lengthy caption, that’s no help. Thanks to text-to-speech software, his laptop reads the caption aloud, but it’s in German. And King doesn’t understand German.

But then he runs an artificial intelligence tool under development at Facebook, and after analyzing the photo, the tool goes a long way towards describing it. The scene is outdoors, the AI says. It includes grass and trees and clouds. It’s near some water. King can’t completely imagine the photo—a shot of a friend with a bicycle during a ride through European countryside—but he has a decent idea of what it looks like.

“My dream is that it would also tell me that it includes Christoph with his bike,” King says. “But from my perspective as a blind user, going from essentially zero percent satisfaction from a photo to somewhere in the neighborhood of half … is a huge jump.”

Read full story at Wired.Com


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.