Facebook's search tool is about to get way more visual.
Director of Applied Machine Learning Joaquin Candela published a blog post today (accompanying his presentation at the Machine Learning @Scale event in New York City) to share updates about Facebook's AI-based image-recognition tool. The improvements can home in on photos to the "pixel level" and will let users search images based on their content -- whether or not they've been manually tagged.
"Until recently, online search has always been a text-driven technology, even when searching through images," he writes. "Whether an image was discoverable was dependent on whether it was sufficiently tagged or had the right caption -- until now."
SEE ALSO:How Facebook is trying to dominate mobile without owning your smartphoneAdvancements in Facebook's computer vision tech and the introduction of new tools will let users make much more targeted image searches. For instance, when you search your old photos, you'll be able to look for images where you're wearing a black shirt or red dress, or where the people in the image are dancing.
Facebook's computer-vision tools were originally envisioned to help the visually impaired navigate the service, discerning what's in a photo just by scanning it. But today's news shows general Facebook users have a lot to benefit from the feature as well.
Crediting "a lot" of teams for the advancements, Candela wrote that Facebook's general-purpose AI platform, FBLearner Flow, is now running 1.2 million AI experiments a month -- six times more than it was just a year ago.
Built on top of that is Lumos, Facebook's specialized platform for image and video understanding. Using Lumos, the network' search tool can identify features in images and video automatically. For users, that capability will help pinpoint searches to the exact pic they're looking for -- and for Facebook, the automation will make it easier to identify inappropriate content and spam.
These systems are also being employed to improve the platform's automatic alt text (AAT) for photos, which makes the visual aspects of the platform more accessible to the visually impaired. With the new tools, a set of 12 new actions, like "people dancing," have been added to the automatic image description.
TopicsArtificial IntelligenceFacebook
(责任编辑：焦點)
This company is hiring someone just to drink all day
Peter Thiel company reportedly helped NSA spy program
A new 'continent's' been found under the magical land of New Zealand
Cry of the Week: UConn's indefatigable women and the world they made
Here's George Takei chilling in zero gravity for the 'Star Trek' anniversaryOver 82,000 evacuate as Blue Cut fire rapidly spreads in southern California
A rapidly spreading wildfire in southern California's Cajon Pass has grown in hot, dry weather, thre
...[详细]Cry of the Week: UConn's indefatigable women and the world they made
Welcome to our newweeklyseries "Cry of the Week," in which we highlight whatever moment made us ugly
...[详细]Iranian film 'The Salesman' wins Oscar in biggest political statement of the night
Director Asghar Farhadi's absence at the Oscars on Sunday spoke almost as loudly as the award itself
...[详细]An English version of China's biggest taxi app is coming, but there's a small problem
China's top (and pretty much monopolist) taxi app, Didi Chuxing, is quietly trialing an English vers
...[详细]Photos show the Blue Cut fire blazing a path of destruction in California
A fast moving wildfire continued raging near San Bernadino, California, forcing the evacuation of at
...[详细]Gentle koala investigating his carer's arm is what dreams are made of
You have to love the story of an orphan made good, right?Dust the koala, who is under the care of a
...[详细]You can track someone's live location and where they live for just a couple of dollars
There is a black market offering deeply personal information on people in China, and all you need is
...[详细]You'll actually want to watch these stop
How much time do you spend waiting for stuff to load?Not as much time as animator Raphael Vangelis t
...[详细]Twitter grants everyone access to quality filter for tweet notifications
Twitter introduced two features Thursday in an effort to give users more control on what notificatio
...[详细]Science is already political. Get over it and start marching.
As the March for Science in Washington, D.C., grows, so does its criticism. This should be expected.
...[详细]Cat gets stuck in the most awkward position ever
The 27 hardest job interview questions, according to Glassdoor
