Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
(责任编辑：時尚)
This German startup wants to be your bank (without being a bank)
Adele paid tribute to Prince, but not with a cover
'The Wicker Man' director Robin Hardy dies at 86
Giants pitcher makes a miracle catch while arguing with an umpireDid our grandparents have the best beauty advice?The five guys who climbed Australia's highest mountain, in swimwear
Climbing a freezing cold mountain is already hard enough work. But in briefs? Nope. 。It's too late fo
...[详细]Super Typhoon Nepartak is an example of terrifying meteorological perfection
The western Pacific Ocean had been building up heat for a record 200 days without the churning from
...[详细]Mick Fanning triumphantly returns to surf where he was attacked by a shark
One year ago, Mick Fanning was counting his lucky stars.The Australian surfer had just been on the e
...[详细]Chinese fans are really upset that Lady Gaga hung out with the Dalai Lama
Lady Gaga's little monsters in China have their fangs out about her recent meeting with the Dalai La
...[详细]Dog elected for third term as mayor of Minnesota town
Hopefully he has a human chief of staff. 。Duke the Great Pyrenees is the only dog that's ever been el
...[详细]You can't use food stamps online. This organic grocery startup wants to change that.
Online organic grocery startup Thrive Market has faced plenty of hurdles familiar to any business tr
...[详细]Introducing the most awkward three
The entirety of North America should be incredibly embarrassed.United States President Barack Obama,
...[详细]We guess you could display flowers in this suspiciously NSFW vase
Looking for a new vase? Here's one you could put flowers in. But, like, wouldn't that be kind of wei
...[详细]Sound the alarms: Simone Biles finally met Zac Efron
Is there anything Simone Biles can't do?The unstoppable gymnast just won her fifth medal of the Rio
...[详细]
Evolvejust leveled up.The 2015 game from Turtle Rock Studios is entering into what the developer cal
...[详细]