Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
(责任编辑：焦點)
17 questions you can answer if you're a good communicator
Iggy Pop has an adorable cockatoo named Biggy Pop
8 innovations that could actually make airplanes more comfortable
WhatsApp now supports endOver 82,000 evacuate as Blue Cut fire rapidly spreads in southern CaliforniaFyvush Finkel, Emmy winner for 'Picket Fences,' dies at 93
NEW YORK (AP) — Actor Fyvush Finkel, the plastic-faced Emmy Award-winning character actor whos
...[详细]Airport reopens, PM says 'normal life' resumes in Brussels after attacks
Twenty airlines resumed flights from Brussels Airport and the gate B section fully reopened on Wedne
...[详细]Thailand says nevermind the drought, annual water gun fight is on
BANGKOK — Drought? What drought? Bring out the water guns!Thailand may be going through its dr
...[详细]Bruce Springsteen cancels North Carolina show in response to anti
Bruce Springsteen has canceled a Sunday show in Greensboro, North Carolina, in response to House Bil
...[详细]Olympian celebrates by ordering an intimidating amount of McDonald's
It's no secret that Olympians have to eat clean for years to ensure they're at peak physical conditi
...[详细]JoJo the golden retriever is your ideal dental assistant
Finally, a reason other than dental health to attend your yearly dentist appointment.JoJo is an ador
...[详细]New Apple Watch bands are next level stylish
Since the beginning, Apple Watch has attempted to align itself with fashion andtechnology, insisting
...[详细]Oculus early adopters furious when orders get delayed for months
The Oculus Rift has officially been out for about two weeks -- but you wouldn't know it.For every pe
...[详细]Watch MTV's Video Music Awards 2016 livestream
It's MTV Video Music Awards night. Are you ready?Kanye's going to be there, and he's going to say th
...[详细]Executions went way up in 2015, mainly fueled by three countries
Governments across the globe executed 573 more people in 2015 than in 2014, a 54% increase for natio
...[详细]