An artist can draw a baby daikon radish wearing a tutu and walking a dog, even if theyve never seen one before. But this kind of visual mashup has long been a trickier task for computers.
Now, a new artificial-intelligence model can create such images with clarity and cuteness.
This week nonprofit research company OpenAI released DALL-E, which can generate a slew of impressive-looking, often surrealistic images from written prompts such as an armchair in the shape of an avocado or a painting of a capybara sitting in a field at sunrise. (And yes, the name DALL-E is a portmanteau referencing surrealist artist Salvador Dal and animated sci-fi film WALL-E.)
While AI has been used for years to generate images from text, it tends to produce blobby, pixelated images with limited resemblance to actual or imaginary subjects; this one from the Allen Institute for Artificial Intelligence gives a sense for the recent state of the art. However, many of the DALL-E creations shown off by OpenAI in a blog post look crisp and clear, and range from the complicated-yet-adorable (the aforementioned radish and dog; claymation-style foxes; armchairs that look like halved avocados, complete with pit pillows) to fairly photorealistic (visions of San Franciscos Golden Gate Bridge or Palace of Fine Arts).
The model is a step toward AI that is well-versed in both text and images, said Ilya Sutskever, a cofounder of OpenAI and its chief scientist. And it hints at a future when AI may be able to follow more complicated instructions for some applications such as photo editing or creating concepts for new furniture or other objects while raising questions about what it means for a computer to take on art and design tasks traditionally completed by humans.
DALL-E is a version of an existing AI model from OpenAI called GPT-3, which was released last year to much fanfare. GPT-3 was trained on the text from billions of webpages so that it would be adept at responding to written prompts by generating everything from news articles to recipes to poetry. By comparison, DALL-E was trained on pairs of images and related text in such a way that it appears able to respond to written prompts with images that can be surprisingly similar to what a person might imagine; OpenAI then uses another new AI model, CLIP, to determine which results are the best. (CNN Business was not able to experiment with the AI independently.)
Aditya Ramesh, who led the creation of DALL-E, said he was surprised by its ability to take two unrelated concepts and blend them into what appear to be functional objects, such as avocado-shaped chairs, and to add human-like body parts (a mustache, for instance) to inanimate objects such as vegetables in a spot that makes sense.
OpenAI, which was cofounded by Elon Musk and counts Microsoft as one of its backers, has not yet determined how or when it will release the model. For now, the only way you can try it is by editing prompts on the DALL-E blog post by choosing different words to complete them from drop-down lists: For instance, the prompt for an armchair in the shape of an avocado can be changed to a clock in the form of a Rubiks cube. Even within those limits, however, there are plenty of ways to manipulate the prompts to see what DALL-E will produce, whether thats a rather 80s-style cube clock, a cross-section view of a human head, or a tattoo of a magenta artichoke.
Mark Riedl, an associate professor at the Georgia Institute of Technology who studies human-centered AI, said the images produced by the model appear really coherent. Despite the fact that he cant access DALL-E directly, it is clear from the demo that the AI understands certain concepts and how to blend them visually.
You can see it understands vegetables, it understands tutus, it understands how to put a tutu on a vegetable, he said, noting that hed probably place a tutu on a vegetable in a similar fashion.
OpenAI did allow CNN Business to send in several original prompts that were run through the model. They were: A photo of a boat with the words happy birthday written on it; A painting of a panda eating cotton candy; A photo of the Empire State Building at sunset and An illustration of a flamingo playing tennis with a cat.
The resulting images seemed to reflect strengths and weaknesses of DALL-E, with pandas that appeared to calmly munch on cotton candy and computerized visualizations of a sort-of Empire State Building as the sun set. It turns out that its hard for the model to write longer words or phrases on objects (and perhaps it wasnt extensively trained on images of boats), so the boats it depicted looked a bit weird and just one of the results we received had a very clear happy birthday. Its also difficult for DALL-E to deliver clear results for prompts that include lots of objects. As a result, many of the flamingo-playing-tennis-with-a-cat images looked a bit, well, strange.
While its successful at some things, its also kind of brittle at some things, Ramesh explained.
Riedl, too, tried to test DALL-E by editing one of the prompts to something he expected it wouldnt have much training data on: a shrimp wearing pajamas, flying a kite. That combination led to images that were fuzzier and more blob-like than those of the radish in the tutu walking a dog.
Perhaps thats because the more well-trodden a concept is in the dataset which was pulled from whats on the internet the more comfortable an AI model will be at playing around with it, he said. Which is to say that what really surprised him is how many pictures of cartoon vegetables there must be online.
- 10 of the best talented Calgary tattoo artists to get inked by | Curated - Daily Hive - March 8th, 2021
- CURTIS HONEYCUTT: With friends like these ... | Features | albanyherald.com - The Albany Herald - February 17th, 2021
- Stephen Bear branded sick by fans for pretending girlfriend was pregnant with twins with scan ripped off Goo - The Sun - February 10th, 2021
- Local tattoo shops see increase in business as the COVID-19 pandemic continues - The Morning Sun - February 7th, 2021
- Nagaland Locals Shift House On Foot, Watch Video: Trending Topics, Viral Videos and Funny Memes of The Day - LatestLY - February 7th, 2021
- Justice League's Snyder Cut Is Fixing The Most Hated Part Of Leto's Joker - Screen Rant - February 4th, 2021
- Anderson: Sarasota fugitive still running, only now the chase is on to catch him - Sarasota Herald-Tribune - January 30th, 2021
- Married teacher found guilty of having sex with student in a field - Yahoo News Australia - January 30th, 2021
- 23 Fun Long Nail Designs to Copy in 2021 - The Trend Spotter - January 30th, 2021
- One Of The Proud Boys Who Stormed The Capitol Had Instructions For Making Guns And Bombs In His Home, FBI Says - BuzzFeed News - January 30th, 2021
- These Amazing Quilters Will Inspire You To Take Up A New Pandemic Hobby - HuffPost Canada - January 30th, 2021
- Tattoo industry striving to safely ink their way through pandemic - KXXV News Channel 25 - January 25th, 2021
- Former Xbox, SEGA, And EA Head Peter Moore Returns To Gaming - Screen Rant - January 22nd, 2021
- Feds: Man arrested near US Capitol had truckload of weapons - Daily Mountain Eagle - January 15th, 2021
- Tattoo artists share 6 of their favorite designs to ink, and 5 they don't really like - Yahoo News - January 12th, 2021
- US Capitol riot: the myths behind the tattoos worn by 'QAnon shaman' Jake Angeli - The Conversation UK - January 12th, 2021
- The Myths Behind the Tattoos Worn by 'QAnon Shaman' Jake Angeli - Snopes.com - January 12th, 2021
- Khanyi Mbaus racy tattoo has got the timeline buzzing - All4Women - January 12th, 2021
- Records: Alabama man on bond arrested after Capitol riot - Daily Mountain Eagle - January 12th, 2021
- How Memorial Tattoos Can Help With The Grieving Process - HuffPost - January 9th, 2021
- Stefflon Don Shows Off Upper Thigh Tattoo In Gucci Swimsuit During Ghana Vacation - The Inquisitr - January 9th, 2021
- George Gerdes, Bosch and Girl With the Dragon Tattoo actor, dies at 72 - Yahoo Entertainment - January 5th, 2021
- Taking a look at the Most Useful Android Apps - Programming Insider - January 5th, 2021
- Suspects charged in connection with Steelton shooting - PennLive - January 5th, 2021
- Skin in the game: why getting a tattoo helped me achieve my goals - The Guardian - January 3rd, 2021
- How the Networks Will Fill Airtime on a Quiet New Years Eve - The New York Times - December 31st, 2020
- Why Werent We All Invited To Neymars New Years Eve Party? - The18 - December 31st, 2020
- Mars is revealing its angel, devil and heart "tattoos" as ice melts at its south pole - SYFY WIRE - December 27th, 2020
- Turn Your RPG Character's Into Inked Showcases With The Tome of Mystical Tattoos - TheGamer - December 27th, 2020
- Bloke asks for his mums advice on what tattoo to get and takes her answer WAY too seriously - The Irish Sun - December 23rd, 2020
- Bloke asks for his mums advice on what tattoo to get and takes her answer WAY too seriously - The Sun - December 21st, 2020
- Cyberpunk 2077: The Face Tattoos, Ranked - TheGamer - December 17th, 2020
- The 25 Best Latin Songs of 2020: Staff Picks - Billboard - December 17th, 2020
- Cardi B Is Being Sued For The Use Of A Tattoo On Her Album Cover - mit inc - December 12th, 2020
- This Mom Tattooed Her Toddler & We're Actually On Board With It - Yahoo Lifestyle - December 12th, 2020
- Inked for The Very First Time: Madonna shares behind-the-scenes photos of first tattoo at 62 - The Independent - December 9th, 2020
- Keke Palmer Showcases Upper Thigh Tattoo In Tiny Plaid Dress & Leather Knee-High Boots - The Inquisitr - December 8th, 2020
- Sophie Turner shares a never-before-seen photo with Joe Jonas from her pregnancy - Insider - INSIDER - December 6th, 2020
- Zlatan Ibrahimovic Or Memphis Depay Or Sergio Ramos: Whos Got The Best Tattoo On Their Back? - IWMBuzz - December 3rd, 2020
- Oliver Peck Net Worth | What is Tattoo Artist Oliver Peck's Net Worth? - The Cinemaholic - December 2nd, 2020
- Rulers of the Upper Realm, Thunderbirds Are Powerful Native Spirits - National Audubon Society - December 1st, 2020
- Through Positive Eyes: living with HIV and Aids - a photo essay - The Guardian - December 1st, 2020
- A Life On Our Planet: 10 Behind The Scenes Facts You Need To Know - Screen Rant - November 27th, 2020
- Lockdown-defying tattoo shop raided for second time as owner wrongly cites Magna Carta - The Samford Crimson - November 27th, 2020
- EndSARS Protester Inscribes Tattoo On His Chest To Commemorate The Killing Of Nigerians At The Lekki Toll Gate (Photos) - GH Gossip - November 21st, 2020
- Born into occupation, young Afghans fear the Taliban will crush their freedoms when US troops exit - The Bakersfield Californian - November 21st, 2020
- David Fincher: Studios don't want to make anything that can't make billions - FOX 28 Spokane - November 20th, 2020
- BEST PLACES TO GET TATTOOS ON YOUR BODY - Artvoice - November 16th, 2020
- David Fincher: Studios don't want to make anything that can't make billions - lcbcradio.com - November 16th, 2020
- Family Fun: Rocking joy into the world with vibrantly painted rocks - The Spokesman-Review - November 16th, 2020
- The Inconclusive World of Tattoos in the Workplace - Fordham Observer - November 12th, 2020
- Police issue CCTV images of three men over incident on train via Dalmuir - Clydebank Post - November 12th, 2020
- Images released of men after rammy on board Glasgow train - Glasgow Times - November 11th, 2020
- 'I'd been avoiding looking at myself': Breast cancer survivors reveal how mastectomy tattoos changed them - 7NEWS.com.au - November 11th, 2020
- Red Notice: Ryan Reynolds Edits Young Versions of Him & Dwayne Johnson Into Image - Screen Rant - October 31st, 2020
- The Weeknd Likes to Keep a Lot of Things a Mystery Potential Tattoos Included - POPSUGAR - October 30th, 2020
- MAGNUM To Release Special Album, Dance Of The Black Tattoo, In January - bravewords.com - October 24th, 2020
- Images released of suspect in four North York break-and-enters - Toronto Sun - October 23rd, 2020
- 25 Carefree Bird Tattoos for Men in 2020 - The Trend Spotter - October 16th, 2020
- Before They Were Tatted: 10 Rockers Before + After Their Tattoos - Loudwire - October 14th, 2020
- Perthshire farm worker posing as teen rumbled in online paedophile trap by tattoo of his own name - The Courier - October 10th, 2020
- 20 Unforgettable Moon Tattoos for Women in 2020 - The Trend Spotter - October 9th, 2020
- V,I, Council on the Arts celebrated Arts and Humanities Month - Virgin Islands Daily News - October 9th, 2020
- First fossil feather found belonged to this dinosaur - Deccan Herald - October 6th, 2020
- True Meaning behind Paris Jackson & Godfather Macaulay Culkin's Matching Spoon Tattoos - AmoMama - October 6th, 2020
- Artists Quarantine With Their Art Collections - Hyperallergic - October 4th, 2020
- Survivors, First Responders Use Tattoos To Cover Scars From The Route 91 Shooting - KNPR - October 2nd, 2020
- First Fossil Feather Ever Found Belonged to This Dinosaur - The New York Times - September 30th, 2020
- Dolly Parton Addresses Those Tattoo Rumors, Reveals the Moving Reason Behind Her Tasteful Ink - Yahoo Entertainment - September 24th, 2020
- Chinese city orders taxi drivers to remove tattoos (for the women and children) - bdnews24.com - September 24th, 2020
- Chinese city orders taxi drivers to remove tattoos for the women and children - Deccan Herald - September 22nd, 2020
- People are getting coronavirus-themed tattoos of masks, toilet paper - Insider - INSIDER - September 20th, 2020
- Surveillance Images Show Denver Burglar Who Has 25 Tattooed On Forehead - CBS Denver - September 18th, 2020
- The Black Lives Matter Movement Will Change the Future of Tattooing - Yahoo Lifestyle - September 10th, 2020
- Conroe man hit with huge 60-year sentence - Woodlands Online - September 9th, 2020
- Daytonian of the Week lets her artwork tell the story it wants to communicate - dayton.com - September 9th, 2020
- Artist selected to paint mural on Garrett City Hall - KPCnews.com - September 8th, 2020
- How to deal with your negative inner voice when running - The Irish Times - September 7th, 2020
- Jada Kingdom Shows Off Tattoo Of Boyfriends Name On Her Neck - DancehallMag - September 6th, 2020
- Jungkook Reveals New Tattoo With Meaning That Warms The BTS Army's Hearts - Talent Recap - September 2nd, 2020