Microsoft AI Can Draw Pictures Based On Verbal Descriptions

first_img Robot Dog Astro Can Sit, Lie Down, and Save LivesMIT’s AI Knitting System Designs, Creates Woven Garments Let us know what you like about Geek by taking our survey. Stay on targetcenter_img Many of you installed Google’s Arts and Culture app to see which famous portrait its AI though you most looked like. Microsoft’ AI researchers have been working on something in the same vein.Instead of matching an uploaded images to other existing images, however, the team at the company’s Deep Learning Technology Center have been training an AI to create images from scratch. All the AI needs is a list of keywords to go by.To be clear, what’s going on in the image at the top is not what happens when you go to Google or Bing and perform a search. The AI didn’t sift through a stash of images to find something that matched up with the keywords provided. Instead, principal researcher Xiaodong He says “[…] here, the pictures are created by the computer, pixel by pixel, from scratch.”There’s no guarantee you’d find that what the AI produces in an Audobon guide, either. He goes on to say “these birds may not exist in the real world — they are just an aspect of our computer’s imagination of birds.”The team also fed the bot more outlandish suggestions to see how it would respond. A yellow and black bird is simple enough — there’s plenty of source material to draw on. It wasn’t nearly as certain what to make of  “a red double-decker bus is floating on a lake.” While a human artist could have sketched that up easily enough, the AI produced “a blurry, drippy image that resembles both a boat with two decks and a double-decker bus on a lake surrounded by mountains.”Why the difficulty? The AI knows what a bus looks like and it knows what a lake is. It also knows that a lake is not a bus’ natural habitat. Logic is getting in the way, so the bot throws in the boat because that’s the kind of vehicle it expects to appear in the water.That doesn’t make what Microsoft’s bot can do any less impressive, and it will become more humanlike as researchers find mathematical ways to mimic human creativity.While you can’t experiment with this AI yourself, you can play around with another Microsoft project that helped pave the way for it. A few years back they introduced Captionbot, which will make an educated guess about the contents of an image you upload.last_img read more