Sign In

Communications of the ACM

ACM TechNews

New Algorithm Can Create Movies From Just a Few Snippets of Text

View as: Print Mobile App Share:
Artificial intelligence is moving into movie production.

A new algorithm creates videos from text snippets.

Credit: ShareGrid/Unsplash

Researchers at NEC Laboratories America and Duke University have developed an algorithm that creates videos from text snippets.

The first stage of the process involves a "generator" neural network using text to produce a blurry image of the background with an unfocused blob where the main action occurs. The second stage derives a video from both this "gist" and the text, producing a short video.

A second network functions as a "discriminator" during training by watching the generated video alongside a real video of the action described in the text, and is taught to pick the real one. This network's critical ability improves over time, with its feedback setting a higher standard for the generator network.

The team trained the algorithm on 10 types of scenes, and a simple classification algorithm correctly guessed the intended action among six choices about 50% of the time.

From Science
View Full Article


Abstracts Copyright © 2018 Information Inc., Bethesda, Maryland, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account