Today marks the release of Dream Machine, a groundbreaking AI model that creates high-quality, realistic, and fantastical videos from text instructions and images. Dream Machine, built on a scalable, efficient, and multimodal transformer architecture, is trained directly on videos. This unique training allows it to generate physically accurate, consistent, and action-packed scenes. Starting today, Dream Machine is available to everyone for free. Try it here: Dream Machine.

Humans have an innate drive to build and create, finding joy and purpose in the process. Luma is committed to developing general AI systems that empower individuals to craft beautiful, powerful, and creative works previously thought to be inaccessible or even impossible. The goal is to create an imagination engine where users can experiment with elements and construct new worlds. This AI system promises to be super intelligent, expressive, and fast enough to ensure that creativity knows no bounds.

Dream Machine is the first in a series of frontier generative models aimed at helping users dream with images, videos, text, and other expressive inputs. Unlike image-animation models, Dream Machine is a true video generation model. It is remarkably fast for its class and capabilities, with continuous improvements planned to eliminate any limitations for creators. The development of Dream Machine involved collaboration with Amazon Web Services (AWS) and their state-of-the-art H100 training infrastructure, SageMaker HyperPod. Early feedback has been extremely positive, akin to unleashing a thousand creative minds.

The creation of Dream Machine was the result of efforts by a small, exceptionally talented team of researchers, engineers, and designers. This team is driven by a passion for developing general intelligence in its most beautiful and useful form. They push themselves to the limits, working intensely in a collaborative environment with ample resources. Those who believe their best work is still ahead of them are encouraged to join this innovative team.

‍
This blog post is AI generated with input from the following sources:

• Luma Labs Dream Machine - Authors: Lumalabs.ai, Publish Date: 2024-06-12