Introducing EDGE: Editable Dance Generation from Music, an innovative AI tool that brings your music to life with stunning choreographies. By leveraging music embeddings from the Jukebox model, EDGE is able to understand and interpret music in order to create high-quality dances that perfectly harmonize with the audio.
Utilizing a conditional diffusion model, EDGE maps the music embeddings into a series of 5-second dance clips. What sets EDGE apart is its ability to impose temporal constraints on batches of sequences, allowing for the generation of dances of any length. By applying these constraints, EDGE ensures temporal consistency and creates seamless transitions between clips, resulting in a fluid and captivating dance experience.
One of the standout features of EDGE is its support for arbitrary spatial and temporal constraints. This means that you can impose joint-wise constraints, such as generating lower body movements based on upper body motion, or vice versa. Additionally, EDGE enables motion in-betweening, where dances can start and end with pre-specified motions, as well as dance continuation, which allows for dances to start with a specific motion and build upon it.
EDGE is designed with physical realism in mind. The tool avoids unintentional foot sliding, a common issue in dance generation, by incorporating a Contact Consistency Loss. This loss function ensures that foot-ground contact remains intentional and adds complexity to the dance, maintaining a high level of physical realism. This attention to detail has been recognized by human raters, who strongly prefer dances generated by EDGE over previous methods.
With its wide range of applications, EDGE opens up endless possibilities for dance enthusiasts, choreographers, and artists alike. Whether you’re looking to create awe-inspiring performances, design captivating music videos, or explore the creative intersections of dance and technology, EDGE empowers you with the tools to bring your artistic vision to life.
Experience the power of EDGE: Editable Dance Generation from Music and unleash your creativity with this cutting-edge AI tool.
