Google DeepMind has partnered with Darren Aronofsky’s Primordial Soup to debut “ANCESTRA,” a short film premiering at the Tribeca Festival. Directed by Eliza McNitt, the film innovatively combines live-action sequences with video generated by Veo, Google’s advanced video generation model. This collaboration aims to push the boundaries of storytelling by putting generative AI into filmmakers’ hands. “ANCESTRA” leveraged Google DeepMind’s Gemini for prompt development and Imagen for concept art, with Veo animating scenes and providing new capabilities like personalized video generation, precise motion matching, and seamless blending of live-action and AI-generated footage. These advancements allowed for the creation of complex scenes, such as realistic babies in utero or intricate camera movements, demonstrating how generative AI can complement traditional filmmaking workflows to overcome creative and practical limitations.
https://deepmind.google/discover/blog/behind-ancestra-combining-veo-with-live-action-filmmaking/