Photorealistic Water: The NYAD Experience with DNEG

By Jeffrey Higgins, Head of CG at Double Negative, and speaker at the VANAS Conference

Visual effects (VFX) have come a long way, with studios constantly pushing the boundaries of realism and innovation. At Double Negative (DNEG), our work on the award-winning film NYAD stands as a testament to the heights that photorealistic water simulations can achieve. This article delves into the complexities and triumphs of creating lifelike water effects for NYAD, highlighting our unique approach and the lessons learned that are shaping the future of VFX.

Jeffrey Higgins is a seasoned Visual Effects (VFX) artist with over 20 years of experience, specializing in FX design, lighting, and compositing to create photorealistic imagery. He has worked with leading studios such as MPC, Animal Logic, ILM, and Sony Imageworks, and is currently the Head of CG at Double Negative in Vancouver, British Columbia. Known for his attention to detail and innovation, Jeffrey also has a background in Research & Development (R&D), where he codes solutions to enhance visual effects.

The Story Behind NYAD

NYAD tells the remarkable real-life story of Diana Nyad's grueling 101-mile swim from Cuba to Miami, a feat accomplished after four previous unsuccessful attempts. Directed by Elizabeth Chai Vasarhelyi and Jimmy Chin, the film needed to portray the vast and relentless open ocean, making water a crucial element of the storytelling. With over 250 shots requiring CG water replacement, our challenge was to ensure that the water not only enhanced the narrative but also seamlessly integrated with live-action footage.

The Importance of Collaboration and Innovation

At DNEG, effective collaboration and pushing creative boundaries are at the heart of what we do. For NYAD, our team of VFX professionals worked tirelessly to develop and implement a custom pipeline tailored to the unique needs of the project. This approach allowed us to deliver high-quality, photorealistic water simulations that were critical to the film’s success.

Pipeline Development: A Custom Approach

To meet the demands of the project, we deviated from the traditional Clarisse pipeline for lighting, opting instead for a Houdini-centric workflow. This shift was driven by time constraints and the need for a streamlined process. By using Houdini’s Mantra renderer, we ensured ease of asset sharing between the FX and lighting teams, ultimately enhancing our efficiency.

Key Pipeline Features:

Custom Houdini Workflow: We established a Houdini-centric pipeline to manage the complex water simulations, utilizing Mantra as our primary renderer. This setup allowed us to develop assets completely within Houdini, facilitating smoother transitions between different departments.
Distributed Simulations: While we used distributed simulations minimally, the capability to launch simulations on a farm was crucial for managing the large-scale water effects required by the film.
Look Development: Assets were meticulously developed in Houdini’s Mantra renderer, ensuring that each detail was crafted to meet the film’s high standards for realism.

Anatomy of a Shot

Creating photorealistic water involves more than just advanced technology; it requires a deep understanding of both the physical properties of water and the specific needs of each shot. Here’s a breakdown of our process:

Initial Setup: With no reference material or tracking markers available for the shots, our team faced the challenge of accurately capturing water dynamics. We relied on meticulous work by the talent crew to ensure that the simulated water matched the live-action footage.
CG Environment: To aid in lighting, our DFX Supervisor built a CG environment in Terragen, complete with CG clouds serving as the HDRI base. This setup was essential for achieving realistic lighting conditions for the water.
Progressive Simulation: We employed Houdini 18.0’s out-of-the-box nodes in a small-scale template, derived from a larger-scale water template developed during our work on Greyhound. This approach allowed us to fine-tune simulations without overwhelming the system with unnecessary complexity.
Integration and Enhancement: The goal was not to overshadow the film’s performances but to enhance them. Careful sculpting of the water simulations ensured that the ocean’s appearance supported the narrative of direction, speed, and scale, rather than distracting from it.

The Water Simulation Process

Creating photorealistic water is both an art and a science. Our approach involved several key steps:

Custom Solvers: Although we used Houdini’s standard solvers for the most part, minimal custom modifications ensured that the water simulations were tailored to the specific needs of NYAD.
Rendering and Integration: The rendering process was designed to blend seamlessly with the live-action footage. This required meticulous attention to detail to ensure that the CG water felt like a natural part of the film’s environment.
Feedback and Iteration: Continuous feedback loops between the FX, lighting, and compositing teams helped refine the water effects, ensuring that each shot met our high standards of realism.

Looking Ahead: The Future of Photorealistic Water

As we move forward, DNEG is adopting a new USD-centric pipeline using Houdini and Pixar’s PRman Renderer in Solaris for lighting. This updated approach leverages multiple renderers, including Houdini’s built-in Karma renderer, to further enhance our capabilities.

Upcoming Developments:

New Pipeline: Our transition to a USD-centric pipeline is designed to improve workflow efficiency and maintain the high quality of our water simulations.
Ongoing Projects: We are applying the lessons learned from NYAD to current projects, ensuring that the scale and quality of our work continue to advance.
Future Innovations: We are committed to exploring new techniques and technologies to push the boundaries of photorealism and continue delivering exceptional visual effects.

Key Takeaways

Collaboration is Crucial: Effective teamwork and clear communication between departments are essential for achieving high-quality results.
Custom Pipelines Enhance Efficiency: Tailoring workflows to the specific needs of a project can significantly improve efficiency and output quality.
Attention to Detail Matters: The success of photorealistic effects lies in the meticulous attention to detail and the ability to integrate CG elements seamlessly with live-action footage.

Wrapping up

The work done on NYAD represents a significant achievement in the realm of photorealistic water simulations. Through innovation, collaboration, and a relentless pursuit of quality, DNEG has set a new standard for VFX in film. As we continue to evolve and embrace new technologies, our commitment to excellence remains unwavering. The lessons learned from NYAD will undoubtedly shape the future of visual effects, driving us to new heights of creativity and technical mastery.

For those interested in pursuing a career in VFX or animation, the techniques and insights shared here highlight the importance of both artistic vision and technical expertise. At VANAS Online Animation School, we offer programs in Animation, Visual Effects, and Video Games that can help you launch your career in this exciting field. Learn more about our programs at VANAS and start your journey towards mastering the art of visual effects today.