The Midnight Sky

Framestore assembled a sci-fi dream team to join Production VFX Supervisor Matt Kasmir; academy award-winning VFX Supervisor Chris Lawrence (Gravity, The Martian), Animation Supervisor Max Solomon (Gravity), VFX Supervisor Shawn Hillier (Star Wars: Episodes 2 & 3) and Graham Page (Interstellar), delivering nearly 500 shots across the studios in London and Montréal. The team were tasked with high-level CG facial replacements, building the Aether ship and interior, as well as ‘Sick Earth’ and it’s foreboding environment. 

Clooney admitted that his role as a stranded astronaut in Alfonso Cuarón’s Gravity (for which Framestore's work was recognised with the Academy Award for Best Visual Effects) helped him to conceive some of the space sequences, telling Vanity Fair, “once you’re in the antigravity kind of world...up isn’t up, and down isn’t down.” To emulate zero-G and help to sell a pregnant Sully floating in space (Jones was actually pregnant at the time of shooting), digital face replacements were required for the wide, full CG shots; totalling 30 shots in the stand-out ‘Space Walk’ sequence. Incredibly high resolution Anyma scans were combined with cutting edge proprietary shaders to create convincing high-res digital faces, which were then keyframe animated. “The Anyma capture for the performance gave us an animated mesh of the actor that you can use to drive animation,” explains Page, “but there’s a lot of clean-up work for that to be usable - especially around the eyes and the mouth.”

Adds Max Solomon, Animation Supervisor, “The head motion and eyelines were adjusted to work with specific actions and the position of the camera. In some shots it was quite nuanced, enhancing eye darts and blinks while in others we made broader changes to head angles and eyelines. Considerable sensitivity had to be used though as it was surprising how quickly small adjustments made shots feel broken.”

The Space Walk sequence sees the characters clad in incredibly-detailed CG suits, designed by Jenny Eagan, using CAD, patterns and scan data from FBFX, as they float in space. “We worked closely with the editor Stephen Mirrione in designing the digital shots and combining separate takes into longer shots through hidden transitions,” explains Solomon. “We also used our animator friendly simulation toolset for the tethers to allow the animators to integrate the tether motion into the performance of the astronauts.”

The ‘Aether’ ship, housing the crew returning from their reconnaissance to Jupiter, was designed by Jim Bissell, Production Designer of E.T. fame, with the support of Framestore’s Art Director, Jonathan Opgenhaffen. Drawing from the studio’s archive of spaceship parts, Aether evokes the futuristic feel of the film while staying grounded with the tangible technology of today. Using parts of the ISS, existing NASA technology and cutting-edge 3D printed technology, the team were then able to focus on the details and texture of the ship to make it realistic. “The buzz word was topological optimisation,” explains Opgenhaffen. “The ship’s components had to work practically; it’s beauty stems from its functionality and availability of existing and emerging technologies.” 

The team also created nuanced, ominous imagery to imply the idea that something has caused this global catastrophe. “Sick Earth is a huge character,” notes Lawrence. “It’s purposefully left ambiguous so you ask questions without necessarily receiving answers.” Layers of clouds, some curling towards the sky mirroring fingers reaching up to space, are the main aesthetic cue. “It’s not a natural phenomenon, so there’s a bit of speed that is visible from space; we played around with FX passes in comp to create additional movement,” adds Hillier.

The shoot of Ausgustine on earth took place in Iceland with 70 mph winds and freezing temperatures; although the actual amount of snow posed some problems. “Unfortunately when they went to shoot the plates, a lot of the snow had melted so we had to replace it,” explains Hillier. “We’d worked on snowy landscapes recently for the first season of His Dark Materials, but we really had the opportunity to push our snow shaders further to hold up in all of the close-up shots of the snow moving across the surface of the ground, with the light scattered through it.” 

Pre-production Supervisor Kaya Jabar, then at The Third Floor London, led a virtual camera shoot of the set, before designing a virtual LED shoot plan for screens in the observatory. Working closely with Lawrence, Jabar’s team created a suite of tools using Unreal Engine to tie together a virtual camera and an LED screen simulator that was accurate to the exact panels used on the day. Says Jabar, “I do believe that we were amongst the first people to plan it that way. I just applied the logic that if we can virtually plan a shoot and show you what will replace a green screen, then we can do the same with LED screens.”

The VFX on The Midnight Sky needed to be as seamlessly- integrated, photoreal and realistic as possible. “Ultimately, George wanted the drama to be grounded, “ adds Lawrence, “ The language of the film, especially in those moments you’re with George stuck in isolation, is emphasised by the static locked-off camera and beautiful composition of the scene. It was a nice place to be in; to complement the filmcraft rather than going all out in showy VFX.”

How The Midnight Sky VFX team pulled off the film's most shocking scene  - Before and afters

Inside The Midnight Sky’s Groundbreaking VFX - Netflix Film Club

A ‘Midnight Sky’ VFX conversation—Part 1: LED walls, spaceships and CG face replacements - Before and afters

‘The Midnight Sky’ Soars Into Oscar Race as Director George Clooney’s Magnum Opus' - Variety

Making of 'The Midnight Sky': How George Clooney Battled Extreme Cold (and a Pandemic) to Make His Sci-Fi Epic - The Hollywood Reporter

The Midnight Sky: From the artic to deep space in search of a refuge for humanity - VFX Voice

Framestore Returns to Space for George Clooney’s ‘The Midnight Sky’ - Animation Magazine

The Midnight Sky: Matt Kasmir & Chris Lawrence Interview - Art of VFX