Kristin here:

There have been rumblings lately about the surfeit of CGI-heavy films, especially superhero movies, and about a certain monotony in the results. Critics and fans are hailing Mad Max: Fury Road, in no little part because George Miller did stage much of the action, with real fantasy vehicles and hair-raising stunts, and employed CGI only when necessary. Among the diehard Peter Jackson fans over on TheOneRing.net, many argue that the emphasis on practical effects over digital in the Lord of the Rings trilogy should have been carried over to the Hobbit trilogy, despite the advances in CGI technology in the nine-year gap between them.

Earlier this month, Variety‘s Brian Lowry published an editorial laying out the problem. He concentrated on the superhero movies that have increasingly come to dominate the tentpole level of big-studio filmmaking:

The ability to mount enormous battles featuring multiple super-powered characters, however, has become its own trap. And while the results can be visually astounding, the movies regularly feel as lifeless and mechanized as the technology responsible for bringing those visions to fruition.

The why of it remains something of a mystery, but the outcome is frequently a hugely expensive–if often enough quite lucrative–tentpole release that certainly puts the money onscreen, yet nevertheless proves more numbing than exciting, even during what should be the show-stopping sequences.

The original “Avengers” was mostly a happy exception, even with its prolonged alien-invasion climax. “Age of Ultron,” while ambitious in exploring relationships among characters, becomes drearily repetitive as the heroes mow down another CGI horde, this time consisting of artificially intelligent robots.

[…]

The pattern has become predictable. “Iron Man,” a terrific movie overall — particularly in capturing the origin story — degenerated into a mundane brawl between two armor-clad characters. Ditto the “Hulk” reboot with Edward Norton, which culminated with the title character’s ho-hum showdown with another green behemoth, the Abomination.

One can argue, in fact, that the much-maligned second “Star Wars” trilogy sacrificed an element of its humanity in George Lucas’ embrace of a wholly digital filmmaking approach. At a certain point, watching droid armies being whacked to pieces begins to yield diminishing returns.

Put more simply, just because CGI wizardry allows you to do something, whether hoisting an entire city into the air or leveling skyscrapers willy-nilly, doesn’t always mean you should. Because while the box office figures might suggest otherwise, there is an audience out there that’s weary of these movies precisely because of the hollow quality to the inevitable final 30 minutes of unrelenting mayhem.

This struck a chord with me, because since the beginning of the year I have seen trailers for several CGI-heavy films. (How many of them begin with an ominous “helicopter shot” high over a CGI city, usually at night?) Most of them melt into each other in my memory, but I do recall that they included Insurgent (the teaser, below left) and Jupiter Ascending (trailer #3, below right).

My reactions to the Insurgent and Jupiter Ascending images were: 1) another burning cityscape with a CGI person flying through the air, and 2) wild horses couldn’t drag me to these.

Compare these two frames with the image at the top of this entry. My reactions to the Mad Max: Fury Road teaser, which I only saw in HD on my computer, were: 1) what a gorgeous shot, 2) why is that guy doing that–he’s crazy, 3) George Miller and all these other people are crazy, and 4) I must see this film ASAP. The same qualities attracted me to The Road Warrior, but this time Miller had a far bigger budget, allowing him to create more vehicles and make them more elaborate.

The increasingly same old-same old quality about superhero films extends to science-fiction films and dystopian future ones.

CGI is a marvelous technology and has been used to create wonderful films, scenes, and characters. Gollum remains one of its most successful and memorable creations. I suspect that many, like me, remember that initial jolt of amazement in the scene in The Two Towers when the mild “Smeagol” and villainous “Gollum” sides of his nature talked to each other, and a sudden switch to shot/reverse shot made his split visible, as if he had two bodies:

It was a brilliant way to handle the scene, but it also depended on us accepting Gollum as a character on the same plane of existence as Frodo and Sam. Yes, the technology for Gollum was improved for his reappearance in The Hobbit, but it wasn’t dramatically better, and the first trilogy was the real breakthrough.

Smaug was another creation where one could hardly deny that CGI was used with astonishing complexity and skill (see bottom). The same is true for The Dawn of the Planet of the Apes and The Rise of the Planet of the Apes (also with effects by Weta Digital, which also managed to fill in scenes involving the late Paul Walker in Furious 7 without barely anyone noticing).

Lest all this become too Weta-centric, I also have seen the teaser for Robert Zemickis’ The Walk a few times. Again there’s a computer-generated cityscape, as in Insurgent and Jupiter Ascending, but the effect is quite different. It’s an attempt to create realism in a story based on actual events; the actor obviously can’t be placed high above New York, and the Trade Towers are gone. The effect is anything but clichéd. That I was to see, too.

Another well-reviewed current science-fiction film, Ex Machina, uses CGI in an original way. David liked it less well than I did, but whatever one thinks of the film as a whole, the robot character Ava is not something we’ve seen on the screen before–at least, not done this way.

Historically, any art form goes through cycles. Hugely successful films will give rise to many imitators, and imitation eventually leads to cliché. The question is, will the filmmakers called upon to make big effects-heavy films make the effort to use CGI in an imaginative way? With sequel after sequel in the largest franchises already planned by the studios for years into the future, will the apparent assumption that flashy CGI is enough to attract the action-movie crowd prove wrong?

The madness of Mad Max

Despite the critics’ emphasis on the practical effects and real locations in Fury Road, it should be pointed out that Miller used quite a bit of CGI in the film. Indeed, he was no stranger to digital effects. For Babe (1995), his team used CGI to achieve the most realistic talking animals in films to that time. (Miller produced and wrote the script, with Chris Noonan directing; he directed Babe: Pig in the City.) Previously talking animals were usually done with puppets and animatronics, but Miller’s team used 3D scans of animals snouts and muzzles and manipulated the results. Babe won the 1996 Oscar for best visual effects. There were no exploding cities, giant armies, or battling superheroes, but experts recognized those moving animal mouths as cutting-edge stuff.

In Fury Road, CGI is used for effects that would be difficult, impossible, or prohibitively expensive otherwise. Furiosa’s missing left wrist and hand are an obvious example, as is the massive sandstorm that hits the fugitives and pursuers.

The blue night scene was shot day for night and then enhanced digitally, presumably with tinting and the addition of stars. The city which is the Citadel’s source of gasoline and is supposedly Furiosa’s goal as her truck sets out early in the film, is shown on the distant horizon but clearly was not built, since none of the action takes place there. The Citadel scenes were done in Australia, while most of the desert material was shot in Namibia. Some parts of the Citadel were built full-scale (e.g., the winch room), while green-screen replaced by digital set extensions supplied the rest. I think I spotted some digital matte paintings in some of the landscapes. But on the whole, Miller stuck to real locations, and most of the scenes of the chases were done with real vehicles and actors, chasing each other around the Namibian desert.

Miller commented, “We don’t defy the laws of physics–there are no flying human beings, no spacecraft–so it doesn’t make sense to do it as CGI. We’ve got real vehicles and real humans in a real desert, and you hope that all that texture will be up there on the screen.” Miller had in fact assumed that he would have to create the “pole cat” sequence, which has men perched on long, swaying poles atop speeding vehicles (above). Action unit director Guy Norris, however, shot a test scene on video, with no CGI. Miller was thrilled: “There were 10 pole cats swaying, coming down the road at speed, all of them on cars, and Guy was on one of the poles filming them. I choked up. I thought, ‘Wow, it’s real. It’s absolutely real.”

According to Simon Gray’s “Max Intensity” in the latest American Cinematographer (not yet online), “Months of rehearsals enabled the stunt crew to perform their choreographed sequences while the vehicles traveled at speeds up to 50 miles an hour.” (AC, June 2015, p. 42)

The reality of it comes through, as in this scene of one of many explosions. The stunt man flinching in the foreground is not the sort of thing you’d see if this were all being faked.

And some of the stunts are not all that different from what we saw in The Road Warrior or Beyond Thunderdome, both made in the pre-CGI days. This scene, for example, among the best in the film, where a motorcycle gang chases Furiosa’s rig.

One reason why Fury Road looks so good is results from Miller’s and and his cinematographer’s decision to avoid the look of most post-apocalyptic movies. Anne Thompson describes their approach: “The cliches of the genre were to desaturate the cinematography. So he and great Australian cinematographer John Seale (dragged out of retirement), saturated the color. ‘We were able to change the skies, and go against the idea that because it’s the apocalypse, there’s no longer any beauty in the world.'” (AC, June 2015, p. 48)

There are desert areas of Africa where the sand is the rich, peachy color that appears in the film. The Namibian desert, however, is not so colorful.

(George Miller, in the official Warner Bros. making-of publicity short)

The film’s senior colorist, Eric Whipp, describes the challenge of differentiating the largely brown, beige, and grey colors of the costumes and vehicles from such backgrounds: “The desert sand in Namibia is, in reality, closer to be gray color, but pushing it toward rich gold colors complemented the characters and vehicles, providing a strong, graphic look. The only other dominant color in the film was blue sky, which we embraced.”

The transformation of the desert into rich yellow and orange tones was done with what was obviously aggressive digital color grading. It runs marvelously counter to the dull blues, browns, and grays that form the dominant look of so many action films.

[May 31: On fxguide, Ian Failes has posted an excellent piece that lays out the practical vs. the digital effects in Fury Road.]

LOTR vs. The Hobbit

Reading Lowry’s comments made me think of Andrew Lesnie, who died recently at the young age of 59. Lesnie had unintentionally played a small but pivotal role in my attempts back in 2002-2003 to get permission to interview the Lord of the Rings filmmakers for my book, The Frodo Franchise. I needed to contact someone high in the production who could be a sort of sponsor for me, helping to gain New Line’s cooperation. The only people I figured could do that would be producer Barrie Osborne or Peter Jackson or Fran Walsh.

In November 2002, I was at a conference in Adelaide, Australia and met Annabelle Sheehan, who at that time was an administrator at the Australian School of Film, Radio and Television. When I told her of my potential project, she offered to put me in touch with Lesnie. I hesitated before responding. I knew that it would be wonderful to interview him, but my subject didn’t relate to cinematography at all. Moreover, he wasn’t in a position to sponsor such a project. Then Annabelle offered to introduce me to Barrie Osborne, which subsequently happened via email. The project became real at that point.

I’ve always regretted that I had no excuse to interview Lesnie. From interviews and his appearances in the supplements for the extended DVD editions of LOTR, he seems a genial man. I also admire the cinematography for LOTR. There’s a great variety in the lighting schemes, and he contributed some very striking moments to the film.

It’s of course very difficult to pin down exactly what Lesnie’s contributions to LOTR were in many scenes, given the considerable dependence on CGI. Still, I think he probably had more affect on the final look of LOTR than he did on The Hobbit. As the three parts of The Hobbit came out, it became increasingly clear that there were no shots or sequences that could stand comparison with the best things in LOTR. I think of well-conceived, dramatic shots like the one in The Fellowship of the Ring where a scene begins with a bucolic view out over a misty morning in the Shire, which is suddenly interrupted by ominous music and the entry from offscreen of one of the Black Riders’ horses.

Another shot I admire is the first exterior after the long sequence of the passage through the Mines of Moria in Fellowship. Gandalf has just fallen into the abyss with the Balrog, and the others flee. The cut to an extreme long shot of the rocky terrain (filmed on Mt. Owen) outside the eastern gate to the Mines is jolting, seemingly switching from a color film to a black-and-white one. A trace of green plants at the lower left is virtually unnoticeable, and only as the camera arcs around to follow the remaining Fellowship’s movements away from the gate (which was added digitally) does a bit of blue sky appear at the upper right and eventually the green of the landscapes in the distance.

Although there are plenty of New Zealand locations in The Hobbit, I can’t think of any that are used as effectively as some of the ones in LOTR–most memorably the Edoras set, which was built full-size on Mount Sunday on the South Island. The swooping helicopter shots around the rocky promontory, with the snowy mountains revolving slowly around it, became iconic moments in the film.

Viewers might think that those background mountains were added digitally, and certainly some scenes, including the ones set at Orthanc, did have backgrounds built up of mountains from a variety of places. The extreme long shots of Rivendell are a patchwork of elements. Not so for Edoras, however. David and I were privileged to fly around Mount Sunday in a small plane–after the Edoras set had been removed–and we saw more or less what one sees in the film.

It was a different time of year, November (the Southern Hemisphere’s equivalent of May), but the mountains are clearly the same ones.

There was a helicopter camera team, so Lesnie might have had nothing to do with these circling shots, nor with the mountain photography for the magnificent Beacons Sequence in The Return of the King (to which the fires were added digitally).

Again, there is nothing to compare with this in The Hobbit, which, I would say, suffers from having so many sequences with CGI-created landscapes.

The only really memorable shot I can think of from The Hobbit is entirely digital, the emergence of Smaug from Erebor, covered in gold, at the end of The Desolation of Smaug. He bursts through the door and soars up away from the camera, shaking the gold off in sparkling droplets.

The shot of the dragon’s death is nearly as impressive, as Smaug falls slowly downward away from the camera.

The problems with The Hobbit arise, I think, because so much of it, especially in the third part, has been conceived as almost entirely digital. Compare these two pre-battle moments from The Return of the King and The Battle of the Five Armies.

As Théoden addresses his troops before their charge during the Battle of the Pelennor, we are clearly watching real riders on real horses, their spears held at various angles. To be sure, the MASSIVE program was used to multiply horses and riders, but primarily in the extreme long shots. Hundreds of real ones were used in the scene. In the background we again see impressive non-CGI snow-covered mountains. There are four characters here about whom we care: Théoden, Éowyn, Merry, and Éomer. The Battle of the Five Armies shot of Thranduil’s troops, in contrast, involves perfect ranks of anonymous Elves, moving in synchronization. There is no actual landscape behind them, just vague patches of blue, brown, and white.

MASSIVE was used here as well, but for far more figures. Wasn’t the program devised to allow digital “extras” to move independently of each other rather than replicating a very limited number of gestures? It’s ironic, since in the film’s endless battle, characters moving in synchronization seem to be the rule. See the moment when the dwarves assemble their shields into a wall against the orcs, with Elves leaping effortlessly over them.

Which brings up the matter of seemingly weightless characters and creatures. There has been much discussion of the fact that Legolas and Tauriel leap about, stand on other characters’ heads while fighting, and bound up collapsing stone staircases. Admittedly, Tolkien says in the blizzard scene of The Fellowship of the Ring that Legolas’ “feet made little imprint in the snow.” But even assuming that Elves are very light, some of the antics in The Hobbit look plain silly.

And it’s not just Elves that zip about in this fashion. Partway through the Battle of the Five Armies, large rams appear out of nowhere. (I gather that their presence will be explained in the extended edition.)

Thorin, Kili, Fili, and Dwalin ride the rams up the sheer pinnacle to reach Azog’s command post. The rams bounce weightlessly and effortlessly up the steep cliffs, looking more like ping-pong balls than heavy animals. Indeed, gravity seems to be defied quite a bit in the films–even putting aside from the fact that the characters are able to survive impossibly long falls without a scratch. I can’t think of cases in LOTR where such things happen.

Much has been made of the fact that The Hobbit contains many echoes of LOTR, in terms of characters, scenes, and even specific repeated lines. I’ve complained about that myself. Yet there are many fans who prefer The Hobbit to LOTR–many of them fangirls obsessing over Richard Armitage (Thorin), Aidan Turner (Kili), Dean O’Gorman (Fili), and/or Lee Pace (Thranduil). Such fans proudly point to the “fact” that the second trilogy had higher box-office totals than did LOTR. In unadjusted dollars, yes. In adjusted dollars, LOTR made considerably more, and that without the benefit of 3D surcharges. I suspect this disparity arose from the fact that LOTR was so extraordinarily original, and because it balanced CGI and practical effects so effectively. The Hobbit tipped far in the direction of CGI, and it shows.

Many studios and filmmakers will continue to rely on the standard look of action/sci-fi/fantasy CGI, at least until it becomes so obviously repetitive that audiences lose interest. But films like Fury Road and LOTR offer models of how CGI and practical effects can be balanced for a much livelier film.

[April 18, 2016: Ex Machina, to the surprise of many, won the Academy Award for best special effects. This was probably because it was so original in its use of effects. After all, most special effects doesn’t equal best special effects.]

Kristin here:

In my previous entry, I described Gravity as an experimental film. I had thought of it that way ever since seeing trailers for it online back in mid-September. I described it as reminding me “of Michael Snow’s brilliant Central Region, but with narrative.”

Last time I developed that notion in more detail and analyzed the narrative structure of the film. Now I’ll analyze the experimental aspects of the film’s style and the dazzling means by which they were created. I don’t have the technical expertise to explain the inventions and ingenuity that went into creating Gravity, so I have sought to pluck out the best quotations from the many interviews and articles on the film and organize them into a coherent layout of how its most striking aspects were achieved.

As in that entry, SPOILER ALERT. This is not a review but an analysis of the film. Gravity does depend crucially upon suspense and surprise, and I would suggest not reading further without having seen the film.

Screaming on the set

I’ve written about Cuarón’s use of long takes, a stylistic device that has drawn a huge amount of attention in the press. Here the editing is so subtly done that even someone like me, who typically notices every cut, missed a lot of them during early viewings. There are bursts of rapid editing, as when the ISS is struck by debris and is destroyed, or more conventional cutting, as when the camera follows the Chinese pod and surrounding remnants of the station as they heat up in the atmosphere.

The long takes go beyond what Cuarón has done before. In Variety, Justin Chang describes one major difference: “As the movie continues, the filmmakers even add a new wrinkle, which Lubezki calls ‘elastic shots’: Takes that go from very wide shots to medium closeups, then segue seamlessly into a point-of-view shot, so the viewer is seeing the action through the character’s eyes, right down to the glare and reflections on a helmet visor.” Such moments are rare in Gravity, but one occurs in the “drifting” portion, shortly after the segment laid out above:

As Cuarón has pointed out, his long takes eliminate the need to cut in to closer views: “The language I have been working on with Chivo in these recent films is not one based on close-ups. We include close-ups as part of a longer continuous shot. So this all becomes choreography.” Another point he makes in this and other interviews is the influence of Imax documentaries on Gravity: “My process of exploring long takes fits in with that IMAX documentary notion, because when they capture nature it isn’t like they can go back and pick up the close-up afterward. There isn’t that luxury in space either. So then it falls to us to find a way to deliver that objective view, but then transform it into a more subjective experience.” Hence the “elastic shots.”

The long takes often dictate a refusal to cut in to reveal significant action. There is the moment in the epic opening shot, for example, when Shariff is suddenly killed in the background while in the foreground Kowalski tries to help Stone detach from her mechnical arm and into the shuttle. Did you see the flying piece of debris that struck his head? I didn’t, not until the fourth time I watched the film, knowing that it was coming and determined to spot it. It’s there, a little white dot that flashes through the frame in a split second. Shariff’s abrupt movement to the side, stopped with a jerk by his tether, is what we spot, since his bright white suit moves so suddenly and quickly, ending up against the pitch black of space:

A great deal happens in such moments of action, and we are left to spot what we can.

If these long takes are dazzling on the screen, think what they must have been like to witness being made. Lubezki has suggested how complicated the long takes in Gravity and earlier films were to shoot:

There are very few director/cinematographer teams working today as well known for a certain aspect of filmmaking as you and Alfonso are, which is that long extended take, or the seamlessly edited take. What it is like actually shooting those scenes?

I’m going to tell you something, the reality is that the movie was so new that when we finished a shot we would get so excited people would scream on set—probably me before anybody else.  There were moments when we were shooting and Alfonso said ‘cut’ we would all just jump and scream out of happiness because we’d achieved something that we knew was very special.

In Children of Men, we also had moments like that. When we finished the first shot inside that car [the aforementioned ambush scene], the focus puller started crying. There was so much pressure that, when he realized he had done a great job, he just started crying.

There is something breathtaking about the achievement of complex long takes that seems not to arise from any other cinematic technique. I have seen Russian Ark three times now, and each time I feel an inexplicable tension, wondering whether the camera team will make it through the entire one-shot film without a mistake. I’ve already seen it happen, and yet it still seems unbelievable that they did.

In Gravity, of course, the “long takes” were not actual lengthy runs of the camera. Nor were they, as in Children of Men, several camera takes stitched together digitally to create lengthy single shots. Rather, they were created in the special-effects animation, with the faces of the actors being jigsawed into them through a complex combination of rotoscoping and geometry builds. (See this Creative Cow article for an example.)

The choice to present the action in long takes was crucial to the look of the film. Most films set in space rely heavily on editing, since for decades the special effects needed to convey space walking were best handled in a series of shots. In Star Trek Into Darkness, Kirk flies through space toward a spaceship breaking up and surrounded by debris, a situation somewhat comparable to that in Gravity. The sequence is built up of many short shots of Kirk against shots of dark space, point-of-view shots through his helmet, and cutaways to characters inside the Enterprise conversing with him via radio. Here’s a brief sample of four contiguous shots:

The sequence conveys little sense of weightlessness, partly because the actor adopts a  traditional superhero-style flying pose. With no air in space, there would be no need to compact oneself into a streamlined shape. The fast cutting keeps repeating similar compositions, as with frames 2 and 4 above, with the fast editing presumably intended to generate excitement. (Star Trek Into Darkness has at least 2200 shots in a little over two hours, while Gravity has about 200 in 83 minutes.) Gravity‘s success in creating a realistic environment in space is dramatically evident when contrasted with this film’s more traditional outer-space conventions.

But it turns out that the commitment to the long take led Cuarón toward less common choices about editing, staging, and lighting.

Follow the bouncing axis

For much of the film, there is minimal spatial stability for the characters or for our viewpoint into the diegetic world. There is no ground, so we cannot imagine the camera resting on anything. When outside the space vehicles, the camera moves nearly all the time. In an interview with ICG Magazine, director Alfonso Cuarón was asked, “So with the camera and characters in constant motion and changing perspective, how did you figure up from down?” He replied:

There is no point of departure because there is no up or down; nobody is sitting in a chair to orient your eye. It took the animators three months to learn how to think this way. They have been taught to draw based on horizon and weight, and here we stripped them of both.

Undoubtedly many scenes contain an axis of action running between the characters, but it is not of a traditional kind. Unlike in a classically edited film, in Gravity‘s action scenes in space, the axis is in constant, fleeting motion, and any given center line between two characters must in quick succession run not only left and right but also up and down, diagonally, in almost any direction. Any given screen direction set up by the axis is ephemeral and offers little to help orient us spatially. Eyeline directions mean very little, since there are few cuts to things that the characters have seen offscreen. (True, when characters look offscreen, they establish eyelines, and the camera sometimes pans from Stone or Kowalski to some object they have been looking at. But a pan from a person to an object automatically establishes the spatial relations between them, whether or not the character is looking at the object.)

As a result, the spatial cues used in continuity editing system are not so much eliminated as made irrelevant for long stretches. That system is meant, after all, to guide our understanding of the story space across cuts. There are exceptions, such as a brief shot/reverse-shot exchange: Stone, loosely attached to the International Space Station (ISS) by ropes, pleads with Kowalski not to untether himself from her and float away to die in space, and he insists that it is the only way to allow her to live. When Kowalski and Stone, tethered together, travel toward the ISS, he is always at screen left, she at screen right, with the strap joining them stretched out as a sort of visible axis of action; straight cut-ins to close views of each character, and even at one point Kowalski’s point of view, obey the 180-degree rule and create an almost conventional scene. Actions inside the spacecrafts are more oriented as well. In the ISS Stone moves weightlessly through a series of pods, all the while maintaining screen direction. Similarly, inside the vehicles, especially late in the film when Stone is strapped into seats, she is usually upright, her head oriented toward the top of the frame. Some sustained actions in space also keep her right-side up, as when she removes the bolts holding the parachute cords to the Soyuz landing vehicle.

In part because of such orienting devices, we are seldom seriously confused about where the characters are, or at least not for long. Otherwise we would not be able to comprehend the story action. Still, compared to typical classical films, Gravity conveys little sense of spatial stability. The disorienting simulation of weightlessness for characters and camera dominates the scenes outside the vehicles and creates a style that can truly be called experimental.

Take the brief segment (about 14 seconds) below, from the 13-minute opening shot. Stone has been standing at the end of a large mechanical arm which gets knocked off the space shuttle by a piece of hurtling debris. It spins rapidly, with the camera framing it from long-shot distance. The camera is not entirely static, reframing slightly, but we can see the earth in the background fairly clearly. Stark sunlight comes from offscreen left, and as Stone’s body whips through space, the shadows move accordingly around her, with the back of her body in deep shadow in the first frame and then her front shadowed in the second:

The fact that the light source, the sun, is offscreen left during this spinning segment suggests that the camera and hence our viewpoint are in a stable position. Yet that position is maintained for only a short time. At this point in the shot, the camera is essentially waiting for her to draw near in order for it to execute a change that will govern the penultimate part of the lengthy shot.

That happens when, after she has spun wildly toward and away from us several times, the camera “attaches” to her, so that we are now seeing her in medium shot and spinning with her. Instead of seeing the earth clearly, we see her while the blurred surface of the earth and the blackness of space alternate rapidly. This was the technique that led me, when I first saw the film’s trailers, to compare Gravity to Michael Snow’s Central Region:

Being closer to Stone, we can see more clearly the shadows coming and going; her face is sometimes illuminated brightly by the sun and sometimes in near darkness:

The function of the attachment to Stone, apart from allowing us to see her fear and confusion, is to show us that her hands are working to detach her from the arm, as a tilt down reveals:

As she soars off the arm and tumbles into the black depths of space, the camera  leaves its “attachment” to her, and she spins away from it:

Cuarón’s commitment to the long take thus made him rely more than usual on events taking place within the frame–camera movement and figure movement in particular. Yet these movements had to occur in a microgravity environment radically different from the earthbound surroundings of Children of Men and Harry Potter and the Prisoner of Azkaban. This new constraint led to some technological innovations of remarkable originality.

The LED Light Box

Early on it became clear that moving the actors through space on wires would not create the desired realism of weightlessness, and obviously they could not be whipped about and tumbled in ways that the film ultimately achieved. The actors would have to be relatively static, with the illusion of movement created through other means. One of the main challenges was to have the lighting on their stationery faces support that illusion. And it would have to be done perfectly in order to achieve the photorealistic depiction of space that the filmmakers were after.

Usually in watching a film heavily dependent on CGI, one notices elements that have been assembled into a single composition but don’t quite match each other. A matte painting that isn’t lit from precisely the same angle as all the other components stands out from the rest (as, it has to be admitted, happens in the best of CGI scenes, including those in The Lord of the Rings). The problem was solved for Gravity using the LED Light Box, a device frequently mentioned in the press coverage of the film but seldom explained. (See image at the top.) The concept is truly revolutionary, although I am not sure to what extent it would work for other films that did not present such peculiar challenges.

In American Cinematographer‘s article on Gravity, “Facing the Void,” cinematographer Emmanuel Lubezki explains why consistency of lighting is crucial and how he came up with his solution:

Lubezki emphasizes that Gravity‘s blending of real faces with virtual environments posed a tremendous challenge. “The biggest conundrum in trying to integrate live action with animation has always been the lighting,” he says. “The actors are often lit differently than the animation, and if the lighting is not right, the composite doesn’t work. It can look eerie and take you to a place animators call ‘the uncanny valley,’ that place where everything is very close to real, but your subconscious knows something is wrong. That takes you out of the movie. The only way to avoid the uncanny valley was to use a naturalistic light on the faces, and to find a way to match the light between the faces and surroundings as closely as possible.”

This challenge led Lubezki to imagine a unique lighting space that was ultimately dubbed the “LED Box.” He recalls, “It was like a revelation. I had the idea to build a set out of LED panels and to light the actors’ faces inside it with the previs animation.” Lubezki conducted extensive LED tests and then turned to [special effects head Tim] Webber and his team to build the 20′ cube and generate footage of the virtual environments, as seen from the actor’s viewpoint, to display inside it. While constructing the LED Box, the crew also solved problems involving LED flicker and inconsistencies.

Inside the LED Box, the CG environment played across the walls and ceiling, simulating the bounce light from Earth on the faces of Clooney or Bullock, and providing the actors with visual references as they pretended to float through space. This elegant solution enabled the real faces to be lit by the very environments into which they would be inserted, ensuring a match between the real and virtual elements in the frame.

This ingenious approach largely did away with traditional three-point lighting in the exteriors. As Lubezki explains in the AC article,

When you put a gel on a 20K or an HMI [Hydrargyrum medium-arc iodide], you’re working with one tone, one color. Because they LEDs were showing our animation, we were projecting light onto the actors’ faces that could have darkness on one side, light on another, a hot spot in the middle and different colors. It was always complex, and that was the reason to have the Box.

The crucial point here is that the lighting was being created by playing the previs animation of the earth, space, the moon, and the large reflecting objects like the space shuttle on the sides of this 20′ by 10′ box. In other words, the moving images from the nearly finished special effects were used to light the faces of the actors, and those faces were later joined to those very same special effects, in a more polished form, to create the final images.

Lubezki gives an excellent description of the Box in his interview with Bryan Abrams, a series of responses which is worth quoting at length. Note that Lubezki refers to the Box as an LED monitor–essentially a giant television screen turned inside out and surrounding the actor:

Can you touch upon some of the pieces of technology and equipment that were created to make Gravity possible?

To make this movie we used many different methodologies. For one of them, we invented this LED box that you’ve probably read about, which is basically this very large LED monitor that is folded into a cube. So all the information and images that you input into this monitor lights the actors, and you can input all of the scenes that were pre-visualized to create the movie—all the environments that we had created—and you can input them into this large cube so space itself is moving around the actors.

So it’s not Sandra Bullock spinning around like crazy, it’s your cameras.

Yes, instead of having Sandra turning in 360s and hanging from cables, what’s happening is she’s standing in the middle of this cube and the environment and the lighting is moving around her. The lighting on the movie is very complex—it’s changing all the time from day to night, all the color temperatures are changing and the contrast is changing. There were a lot of subtleties that you can capture with the box, subtleties that make the integration of the virtual cinematography and the live-action much better than ever before.

The effects of the LED projections are visible in the changes on Stone’s face in the extended example above. Here’s a brief example of changes on Kowalski’s face in the opening shot:

The harsh light in the right frame above is a real lamp. The LEDs could not produce a local, hard light intense enough to simulate the sun. The team placed “a small dolly and jib arm alongside the actors” with a lightweight spotlight. This was moved “according to the progression of the virtual sun.” Such harsh light was necessary because outside the atmosphere there is nothing to filter bright sunlight. Several moments where the actors’ faces and suits are severely overexposed reflect this technique:

The Box also contained a large video monitor, visible to the actor, which displayed the previs animation. Lubezki explains: “This was wonderful in a couple of different ways. The actor sees the environment and how objects are moving in that environment, and at the same time we can see the interaction of that light on the actor. We capture true reflections of the environment in the actor’s eyes, which makes the face sit that much better within the animation.”

Previs as environment

The fact that almost everything in the film was created digitally–including the space suits in which the actors bob and spin in the exteriors–necessitated an extraordinary amount of planning and pre-production. “Pretty much we had to finish post-production before we could even start pre-production, because of all the programming,” Cuarón says. This was one reason why there was such a long gap between Children of Men (2006) and Gravity. Four and a half years were spent in developing the new technology and preparing to shoot.

The team started with geography:

The filmmakers began their prep by charting a precise global trajectory for the characters over the story’s time-frame, so that Webber and his team could start creating the corresponding Earth imagery. Cuarón chose to begin the story with the astronauts above his native Mexico. From there, the precise orbit provided Lubezki with specific lighting and coloring cues. The cinematographer recalls, “I would say, ‘In this scene, Stone is going to be above the African desert when the sun comes out, so the Earth is going to be warm, and the bounce on her face is going to be warm light.’ We were able to use our map to keep changing the lighting.”

Next, the filmmakers defined the camera and character positions throughout the story so that animators at Framestore could create a simple previs animation of the entire movie. [“Facing the Void”]

Lubezki was completely involved in planning the digital lighting. He recalls, “I would wake up at 4 a.m., turn on my computer, I’d say good morning to my gaffer and start working on a scene. I would say, ‘Move the sun 60,000 kilometers to the north.’ That way I could put the lighting anywhere I wanted.”

The reference material for the earth imagery came in part from NASA reference footage and photos. You can get a sense of these from the NASA films posted online, although these are mostly done in fast motion, unlike the ones the filmmakers would have used. One good example is “Earth HD.” There, at 2:25 and again at 2:41, one of the most recognizable locations on earth, the Nile Valley and Delta, are visible:

A similar image of the Nile appears on earth as Kowalski and Stone slowly make their way from the space shuttle to the ISS, with him asking her about her hometown and any family she might have waiting for her. (I was also happy to see the area of the site where I work in Egypt, Tell el-Amarna, which lies about midway between the Delta at the upper left and the large bend in the river.)

This geographical plotting included some ellipses. Although commentators have suggested that the film takes place in real time, or nearly so, there are temporal gaps. Shortly after the first pass of the speeding debris field, Kowalski tells Stone to set her watch’s timer for 90 minutes, since he calculates that is when they will encounter the orbiting debris again. That happens when she exits the Soyuz vehicle to detach its parachute. She again sets her timer for 90 minutes, and the debris field shows up at the Chinese station, battering it to the point where it sinks into the atmosphere and breaks up into chunks melting from the friction of reentry. Thus a little over three hours should be passing in the 83 minutes of screen duration.

Cuarón more or less confirms this timetable when he describes the creation of the previs: “The screenplay describes a journey that takes place mostly in real time, with only a couple of time transitions. We travel around Earth three times, so in previs we planned out visuals with specific knowledge of where we’d be in orbit at any given point in the story, whether it was in sunlight or darkness.”

In the film there are very few places where we can assume a significant ellipsis occurs. After Stone enters the ISS, sheds her helmet and suit, and drifts in a fœtal position, there is a gap. It’s probably not long, since she still holds some hope of going to rescue Kowalski, but she pauses to recover after her trying experience. Later, there is a cut from her inside the landing module, not in the suit, to her emerging from the hatch fully suited up–a gap we might assume to be ten minutes or so. Most notably, the cut from the nighttime shot of the earth that includes the aurora borealis at the right to the extreme close-up of frost on the window ellides a longer stretch of time. Stone has become hoarse in the interval as she tries to send a mayday message via radio. In other cases, such as Stone and Kowalski’s slow journey toward the ISS, time seems to be somewhat compressed though not ellided.

Staging without a stage

A lack of depth cues hampered the animators charged with creating the previs. The absence of one major depth cue, aerial perspective (the tendency of layers of space in the distance to turn successively bluer and blurrier due to the filtering quality of the atmosphere), caused problems. Visual-effects supervisor Tim Webber, of the effects house Framestore, remarks:

You can’t rely on aerial perspective because without atmosphere there is no attenuation of image due to distance. And the lack of reference points [in space] can get you into trouble, like not being able to tell if the character is coming toward you or the camera is moving toward him. Even though we played it straight with respect to science and realism, we did put in more stars than you’d be able to see in daylight, just so there’d be some frame of reference to gauge movement.

Presumably Webber is referring here to the movement of the characters and objects through space, not the camera movement. (The lack of any “frame of reference” against which to sense movement is part of what makes the Star Trek scene illustrated above seem so unsophisticated.)

Naturally, since the actors were not standing on a floor or solid ground, the blocking was difficult, but it also had to be planned completely in advance:

Cuarón laughs as he recalls the surprises inherent in blocking characters in a zero-gravity environment. “The complications are really something because you have characters that are spinning. Say you want o start your shot with George’s face and move the camera to Sandra, who is spinning at a different rate. You start moving around her, and then you start to go back to George, only to realize that if you go back to George at that moment, you will be shooting his feet! So then you have to start from scratch. Sometimes you find amazing things accidentally, but sometimes you have to reconceive the whole scene.” [“Facing the Void”]

Finally, after all the planning, the previs animations were made. These had to be refined considerably so that they could adequately serve in the Light Box to illuminate the actors’ faces. According to Bill Desowitz, “The previs was so good, in fact, that the daughter of cinematographer Emmanuel (“Chivo”) Lubezki thought it was the real movie.”

The previs became so sophisticated because it evolved during preproduction. Cuarón recalled that Lubezki’s inspiration to create the LED Light Box changed the planning tactics:

Then that kind of had a ripple effect back into the previz, because originally they were going to just be a model that we could look back at, but we realized that the previz was more than that. That was something that [James] Cameron kept on talking about. He would say “I don’t use previz anymore, I use it as if it is the first painting on a canvas.” In other words it was the stuff that you kept on painting on top of and the thing with that is that it became very clear that in order to use these technologies, we needed to program stuff and the previz was going to have to be precise in terms of camera movements, choreography, timing and light.

As a result, the movie changed very little during principal photography. Senior visual-effects producer Charles Howell told American Cinematographer: “I think there were only about 200 cuts in the previs animation, [whereas] an average film has about 2,000 cuts. Because these shots had to be mapped out from day one, many of the lengthy shots didn’t really change in the three years of shot production. Because we did a virtual prelight of the entire film with, the whole film was essentially locked before we even started shooting.” [“Facing the Void”]

David counted 206 shots in Gravity, not including the two opening titles about life in space being impossible. This suggests that Howell is right, and that the film underwent little revision after the planning phase.

Several years ago I suggested on this blog that animated films, notably those of Pixar and Aardman, were on average better than mainstream live-action films because they had to be planned so carefully and thoughtfully. Gravity, being very close to an animated film, provides more evidence for that claim. Not that thought, time, and money can guarantee quality, but they certainly narrow the odds.

Iris in

The Light Box technology is astonishing enough, but within its confined space there also had to be a way to photograph the actors. In Lubezki’s interview with Bryan Abrams, he explains:

So we built the box, but that wasn’t it.  To be able to shoot inside the box, we had to build a special rig that holds the camera and moves with motion control. So we had people build a very narrow, lightweight but sturdy rig to control the camera. If you imagine the big box of LEDs, it has a gap that is almost a foot and a half or two feet wide, and the camera has to go into the box and make all these moves to make the audience believe that Sandra is turning and turning, but it’s really the camera and the environment in the box that is moving. So we built the box, the rig, and then used a company called Bot & Dolly. These guys are from San Francisco, and they use robots from the automotive industry.  They redid all the software for us, so we were able to use these robots to move the cameras and the lights around the actors. It was just a big ballet of gadgets and new technology for the film.

Bot & Dolly is a San Francisco company specializing in robots for the automobile industry. It built or perhaps modified an elaborate rolling, multiply-jointed camera mount called Iris especially for Gravity. It has been used in other features and in ads since then. (See image at the bottom.) An impressive demo film shows the Iris gracefully writhing about, quickly pointing the camera in many directions. (The camera in the film is a Red, though Gravity used an Alexa.) According to ICG Magazine, “The firm devised a Maya-based series of commands that allowed Framestore animators to direct the robots in ways that matched previs action in precise detail.” (Maya is the industry standard computer animation program.)

Typically this camera was inserted through an opening in the Light Box and swooped around the actor, who stood in a gyroscopic basket, seen in the production photo below. The photo shows one side of the Box open, though this would not be the case during shooting:

The combination of the Light Box and Iris made it possible to blend the special-effects shots and the live-action photography of the actors so smoothly that there is no “uncanny valley” effect, no sense of an obvious matte painting stuck into the middle of an image. The shots in Gravity are all photorealistic to a degree that is rare, if not unique, in recent effects-heavy films.

Iris brings us back to the comparison with Central Region. Snow built a special camera mount (below) designed to allow his images to rotate freely in almost any direction. During the three-hour film the camera never repeated any of its trajectories. Some images were close views of the pebbles on the ground; others were upside views of the bleak Canadian mountains in the distance. A nighttime segment was completely black except when the moon occasionally swept through the frame. The one area that the camera didn’t survey was the camera support itself, the “central region” of the title.

The vital difference between Snow’s machine and Iris is that the new system has no fixed anchor. Not only does it slide on a track, but everything it photographs can be digitally altered to erase any traces of the machine. It moves with entire freedom through a constructed space that has no central region, no fixed point around which everything else revolves.

Puppeteers and eyes

Gravity‘s utterly spherical space, beyond anything we normally find in commercial cinema, placed unusual demands not only on camera movement but also upon the actors’ blocking and performances. Our first entry on Gravity begins with a quotation from Sandra Bullock, which included the statement, “No character was like Stone, no film set was ever like these sets, not one member of this crew had ever done this before.” That may seem an exaggeration until one grasps how Bullock and Cuarón’s team built her character.

We all know from infotainment coverage that Bullock was isolated in the Light Box through entire days and that it was a trying experience. What doesn’t come through in such accounts is that she was often enclosed in the gyroscopic basket, visible in the photo of the Iris rig and Light Box above, as well as in the same setup visible behind Cuarón in this photo:

That was only the start of it. Anne Thompson’s interview with Cuarón and producer David Heyman reveals some of the details of blocking a character who is unrestricted by gravity:

AC: The physical aspect, not anybody can do what she did. On the one hand the physical discipline she went through to make this film, the training and the workouts. She also has an amazing capability for abstraction. Those emotional performances, it was as if they were an exercise in abstraction, like she was bonded to very precise cues. And physically that was very difficult: she trained and practiced like crazy, together with the stunt people and special effects. And the puppeteers from “War Horse” were helping her, supporting a leg or an arm, all the floating elements, they were creating approaching objects toward her in perfect timing. Then after she practiced so much her whole concern was only about emotions and performance.

Imagine a ballet dancer with really strict physical discipline in terms of what a body has to do, positions and precise choreography, who goes through months of training for one choreography so when they are performing they have expressiveness and emotion.

What was the most challenging scene to realize?

David Heyman: When Sandy comes into the ISS for the first time. She takes off her suit, then goes into fetal position, all in one shot. It was the most difficult. All the objects, getting the suit off, and into fetal position in such a way that it felt effortless, not as it was–she was sitting on a bicycle with one leg tied down leaning back in a 12-wire rig, with puppeteers. One of the things you forget about Sandy’s performance, which seems so truthful, is all the effort and physical exertion that went into making it, the precision of the technical aspects. She had to move her hands at a third of speed — zero G –while talking. Each shot connects with the next at very precise points where her head began and end and begin and end. She’s on a bicycle stringing uncomfortable with people moving around on 12 wires, through it all, with no gravity. Physically the body must not show the tension, so it looks effortless. What I loved about it is the performance behind the visor shines through, her eyes. You can’t slouch your shoulders to show sadness or weight, it’s just the eyes.

Bullock did all this with four 10′ by 20′ walls of LEDs projecting moving images of the earth and of exploding space stations around her. I think it is safe to say that this was a unique kind of performance.

The sounds of silence

As the film’s ominous opening titles point out, there is no sound in space. In keeping with the overall attempt to duplicate the effects of weightlessness immersively, Cuarón’s team limited the track to two types of sound: diegetic sounds heard by the characters and a non-diegetic, modernist musical track. In an interview with Cuarón, Wired‘s Caitlin Roper pointed out that there was an explosion in one of the trailers. Cuarón replied:

Yes, but that’s just the trailer. I honor silence. The only sound you hear in space in the film is if, say, one of the characters is using a drill. Sandra’s character would hear the drill through the vibrations through her hand. But vibration itself doesn’t transmit in space—you can only hear what our characters are interacting with. I thought about keeping everything in absolute silence. And then I realized I was just going to annoy the audience. I knew we needed music to convey a certain energy, and while I’m sure there would be five people that would love nothingness, I want the film to be enjoyed by the entire audience.

As in other areas of the film, we see the compromise between an experimental technique–an attempt to suggest the silence of space–and the desire to provide something more familiar for the broad audience. In this case, music acquires an expanded role, substituting for sound effects and conveying the rapidly shifting emotions of the scenes.

Sound effects are not entirely eliminated. Many sounds that the astronauts would hear via vibrations of things they come into contact with are included. In some cases these are fairly clear, as with the voices heard within their helmets–their own voices or others’ via radio. Other effects are heard in a distorted fashion. Glenn Freemantle, the supervising sound designer and editor, describes the process:

“When [Bullock] is in the suit, you hear her voice and her breathing, and you hear through her suit when she is in contact with things,” he explains. His team captured sounds by recording with contact mics at car plants and hospitals. “We even recorded through water with a [submerged] guitar,” he recalls.

One obvious example of distortion comes in the opening scene, when Stone is unscrewing bolts and sliding a panel out of the transmitting device she is working on. The sounds of the bolts and the sliding metal are audible but muffled, as though they were recorded under water or electronically manipulated.

Yet other sound effects not heard by the characters were relegated to musical expression. As Angela Watercutter put it in a Wired article based on interviews with Cuarón and composer Steven Price,

Every time there’s a collision in the movie the audience doesn’t hear a bang – they hear a sonic boom. The same goes for the characters’ — and, by extension, the audience’s — feelings of anxiety, claustrophobia, and agoraphobia. Much of what is seen in Gravity is terrifying, and when the audience can’t hear the horror of a space shuttle breaking apart or an airlock flying open, Price had to fill the void with his nerve-wracking score.

Cuarón dictated that one of the rules for the film’s score was the eliminating of percussion, to avoid the “cliché of action scoring.” Watercutter continues:

As a result the score for Gravity serves as more than just musical accompaniment – it also provides the movie’s sound effects. There are some non-music sounds that would be space audible, like the ones transmitted by vibrations characters feel in their spacesuits, but for the most part everything that happens in open space is accompanied only by Price’s music and the voices of Stone and astronaut Matt Kowalski (George Clooney), which “freed up the rest of the frequency spectrum for me,” Price noted.

Price used a mix of organic and electronic sounds to meld the natural world of space with the mechanical world one of the space exploration. There are also moments where he took an analog instrument – a cello, for example, or even a human voice – and ran its notes through a synthesizer or processor in order to create a whole new sound. And for the opening song on the score, “Above Earth,” Price took a track he was already working on and slowed it to about 1/60th its original speed. “Basically,” Price said, “what you’re hearing is the space between the notes.”

In an interview with Rolling Stone, Price discussed some of the aesthetic principles and functions he aimed for with his score:

Really it was all very much led by the character of Ryan. I tried to be with her all the time. The idea was that the music was up there in space and we made it very immersive and used a lot of elements and a lot of layering so that things would move around you all the time. The writing of those elements and what they were, were always influenced by what Ryan was feeling and where she was emotionally in the whole thing. And also where the camera was, where things were moving and what point of view the camera was facing, whether it was looking at them or kind of looking through their eyes. Some of it was melodic and some of it was intended to underscore a kind of emotional journey, and then there were a lot of sounds that were there to express real terror. It was those two extremes, really, expressing the beautiful nature of where they were but also absolutely a massively terrifying situation.

With little expertise in musical analysis, I can simply say that I hear the score as a combination of traditional instrumental music and electronically synthesized instrumental music. Under this, typically in tense passages, there are abrupt or charging percussive emphases, not using percussion instruments but, in some cases, deep string chords. Scenes of damage or tension are sometimes accompanied by sounds like stressed, grinding metal. Other sounds like distorted, high-pitched radio waves (in the “ISS” and “Fire” tracks) are included, reminiscent of electronic music of the 1960s.

Other critics have offered suggestive descriptions. Justin Chang’s review refers to “Steven Price’s richly ominous score, playing like an extension of the jolts and tremors that accompany the action onscreen.” David S. Cohen and Dave McNary’s Venice festival coverage characterizes the track: “Much of the action, even the debris storms, plays out against eerie silence, broken only by the score. The silence is more startling after the score builds to deafening crescendos, then stops abruptly. But during the interior scenes, the rumbles and groans of failing space gear are as frightening as the roars of any classic movie monster — even more so because their source is unseen.”

Price has contributed a remarkable score, one which is highly original and yet completely motivated by the story situation it accompanies.

The space between

The immersive, 360-degree surrounding and sound fields made Gravity a natural for 3D exhibition, but they also posed unique problems. Given the long takes, the need for complex camera movements, the demands of the LED Box, and the complicated acting conditions, it would have been very difficult to shoot the film in 3D. In most scenes, of course, there were no real objects juxtaposed in different layers of depth in front of the camera. Even the actors’ placements in long shots would have be created digitally. So the project had to be converted to 3D. But this forced choice actually yielded strong results.

The press coverage of popular cinema has come to treat films shot in 3D (“native” 3D) as pure and admirable and films converted to 3D after shooting as crass and compromised. But is there all that much difference? Even Avatar, the film made with an intention of promoting the universal use of 3D, had some converted footage. With conversion technology improving, the notion of waiting until after filming to create a movie’s 3D is becoming less onerous. As Variety‘s David S. Cohen pointed out earlier this year, Iron Man 3, Man of Steel, Star Trek into Darkness, and Pacific Rim have been post-converted with little objection from the public or press.

That conversion techniques for generating 3D images are not inferior became much more evident during the early decision-making process for shooting Gravity. Nikki Penny, the film’s executive producer, took some test footage shot by in 3D to Prime Focus World, a conversion house that ended up doing 27 minutes of Gravity. The filmmakers were trying to decide whether to shoot the live action portions in 3D or use conversion. In an article on Creative Cow, Debra Kaufman explains what happened:

The production had done a test shoot in 3D, which involved placing the cumbersome 3D rigs inside the cramped space capsule. When Penny brought the 3D live action footage to Prime Focus World, she asked that they test 3D conversion by utilizing a single eye from the same footage. The results convinced Cuarón and producer David Heyman that conversion would not only look as good as shooting in native 3D, and would be much easier and more efficient to accomplish.

That is, the footage shot by one of the two lenses in the 3D setup was separated out. It was then treated as if it were native 2D footage and put through a conversion process to create a 3D image. The result resulted in 3D that was not inferior to the original native-shot 3D. The lesson, I think, is that the question is not usually whether a film is shot in 2D and converted; it’s whether it was planned to be completed as a 3D film (and has sufficient budgets and skills invested in it) .

Gravity couldn’t be shot in native 3D, since in most scenes there were not real objects juxtaposed in different layers of depth in front of the camera. Also, the camera was too cumbersome to fit into the space-capsule sets. With so much of the characters’ surroundings done as CGI, however, the conversion to 3D could be done concurrently with the filming. Kaufman describes the process at Prime Focus World, one of the firms that handled the conversion:

Unlike the more typical post-production 3D conversion, Gravity involved PFW working on the 3D conversion during production. The work on 3D conversion began with six months of pre-production, during which the production’s Stereo Supervisor Chris Parks worked closely with the PFW team to explain his carefully plotted depth map, which contrasted the vast emptiness of space with the tight, nearly claustrophobic quarters of the space capsules.

From the beginning, the challenge for Prime Focus World would be to make sure that the 3D converted footage integrated seamlessly with the extensive 3D CGI. Both the live action footage and CGI would be 3D, but 3D from two different worlds, conversion and visual effects – and they would both be active or “live” during the production process. At the same time, the PFW team wanted to retain the creative flexibility of its View-D conversion process, while integrating the stereo VFX universe. What made it trickier was that, unlike a completed film, Prime Focus would be working with work-in-progress shots and an open edit.

For more on the technical aspects of the integration of converted footage and CGI, along with an example of the stages that went into creating a single shot, see the Kaufman article.

In an essay on ICG Magazine, Vision3 stereo supervisor Chris Parks describes some of the narrative functions of the film’s 3D:

We had a virtual camera at Framestore that let us control depth functions. When Sandra floated off in space, we separated her slightly from the starfield, using 3D to make her feel very small. At another point we went very deep, when we see her POV as her hands reach out to those of another astronaut coming to camera. At the point when they make contact, we increased the interaxial to five times normal, then scaled it back down as they separate and drift apart.

Parks also comments on the scene where Stone and Kowalski look through the shattered windows of the space shuttle and a crew member’s dead body suddenly falls into the shot:

Alfonso asked how the 3D could make this more powerful, but without just throwing something out into the audience to make them duck. We decided to float a little Marvin the Martian doll out into the audience, which is a kind of fun, lighthearted tension-breaker, and then we whip-pan right off that to the dead astronaut, which makes the emotional revelation more jarring.

In fact the Marvin doll (derived from Chuck Jones’s Warner Bros. cartoons) comes diagonally forward from the depths of the shuttle interior, and the camera pans with it as it moves out of the ship past Stone, who watches it and then turns back to look inside again. The corpse falls into the shot from above left, but not out toward the audience. It bumps Stone’s helmet, and the camera pans to reveal it more fully and continue almost nonchalantly onward to show another dead astronaut further back in the shuttle interior.

Finally, Parks points out an expressionist distortion of space for subjective purposes in the dream sequence where Kowalski joins Stone in the Soyuz landing vehicle:

It’s a dream sequence that doesn’t reveal itself as such right away. To give a subconscious impression that something different was happening, we pushed the top right corner into the set while pulling the bottom left corner ahead, skewing the whole view. That sense of unease represents, to me, how 3D can be expanded beyond just giant VFX movies. It’s a tool that can be most effective in very small spaces, as this one shot reveals.

Outside the dream scene, we see the wall panel of instrument controls at an angle to the camera, with Stone in her seat at the left. During the dream, the panel is suddenly turned so that it is almost straight into depth, so that we are pressed up obliquely against it. Stone’s seat at the left is further away from it. The result is that the space is strangely skewed during the dream.

In all, shooting in long takes, building each shot with CGI yet including complex camera and figure movement, canceling the sense of horizons and ground planes, and enhancing all these choices through 3D, has resulted in a film in which stylistic patterning becomes an object of fascination in its own right.

Despite the occasional joke about a Gravity sequel, it seems unlikely that Cuarón will tackle similar subject matter and formal strategies in his next film. Dealing with space without horizons and characters without weight was a formidable task. At the end of his Wired interview, asked what his next film will be, he replied, “Any movie in which the characters walk on the floor.” Welcome back, axis of action.

Most of the frames used here and in Part 1 were taken from a New York Times article containing a clip from the opening shot with commentary by Cuarón.

Thanks to Stewart Fyfe, who shared links to some of the sources cited in this entry.

There was no way to rely on anything we knew before this film. No character was like Stone, no film set was ever like these sets, not one member of this crew had ever done this before. We all were doing something that had never been done before.

                                                                                                     Sandra Bullock

Kristin here:

Back in mid-September, on the verge of leaving Madison to attend the Vancouver International Film Festival, I mentioned that I had watched one of the trailers for Gravity and thought it looked like “the most exciting new piece of filmmaking this year.” I added that the trailer “called ‘Drifting’ reminded me of Michael Snow’s brilliant Central Region, but with narrative, with the earth and stars spinning past a close-up of Sandra Bullock as the marooned, panicky astronaut protagonist.”

At that point, I wondered whether the film as a whole could keep up that experimental feeling, with vertiginously wheeling actors combined with an untethered camera swooping around them. Or would the narrative gradually lead us into a more conventional style later in the film? It turns out that, to a remarkable extent, the highly unconventional treatment of unanchored space, where up, down, and sideways characters and background change with a breathless rapidity, extends through much of Gravity‘s length. For brief intervals Ryan enters space capsules and sits, right-side up, and the action calms down briefly. Yet these lead to further scenes in space with the same swooping camera. In short, the film turned out to be as remarkable a formal and stylistic achievement as I had hoped.

SPOILER ALERT. This is not a review but an analysis of the film. Gravity does depend crucially upon suspense and surprise, and I would suggest not reading further without having seen the film.

An experimental blockbuster

I am not the only one who was struck by Gravity‘s resemblance to an experimental film. After the film’s opening weekend in the USA, Variety‘s Scott Foundas published an article on the subject: “Why ‘Gravity’ Could Be the World’s Biggest Avant-Garde Movie.” He references the influence of Jordan Belson’s work on 2001: A Space Odyssey and speculates that the final shot of The Shining echoes the ending of Michael Snow’s Wavelength. More specifically he links Gravity to Central Region, shot in 1971 at in a Canadian mountain range; Foundas describes the robotic arm used to shoot the film and how it was controlled by instructions on magnetic tape. (I’ll have an illustration of the robotic arm in Part 2.) To Foundas, the avant-garde aspects of Gravity outweigh its narrative: “‘Gravity’ has more of a plot than ‘La Region Centrale,’ but only barely, and surely no one is telling their friends to see Cuaron’s film because of its great story. Rather, it’s the very absence of a dense narrative line that gives ‘Gravity’ its majesty.”

I think that to say Gravity has “only barely” more narrative than Snow’s purely abstract film is a considerable exaggeration. The film’s story is certainly simpler and more unconventional than other mainstream Hollywood films, but as we shall see, it contains goals, motifs, character traits, careful setups of upcoming action, and other traits of classical narratives.

In an October 11 blog entry, J. Hoberman also stresses the film’s modernism:

Depth and volume are illusory. Mass has no weight. In this 3-D spectacle, best seen on the outsized IMAX screen, Cuarón promotes sensory disorientation–or better, reorientation. […] Gravity is something quite rare–a truly popular big-budget Hollywood movie with a rich aesthetic pay-off. Genuinely experimental, blatantly predicated on the formal possibilities of film, Gravity is a movie in a tradition that includes D. W. Griffith’s Intolerance, Abel Gance’s Napoleon, Leni Riefenstahl’s Olympia, and Alfred Hitchcock’s The Birds, as well as its most obvious precursor, Stanley Kubrick’s 2001. Call it blockbuster modernism.

(Actually I’d say Gravity is better than some of these, notably Napoléon and 2001.)

Hoberman sees more of a balance between style and narrative than does Foundas. In fact, he considers that the film contains “a distracting surplus of backstory.” Presumably he would prefer to do without the references to the death of Stone’s daughter and her subsequent aimless car rides after work, listening to the radio. The space voyage does become an overly obvious extension of that drifting and listening, coming close to turning the film into a maternal melodrama. Presumably the filmmakers felt that simply sending Stone on a mission and having her struggle to return to earth was not enough. In interviews, the co-scriptwriters, Alfonso and his son Jonás Cuarón, emphasized that their basic idea was to create a character arc of her “rebirth” after despair. To some, this arc, with its religious overtones, will seem a bit, as Hoberman says, distracting and even contrived. To others it may be inspiring. At least it is not allowed to come forward very often.

Hoberman stresses the balance of plot and radical style. The film, “premised on the absence of up or down, is naturally abstract although it also has a streamlined and suspenseful narrative that, save for one or two ellipses, might almost be happening in real time.” In Variety, Justin Chang’s review highlights the same balance: “at once a nervy experiment in blockbuster minimalism and a film of robust movie-movie thrills, restoring a sense of wonder, terror and possibility to the bigscreen that should inspire awe among critics and audiences worldwide.”

David and I have often claimed that Hollywood cinema has a certain tolerance for novelty, innovation, and even experiment, but that such departures from convention are usually accompanied by a strong classical story to motivate the strangeness for popular audiences. (This assumption is central to our e-book on Christopher Nolan.)  Gravity has such a story, though Cuarón is remarkably successful at minimizing its prominence. The film’s construction privileges excitement, suspense, rapid action, and the universally remarked-upon sense of immersion alongside the character in a situation of disorienting weightlessness and constant change.

That construction derives partly from techniques unique to this project. The weightless dance of characters and camera almost entirely does away with such widely applied spatial premises as the axis of action, eyeline directions, and the establishing of stable spatial relationships. And, as Cuarón pointed out in an interview for Wired, “After all, you learn how to draw based on two main elements: horizons and weight.” Those two factors are virtually gone as well.

The weightlessness and the long takes in the film have been given much attention in the press. Reports refer less often to the “Light Box, one of the film’s most extraordinary innovations. It is a giant inside-out LED monitor that allows the film’s own previs special effects to light the faces and bodies of the actors inside the box, making it possible for those shots to be integrated seamless into the effects shots. Basically, apart from the scenes inside space vehicles, traditional three-point lighting is jettisoned along with spatial relations.

Other technical aspects of the film are innovative. A bold new camera mount, the Isis, was devised to allow the camera to twist and whirl around the actors. The silence of space was respected by the filmmaker, leading them to substitute a eerie musical score to replace sound effects and convey emotions. The blocking and acting, of course, had to be vastly different from methods used in conventional films where the actors have the luxury of walking on a ground plane.

In short, it is hard to think of another mass-audience film in recent years that has so thoroughly departed from the current technological and stylistic conventions of mainstream filmmaking. Jurassic Park and The Lord of the Rings, to be sure; perhaps Avatar. Publications devoted to the techniques of cinema have recognized this. The Cinefex issue dealing with Gravity is not yet out, but on the journal’s blog, Don Shay’s remark is quoted: “Every once in a while, a film comes along that is a game-changer. This is one of those films.” Debra Kaufman, writing about the film’s 3D for Creative Cow, agrees: “Anyone who’s seen Gravity 3D will agree that the 3D was a game changer.” And unlike those earlier game-changers, Gravity has a strong experimental component to it that audiences gladly accept, since it is so well motivated by the story and situation.

In the next blog entry, I’ll survey the innovative aspects of Gravity‘s style and technique. Today, though, I’ll concentrate on the plot–in some ways conventional and in some ways quite strange–that holds it all together.

Who needs psychological depth in a crisis?

Arguably Cuarón had constructed nearly the most sparse narrative that can sustain the experimental style and motivate that style enough to hold the attention of a popular audience. Three characters, then two, then one, all with minimal backstories and simple goals.

Most Hollywood films have two parallel plotlines, usually one involving a romance. Here there is only one, and it primarily concerns an immediate situation, a cycle of deadly threats alternating with stages of Ryan’s progress toward safety. On balance, the focus is more on the suspense and terror of the situation than on the characters. Although there is a little mild flirtation between Stone and Kowalski, it’s more to generate humor and defuse the tension than to suggest any real possibility of mutual attraction.

One indication of the film’s minimal characterization is that fact that we never learn the nature of Stone’s experiment. That would be a logical initial goal for her character. Why has she set herself this particular task, which obviously involved not only scientific expertise in  a complex field but also elaborate training to become an astronaut? Where does she work? What might her test achieve? Some reviews have referred to her as a medical expert. As far as I can tell, this is based on one line when she and Kowalski are working together to activate the communications device that is her focus of attention in the opening scene. During the calm before the debris collision, she remarks, “I’m used to a basement lab in a hospital where trays fall to the floor.”  She also says that “It’s designed for hospital use.” That’s it. Normally a Hollywood film would redundantly give us information about her job. Here we don’t even get a sketch of it. And why is a medical experiment attached to the Hubble Space Telescope?

Incidentally, the Hubble is detached from the shuttle just before the debris cluster reaches it. We never learn whether it, too, is destroyed in the disaster. Might it have survived, with Stone’s experiment, perhaps activated during her brief delay before obeying the mission-abort command? Might she return to earth to find her experiment a success, with her initial goal miraculously achieved despite the tragic events in space. So little is the narrative concerned with the experiment as a significant goal that such questions are unlikely to occur to a spectator. They came to me only after three viewings.

Stone’s casual reference to working in a hospital lab typifies the limited sort of backstory we’ll get for the most part. Aside from Stone’s recollections of her daughter’s death and her aimless evenings of driving as her form of mourning, the moments of backstory are mere hints. In the opening we learn that Matt’s wife left him when he was in space on a mission. Might he be so obsessed with the beauties of space travel because he, too, is seeking to escape loneliness? We can’t know, since he treats the mention humorously, as if he has managed to shrug off his wife’s betrayal. Of the third character present on the spacewalk, Shariff, we learn that he has a wife and son, something revealed by a photo only after his death. This knowledge serves less to characterize him than to contrast this cheerful fellow with the wifeless Kowalski and childless, unattached Stone.

Stone’s mention of her home in Lake Zurich, Illinois and of her daughter’s death is the last piece of backstory that we get, and it comes slightly under half an hour into the film, during the calm interlude when she and Kowalski are slowly traveling toward the International Space Station (ISS). After this, I believe the only scrap of information from her past that we get is that Stone’s daughter had worried about a lost red shoe.

This lack of information about the characters is probably what led Foundas to say that the film has “barely” more of a plot than Central Region. In the same piece, he speculates, did the executives at Warner Bros. “wonder if they’d just gambled away $100 million on the most expensive avant-garde art movie ever made?”

Kevin Jagernauth reports on indiewire that the studio pushed for a more conventionally constructed film. Cuarón told him about some of the feedback he got from WB:

But at first, the studio suggested that [the Mission Control] team in Houston should get more face time. “…there area lot of ideas. People start suggesting other stuff. ‘You need to cut to House and see how the rescue mission goes.'”

And that’s not all. Part of the emotional journey of “Gravity” rests on Stone’s backstory, which includes a daughter she lost, but this is all effectively communicated without breaking the single location concept. However, Cuarón was advised to perhaps include some flashbacks in the film and even more. “A whole thing with … a romantic relationship with the Mission Control Commander, who is in love with her. All that kind of stuff. What else? To finish with a whole rescue helicopter, that would come and rescue her. Stuff like that,” he explained of some of the ideas that were floated his way.

There’s that conventional second romantic plotline, which in the wake of the film’s success seems such a ludicrous suggestion. The studio’s attitude demonstrates how very much Cuarón was able to get away with and how much of a struggle it must have been. Audience and critical enthusiasm suggests that he and his team managed to include just enough classical storytelling to make spectators identify with the characters even while knowing very little about them.

Why would a film need to establish psychological depth for characters when most of what they’re going to be doing is struggling frantically for their lives, cast adrift in space and bombarded by hurtling space debris? They must summon what skills and psychological strength they have and get on with it. Thoughtful conversations and subtle complexities are irrelevant for the most part. We need to care about these people to be engaged by the film, but that is part of the point of having Sandra Bullock and George Clooney as the leads, playing to the likeable personal qualities that we already associate with these stars.

Challenges and goals

There’s no question that the characters do have goals, but these are largely based on circumstances thrust upon them rather than on character traits. Before disaster strikes, the characters have short-term goals: Stone to solve the glitch with her equipment (and to avoid allowing nausea to cut short her attempt) and Kowalski to enjoy his final space walk and ideally break the record for duration of space walks. Both goals are cut short by the news of approaching debris and the mission-abort order. As we’ve seen, whether Stone achieves her original goal concerning her experiment is never revealed, nor are we encouraged to wonder even briefly as to whether the Hubble might carry it away from the destruction of the shuttle. Kowalski achieves his goal of breaking the record, in a sense, as he comments ironically while detached and drifting in space and awaiting his death. His space walk will last forever, but records are hardly intended to include corpses.

Once Stone spins off into space, alone, her goal is to re-establish contact with Mission Control and Kowalski. His is to rescue her. Once he finds her and tethers them together, their mutual goal is to get to the shuttle, with Kowalski adding the goal of retrieving Shariff’s body. Very quickly these goals are shattered, since the shuttle has been extensively damaged and its other crew members killed. A new short-term goal arises: reaching the relatively nearby ISS.

Kowalski fails to achieve this goal, since the fuel in his jetpack and his inability to grab anything on the ISS’s exterior send him floating off into space. Stone’s goal is now to get inside before she passes out from lack of oxygen. Once inside, her goal is to detach the remaining semi-functional Suyuz landing vehicle and use it to get as far as the Chinese space station, in turn using its landing pod to return to earth.

Discovering that the deployed parachute has become tangled in the ISS, she takes another space walk to detach it from the Soyuz. Another short-term goal that is soon accomplished. As she starts to remove the bolts anchoring the parachute, she states the short-term and long-term goals: “OK, we detach this, and we go home.”

Her purpose, however, seems to be thwarted when the fuel tank of the Soyuz vehicle proves to be empty. Here Stone loses hope, drifting into despair. She decides to turn off the oxygen supply and allow herself to die. Suddenly Kowalski appears and enters the pod, giving her a pep talk and telling her to use the soft-landing function of the Soyuz rather than its take-off capabilities. He disappears, and Stone, reinvigorated and determined, follows the instructions for landing the craft.

In traditional classical films, shifting goals often mark the turning point between large-scale sections of the plot, generally referred to as acts. Despite its unconventional aspects, Gravity’s plot does stick fairly closely to the well-balanced four-part structure that I have claimed is typical of Hollywood narrative conventions. Not counting titles or credits, the story runs approximately 83 minutes. Thus on average the acts would run about twenty-one minutes each.

At about 22 minutes in, Stone and Kowalski achieve their goal by reaching the shuttle, only to discover that it has been destroyed. At 23 minutes, Kowalski declares them the last survivors of the mission. I take this to be the first turning point, ending the setup and beginning the complicating action. Essential premises are reversed as the pair realize that they are stranded in space and they shift their goal, striving next to reach the ISS. Stone’s failed attempt to contact Kowalski by radio once she enters the ISS–she initially hopes to rescue him–and declaration of herself as the mission’s sole survivor happens at roughly 43 minutes. The third act, the development, begins, with Stone meeting numerous obstacles that threaten her new goal of getting back to earth in the Chinese landing vehicle. The last turning point, launching the climax, comes when Stone awakens from her dream about Kowalski and turns the oxygen flow back on, signaling her return to hope and determination to reach earth. That happens at about 66 minutes in, leaving seventeen minutes for her landing, including the brief epilogue of her floating, swimming ashore, and shakily standing up.

Motifs and causal motivation

As I mentioned, strongly innovative films in the Hollywood tradition need the support of classical conventions to keep the narrative clear and appealing. Two of Gravity‘s most traditional techniques are its motifs and its motivations. Motifs can quickly make the characters more vivid, even if they are not particularly rounded or complex. Motivations often involve planting an object or event in advance. In this film, several motifs trace the relationship between Stone and Kowalski.

In the opening, the motif of Kowalski’s wanting to break the space-walking record is introduced early on, stressing that this is his last mission and hinting that he loves his time in space. Similarly, his anecdotes, introduced with the “I’ve got a bad feeling about this mission” running gag, create irony but also suggest how Kowalski inspires Stone. Before setting out on her re-entry flight in the Chinese landing pod, she repeats this line with the same good humor that Kowalski had displayed. Another parallel is set up between the two when Stone detaches the clasp tethering her to the wildly spinning support in the opening scene, and later Kowalski does the same to separate himself from Stone when they are precariously suspended from the ISS (below). She comes back; he doesn’t.

In the early scene where the pair work to activate Stone’s equipment, he refers to her “beautiful blue eyes,” though she points out that hers are brown. Later, when Kowalski has set himself adrift in space, their radio conversation mentions his “beautiful blue eyes,” which are also brown. Though we see nothing of their earlier relationship, such motifs lend it depth, because we sense that the two have already developed a customary way of bantering with each other.

Similarly, in the opening scene, Kowalski tells an anecdote about how, during a previous mission, he had imagined his wife looking up into space and thinking about him, when in fact she had run off with another man. Later, as Kowalski moves toward the ISS dragging Stone tethered behind him, he asks her if anyone is looking up and thinking about her. This elicits her most intimate revelation, that she had had a daughter who died in a freak accident. There is also no Mr. Stone waiting at home for her. Thus although the two characters have different personalities, both are escaping loneliness by a retreat to the beauty and peace of space.

Finally, there is the last shot, with Stone seen from behind against the sky, covered by light clouds. It reverses the opening, when we were in the opposite position, looking down at the earth from space, with the clouds of a huge hurricane prominently visible. There Stone drifted in space, held in place by a large mechanical arm; here she struggles to regain her sense of balance after prolonged weightlessness and succeeds in walking a few steps, thanks to gravity.

Like motifs, careful motivation of action helps us navigate through the plot. Given the rapidity with which new information is thrown at us as the narrative progresses, the screenwriters are careful to set up major premises in advance so that we will quickly understand them when they arrive. In the opening scene, as Kowalski swoops cheerfully around the shuttle, Houston asks about the supply of fuel in his jetpack. He reports that it’s 30% down. Not a lot, but enough that we are prepared for the moment after the disaster when he says he’s running “on the fumes.”

During the opening, the messages from Mission Control thoroughly forewarn us of the rapidly approaching hail of space debris. After it passes, Kowalski has Stone set her watch for 90 minutes, since that is when they can expect the same debris to return–as it does at regular intervals to destroy the ISS and the Chinese station. Stone reminds us of this danger when she exits the Soyuz vehicle to detach its parachute, muttering, “Clear skies with a chance of satellite debris.” The presence of the deployed parachute also sets up the moment when the chutes of the Chinese pod deploy as it nears its splashdown in the final sequence.

As Stone struggles to get aboard the ISS, Kowalski converses with her via radio. They mention her training with landing vehicles. Her only experience has been with simulators, and in every case she crashed them. Still, as Kowalski points out, she knows something about them–a point which proves vital in the dream scene discussed above, where Stone’s mind summons up a memory about how launching and landing space vehicles are not all that different.

Apart from creating a brief scene of suspense, the fire in the ISS introduces the fire extinguisher and demonstrates how, in a situation of weightlessness, the extinguisher propels Stone through space. This prepares us for the crucial scene in which she uses it as Kowalski had used the jetpack, allowing her to reach the Chinese station despite being untethered in space.

Character motivation, fortuitous events, and religion

Throughout the film the cause-effect chain remains fairly straightforward, with one major exception that I’ll get to shortly. But because the characters are reacting to rapidly changing circumstances almost entirely beyond their control, the outcomes are often fortuitous rather than the result of character traits. This is not to say the film uses numerous coincidences. It is not coincidence that Stone manages time and again at the last possible moment to grab a pipe or handle on the outside of a space vehicle. She’s aiming to do that, so she manages it not by coincidence but by luck.

Some of the most crucial events in the film are partly a matter of character motivation, but the outcomes of Stone’s and Kowalski’s actions are fortuitous. Stone apologizes to Kowalski for not having immediately obeyed his order to stop trying to repair her equipment and head for the space shuttle. She presumably continued with the rebooting because she is a dedicated researcher, reluctant to abandon her important work even when in physical danger. Yet as it turns out, reaching the space shuttle interior would have been fatal. When Kowalski and Stone do reach the shuttle, they find it split open, its crew dead–just as the pair would be had they retreated inside immediately. Stone’s delay actually saved the pair, though neither character could know this at the time.

Less obviously, Kowalski accidentally dooms himself. We see him in the opening minutes, cheerfully circling the shuttle and Hubble, playing music, telling anecdotes, and apparently hoping to stay outside the shuttle long enough to set a record. Presumably he has already accomplished his task in the space walk, or perhaps as the most experienced member of the team, he is watching over the other two. He is also, however, wasting fuel–fuel that he doesn’t realize he may need. Later, when forced to travel through space to rescue Stone and then to make it from the shuttle to the ISS, his tank becomes empty just before they reach it. His inability to maneuver without endangering Stone leads to him detaching his tether and stranding himself in space forever.

There are other fortuitous events. Stone is lucky that her Chinese pod lands in a body of water but close enough to shore that she can survive the impact and get onto land easily. It is probably by chance that in entering the Soyuz craft, the weightless fire extinguisher blocks the door and that she pulls it into the craft rather than pushing it out. Later the extinguisher enables her to propel herself to the Chinese station. There are also obstacles fortuitously created, as when Stone discovers that the Soyuz vehicle has no fuel–presumably because its supply tank has been ruptured by flying debris.

There may be one major exception to this dependence on accidental causes and effects: the religious motif. This is a strange motif, since it doesn’t become significant to the plot until fairly late. Early in the complicating action, as Kowalski and Stone journey toward the ISS and he asks her about her life on earth, he’s playing a country song, “Angels Are Hard to Find.” It’s playing when Stone mentions her daughter’s death; Kowalski soon turns it off to pay more serious attention to her story. At the time, the song doesn’t seem relevant. About seventy-two minutes in, the religious motif returns and becomes more prominent. Stone discovers that the Soyuz fuel tank is empty. The vehicle drifts as sunset settles on the earth below. We see vast snow fields and fjords below, and frost forms on the window. (The cut to the frosty window is one of the film’s few apparent ellipses.) There is a brief shot of a Russian icon inside the Soyuz (Christ as a child carried by John the Baptist, I think).

Immediately after this, Stone makes contact with someone on earth. She tries to communicate her mayday call. Gradually she loses hope and begins woofing in echo of dogs she hears on the radio. She says she’s going to die. During this scene she talks of how there is no one on earth who will mourn or pray for her soul. She asks the man to “Say a prayer for me.” She adds, “I’ve never prayed in my life. Nobody ever taught me how. Nobody ever taught me how.” A baby is heard on the radio, and the man apparently sings a lullaby to it. Stone sadly comments, “I used to sing to my baby. I hope I see her soon.” At that point she dials down the oxygen inflow and says, “Sing me to sleep, and I’ll sleep.”

As she falls asleep, a knock on the door is heard off, and Kowalski enters the Soyuz. He drinks some of the hidden vodka, chats, and tells her to use the soft-landing device. Although he sympathizes with her desire to surrender to the eternal peace of space, he encourages her to save herself rather than giving up: “Ryan, it’s time to go home.” After his disappearance, Stone once again strives to save herself.

Once she has reached the Chinese landing pod, she struggles to cope with its instrument control-panel. As the countdown clock starts running, there is a tilt up to a little Budda figure, roughly in the spot where the icon had been on the Soyuz. As Stone works, she talks to Kowalski, asking him to find her daughter: “Tell her that she is my angel.”

Finally, back on earth, in the final shot Stone struggles to rise, muttering “Thank you,” before walking away from the camera, which tilts up to a low angle of her against the sky.

Though this motif appears late in the film, the narrative stresses it. Something is going on here, but what?

Most obviously, Stone seems to become somewhat religious, despite never having prayed before. Perhaps this is simply an emotional change that allows her to reconcile somewhat to her daughter’s death, to feel hope and enthusiasm for carrying on with her attempts to reach earth, and to accept her survival as a gift to her from some sort of deity.

Given that the startling visit of Kowalski, whom we assume to be dead, to the Soyuz and also his providing Stone with the one bit of information she needs in order to carry on, we might assume that this scene presents a sort of miracle. Kowalski’s visit makes him a quasi-angelic figure bringing divine intervention to Stone, perhaps, or simply a vision inspired by a divine power.

Yet his return is cued as a dream, with Stone falling into a sleep that she assumes will end in death. We all have had some sort of experience with a dream providing inspiration or the solution to a nagging problem. As Kowalski points out, Stone should know that taking off and landing are essentially the same thing; it was part of her training. The dream does not give her the knowledge but rather reminds her of it. Indeed, after she wakes up, she still has to struggle to remember what she learned about soft landings and also consults the manual.

Everything in the dream reflects things we already know about the two characters. Kowalski mentioned knowing where the vodka is kept. Earlier he had reminded her of things she knows about landing from her training with simulators. His words to her about the sorrow of losing her daughter and the temptation to surrender to the eternal peace of space recall her own line from the beginning when he asked her what she likes about space: “The silence. I could get used to it.” (Cuarón, in an interview with Anne Thompson, refers to Kowalski’s return as “a projection of herself in a dream.”)

Seemingly Stone gains some sort of religious belief or spiritual consolation. While working on the Chinese pod’s controls, she talks animatedly to the absent Kowalski, whom she apparently envisions meeting her daughter in an unspecified afterlife. The “Thank you” at the end I take to be the conclusion of this monologue in the pod, thanking Kowalski. In a truly classical film, a character mentioning never having learned to pray would surely say a prayer later in the film. Stone never does. I interpret the religious motif as signaling a transformation of her attitudes rather than implying some sort of divine intervention to rescue her. Either way, some viewers might take this motif to be heavy-handed or saccharine, but its ambiguities could prevent others from having such reactions.

 It all worked

The combination of narrative techniques that I have just analyzed obviously appealed to many of the the people who have seen the film.

On November 1, Box Office Mojo summed up the film’s career since its October 4 release:

Through four weeks in theaters, Gravity earned $206.1 million, which accounted for just under a third of total domestic box office earnings in October. It’s already the highest-grossing movie ever to be released during the Fall (September or October) and will earn at least another $50 million before the end of its run.

Gravity‘s remarkable success can be attributed in part to Warner Bros.’s great marketing campaign, which helped the movie set an October opening weekend record ($55.8 million). From there, the movie had an unprecedented second weekend hold thanks to world-of-mouth that asserted the movie needed to be seen on the biggest screen possible (and preferably in 3D). Speaking of 3D–Gravity‘s box office has been pumped up by the fact that most people (around 80 percent) are choosing to pay an extra few bucks to see the movie in that premium-priced format.

According to Variety, “Imax contributed 21% of the opening-weekend domestic cume for the film.”

(Even I, no fan of 3D, have seen it in that format at two of my three viewings so far and would do so again.)

Abroad, the film has also done well. As of November 6, its foreign box-office gross is about $207 million, with the film still to open in several major markets, and its domestic take has risen to almost $220 million, expected to top out at $260 million.

[Nov. 10: Box Office Mojo is now estimating that Gravity will ultimately gross about $660 million worldwide. It opened this weekend in the United Kingdom, where 89% of its ticket sales were for 3D screenings.]

This is also one of those rare films people see in theaters repeatedly within a short period. By the end of its opening weekend, three percent of audience members said they had already seen it more than once. On October 21, the film’s official FaceBook page asked fans, “How many times have you seen the film in theaters?” One, two, or three times were common, but even by that date, two and a half weeks into its run, there were a few who had seen it four or five times. Many single and repeat viewers mentioned plans to see it again. Quite a few also specified which formats they saw it in at the different screenings. Dan Fellman, head of Warner Bros.’s domestic distribution, remarked, “This is a phenomenon where people are asking friends and family not only if they’ve seen the film, but where.”

Some moviegoers (and critics) have found the film boring. But those who love it really love it.

Our next entry will deal with the film’s style and how it was achieved.

Coincidences can play many roles in a film’s plot, as we discuss in this entry. You could take Gravity’s ambivalent gestures toward Stone’s spiritual redemption as another example of Hollywood’s strategic ambiguity about controversial themes.

Jason Mittell has written an essay, “Gravity and the Power of Narrative Limits,” which nicely complements my analysis. He concentrates on the film’s relation to traditional genres, discussing how it departs from familiar conventions of science-fiction and survival narratives.

P. S. 9 November: After I linked to this entry on my Facebook page, Meraj Dhir commented that the song Shariff sings as he does his little weightless dance is from a famous number in Raj Kapoor’s 1955 musical Shree 420. Not exactly relevant to my analysis, but fun to know, so thanks, Meraj! You can see the number here.

NOTE: On November 8, after watching the film a fourth time, I revised this post, correcting a few errors and quoting some brief passages of dialogue that I was able to record on this go-through. I have not noted the changes with the usual strike-through lines, since it seemed too complicated and distracting to do so in this case.

Today we have a guest entry by our friend and colleague Jeff Smith. Jeff teaches here at the University of Wisconsin–Madison in the Film Studies area. He’s an expert on cinema sound, particularly music. His book The Sounds of Commerce: Marketing Popular Film Music is a trailblazing explanation of the ties between 1960s Hollywood and the music industry. It combines analysis of scoring with discussions of business decisions that shaped audience’s response to movie soundtracks. His forthcoming book is on how critics have understood the impact of the HUAC hearings and the Hollywood Blacklist, with emphasis on films that seem to comment on Cold War politics.

Jeff has written extensively on sound practices in contemporary American cinema. What better person to explain and analyze the newest sound technology in Hollywood movies?

Director Peter Jackson calls it “the completely immersive sound experience that filmmakers like myself have long dreamed about.”  Mark Andrews, who made his feature film directorial debut with Pixar’s Brave, says, “It’s more 3D than 3D images.”  “It” is Dolby Atmos, a new cinema sound system that promises to change the way you see and hear movies.  Does it?

The buzz

Dolby Atmos made its debut with Brave at last year’s Los Angeles Film Festival.  A handful of scenes from earlier films, including Rise of the Planet of the Apes and The Incredibles had been test-mixed in the new Atmos system for demonstration purposes.  But Brave is the first film to use the new platform from start to finish.

If you haven’t heard of Dolby Atmos, you’re not alone.  When Brave opened, there were only fourteen theatres in the country that were capable of showing the film in Atmos.  These tended to be high-end movie theatres, such as AMC’s six Enhanced Theatre Experience venues, which typically charge a premium ticket price.

The list of theatres wired for Atmos has grown since then, but the number remains quite small.  At this point, there are 37 theatres in the U.S. that feature Dolby Atmos, a tiny fraction of the country’s nearly 40,000 screens.  A little more than a third of these theatres are located in California.  Approximately another third are clustered in just five states: Florida, Illinois, New York, Texas, and Washington.  Most of these theatres are in the suburbs of major metropolitan areas.  True, the recently opened Palms Theatre in Muscatine, Iowa (population 22,886) incorporated an Atmos system in its XL Digital Auditorium, but presumably it was part of its building plan.  For existing theatres, an upgrade carries a hefty price tag of between $30,000 and $100,000. So Dolby Atmos may not be coming soon to a theatre near you.

Yet more and more films are being mixed for Atmos.  Dolby has announced that more than twenty films will feature the new platform in 2013, a significant increase over the twelve films distributed with this format in 2012.  The roster includes three of the most eagerly anticipated studio tentpoles of the summer season: Paramount’s Star Trek Into Darkness, Pixar’s Monsters University, and Warner Bros. Superman reboot, Man of Steel.  Still, does the new system justify the expensive theatre conversions and the higher ticket prices that will follow?

Two channels. Then five + one. Now, how about sixty?

Dolby Digital Surround 5.1.

According to the Dolby website, Atmos grew out of the company’s efforts to introduce Dolby 7.1.  For years, the flagship for Dolby’s digital surround sound technology was their 5.1 system.  The digit 5 referred to the number of channels that could be used by sound mixers: three channels for speakers behind the screen (left, center, and right) and two channels for all the surround speakers that line the side and back walls of the auditorium (left surround and right surround).   The .1 in 5.1 refers to the Low Frequency Effects channel (LFE) that sent sounds between 3 to 120 Hz to a subwoofer located behind the screen in the front of the auditorium.  These low-frequency sounds trigger acoustic vibrations that add a kinesthetic kick to onscreen explosions and car crashes.

With Toy Story 3 in 2010, Dolby introduced two additional channels to their 5.1 platform.  The 7.1 system subdivides the surround speakers.  Instead of two channels for the surrounds (left surround and right surround), Dolby 7.1 offers sound mixers four channels (left side surround, left rear surround, right side surround, and right rear surround).

Dolby 7.1 came fairly late to the game, however.  Sony already had introduced its own 7.1 system in 1993 with the premiere of John McTiernan’s Last Action Hero.  Yet despite the eight-channel capability of Sony Dynamic Digital Sound, (SDDS), it never really caught on, largely because of the added expense of executing a 7.1 sound mix in addition to the standard 5.1 one.  To date, more than 1400 films were mixed for the six-channel version of SDDS.  Only 97 films received an eight-channel mix.

In the 2000s, Sony gradually began to phase out its 7.1 system.  Filmmakers stopped building eight-channel mixes in SDDS in 2007.  Moreover, about ten years after introducing SDDS, Sony stopped manufacturing decoders for SDDS content, citing decreased demand.  SDDS had always lagged behind its competitors in the battle for screens, so Sony’s decision was not terribly surprising.  Although new films continue to be mixed in SDDS to meet the needs of exhibitors that continue to use the system.  Most theatre owners have replaced SDDS with one of Dolby’s systems.   Sony promised exhibitors it would continue to make parts and service for current SDDS products available until 2014.  But the electronics giant acknowledged that it was shifting its attention to digital cinema technologies that were already in development.

Considering Sony’s history and exhibitors’ reluctance to upgrade to an eight-channel system, it’s surprising that in 2010, Dolby would launch its own 7.1 counterpart. But maybe not so surprising, because Dolby’s new channels were differently placed.  Sony’s 7.1 system had added channels to the speakers behind the screen. Instead of three front channels (left, center, and right), SDDS had five (left, left center, center, right center, and right).  These extra sound sources probably made little difference to most moviegoers.  Adding channels behind the screen made for smoother panning of sounds that seem to move across the space depicted in a shot, but it did nothing to increase the sense of spatial immersion.

In contrast, Dolby added its two extra channels to the surround areas. Its 7.1 platform treats the interior of the theatre as seven spatially distinct zones.  The additional channels in the surround array enables mixers to position sound elements more precisely.  This “zoning” of the surrounds offers mixers a wider variety of options for the placement of sounds, and it more closely approximates the way that sounds in real life come at us from several different directions.

Now Dolby Atmos pushes the premises of this aspect of Dolby 7.1 to the nth degree.  While Dolby 7.1 makes a leap from six channels to eight channels, Dolby Atmos makes a leap from eight channels to sixty-four channels, a gigantic change from all of Atmos’ predecessors.  Using the old nomenclature that described the sound platform as a ratio of speaker channels to LFE channels, we might call Dolby Atmos  a 62.2 system!  It offers more than sixty separate and distinct speaker channels as well as an optional channel for additional subwoofers located in the back corners of the auditorium.  More importantly, with the vastly expanded number of speaker channels, Atmos enables mixers to position a single sound element in the theatre with unprecedented clarity and precision.

Say you have a screen door banging in the wind. In Dolby 5.1, if a mixer wanted to send that banging noise to the right surrounds, it went to every speaker in the array.  In effect, it wouldn’t sound like a single door, but rather several doors banging in unison.  In Atmos, however, if a mixer wants to position that banging sound in a particular part of the auditorium, he can treat it in a manner analogous to the way it would be heard in the real world.  The sound is emitted from a single point of origin and is heard as a punctual effect rather than as aural ambience emanating from a broader area of the theatre.

All about the panning

Beyond its multiplication of channels, Dolby Atmos  addresses certain limitations in earlier platforms.  Simplifying a bit, we can say that for content providers Atmos is “all about the panning.”  Atmos adds a couple of speakers on each side that are placed close to the screen to facilitate smoother pans for sounds that move from onscreen to offscreen.

The surround speakers in Atmos have a frequency range that closely matches that of the speakers behind the screen.  This aspect of Atmos addresses a common complaint about more traditional digital surround systems.  In those, the surround speakers have a narrower frequency range than the front ones. As a result, when sounds were panned from onscreen to offscreen, the audience could hear changes in timbre and fidelity. The extra subwoofers in Atmos ameliorate this problem since they help to “bass manage” the surrounds, thereby allowing sounds in them to have a much “fatter” low end.

Besides adding subwoofers to increase the number of LFE channels, theatre owners have the option of adding left center and right center channels to the speakers behind the screen.  This allows for smoother pans of sounds made by characters or objects that move across the screen.  In this respect, Atmos combines the best features of Dolby 7.1 and Sony’s eight-channel system.

Up in the air

In platforms like Dolby 5.1, sound is situated almost entirely on one plane.  The speakers behind the screen are at roughly the same height as are the surround speakers that line the sides and back wall of the auditorium.  Dolby Atmos expands the auditory field by adding speakers to the theatre’s ceiling.

These additional speakers create an overhead sound plane, which enhances the sound mixer’s ability to localize sounds in the auditorium.  In real life, of course, we hear all kinds of things overhead–bird calls, airplanes, building construction.  Although mixers can use these ceiling speakers for sounds that are important in the story that unfolds onscreen, Dolby’s literature usefully reminds us that overhead ambient sound can enrich a film’s setting.  A chirping cricket placed in one of the overhead speakers can convey the feeling of sitting at night beneath a forest canopy.

Admittedly, this new feature of Atmos technology merely represents a refinement of something filmmakers could do before.  But previous sound technologies suggested an overhead sound plane through a psychological illusion.  When the characters in Das Boot, for example, hear the pinging sounds of a British destroyer’s sonar system above their submarine, we might hear that sound originating above our heads.  Yet its point of origin is no different from any other sounds that we hear in Das Boot.

Characters’ upturned gazes bias our response as we watch them anxiously awaiting the detonations of the depth charges released by the destroyer.

The extra surround channels and the overhead sources all create a more enveloping ambience and more punctual sound events—ultimately, a more realistic aural environment.  Dolby’s innovations should be especially appealing for films projected in 3-D. Atmos, as its proponents note, offers a 3-D sound to match 3-D picture.

Is the recent popularity of 3-D cinema, though, the only factor in Dolby’s push to get more exhibitors on board with Atmos?  Curiously, it comes right on the heels of Dolby’s introduction of its 7.1 system.  Over the years, Dolby has continually pressed its R & D division to develop new sound technologies.  But, in bringing both Dolby 7.1 and Atmos to the marketplace in about a two-year time span, I still have to wonder, “Why now?”

Backward compatibility

Fans of Atmos argue that it represents nothing less than a paradigm shift for cinema sound technology.  That may prove to be true if more exhibitors decide to invest in it.   But if we are witnessing a paradigm shift, it is one made possible by another paradigm shift, one of even greater historical import.  I’m thinking here of the sweeping change that took place as theatres changed to digital projection.

David has written extensively on this topic, and you can find his account of this change in his e-book, Pandora’s Digital Box, a recasting of several blog entries under that name. Actually, the shift to digital projection didn’t demand Atmos.  But it certainly made it possible.

Look closely at a single frame of 35mm film.  Like an archeological record, it preserves thirty-plus years of cinema sound innovation. Left of the picture area, you can see the twin optical sound stripes, encoded as wavy lines, that are used for older Dolby Stereo systems.  Dolby continually refined its initial four-channel stereo system, ultimately introducing Dolby SR in 1986 as the last generation of its signature noise-reduction technology.  (The SR stands for Spectral Recording.)  These optical stripes on a 35mm print are still necessary for any theatre still using analog sound.

Just to the right of these optical stripes you can see dashed white lines used for DTS time code.  DTS is a digital surround sound technology that uses compact discs to store and play back the film’s audio.  The white lines maintain sync between picture and sound.

On the extreme left and right edges of the film strip, outside the perforations, is a speckled light blue stripe. That encodes the audio data for SDDS playback.  The information in the two stripes is redundant, but that’s necessary because SDDS is decoded by a sound reader that mounts on the top of a 35mm projector.  By putting the information on both sides of the frame, Sony’s design avoids any potential problems in threading the SDDS decoder.

Lastly, in between the sprocket holes on the left side, you can see the audio information for Dolby Digital.  Like the SDDS stripes, these gray patches of Dolby Digital audio are encoded as data blocks that are read by a digital sound head. They send the information to a Dolby Cinema Sound Processor.

In our 35mm strip, a huge amount of audio information, along with the film image itself, is jammed into a space that’s less than an inch and a half wide. Throughout the 1990s and 2000s, this “quad track” – that is, one analog system and three digital formats – proved to be very versatile. The audio could be played back in any theatre, regardless of the particular type of sound system that is used.  The quad track allowed studios to avoid the distribution nightmare of having to match prints to screens using different audio systems.  The one-size-fits-all approach also enabled multiplex exhibitors to move a print from one screen to another without worrying about compatibility.

But suppose we had to add another type of audio data to 35mm film, one that is capable of supporting more than sixty different audio channels.  There just isn’t enough empty space on a 35mm print to make such an innovation possible.  So even if Dolby’s engineers envisioned the potentiality of an overhead sound plane and of a cinema sound processor capable of supporting 64 different outputs, there was no practical way to add the audio information needed for Dolby Atmos and retain the compatibility offered by the quad-track 35mm.

Enter the Digital Cinema Package.  With the large-scale conversion to digital projection, the prospect of innovating a system like Dolby Atmos suddenly took on new life.  The audio files for Dolby Atmos are embedded in the DCP alongside the files for 5.1 and 7.1.  Like the audio in 35mm film, the DCP is designed for maximum compatibility.  The Dolby Atmos files are ingested into the theatre’s server along with all of the other audio and picture files found in a DCP.  But for any theatre that is not wired for Atmos, the server simply ignores the Atmos files and uses the main audio track file for standard playback.  More importantly, if there is any communication problem between the server and the Atmos sound processor, the system simply reverts to a Dolby Surround 7.1 or 5.1 mix, ensuring that a show can continue without delay.  Even more impressively, the Atmos system even detects a damaged speaker or amplifier.  Its flexible rendering system automatically works around the faulty component, sending the necessary audio data to other parts of the replay chain.  So a show will continue despite a technical problem, and a narratively important sound effect or line of dialogue will not be lost due to a damaged speaker or amplifier.

The backward compatibility found in the Atmos system has long been an aspect of Dolby’s business strategy.  When Dolby introduced its four-channel Stereo technology in 1975, it did so in a way that accommodated the needs of theatre owners who wanted to retain their existing sound systems.  Dolby Stereo used a matrix system that mixed four channels of audio information down to the binaural optical stripes found on a standard 35mm print.  After the projector’s sound head read these optical soundtracks, the information contained in them was then sent to a sound processor that “unpacked” the binaural stereo and sent the signals to the appropriate speakers in the auditorium.  Dolby’s matrixing system, though, was prone to certain amount of cross-talk between the screen channels, and it occasionally caused a sound to be sent to the wrong output in the four-channel mix.

As a company concerned about backward compatibility, Dolby was willing to live with trade-offs. On one hand, the Dolby matrixing system avoided the kinds of format complications found in multi-channel systems that used magnetic striping.  On the other hand, because of the potential for bleed between channels, some sound editors were reluctant to experiment with directional sounds in Dolby Stereo mixes.  In practice, the surround channel in Dolby Stereo was reserved mostly for ambient noise, things that added texture to a film’s aural environment but that did not flaunt the precise directionality made possible by multi-channel playback.

Sound historians Jay Beck and Mark Kerins point out that such timidity has also characterized a good deal of sound work in the Digital Surround era. Contemporary sound designers strive to create immersive audio environments for films, but they also opt not to localize specific sounds that would draw our eyes away from the screen.  In particular, designers shy away from assigning sudden loud sounds to the rear surround channels.   Because the sound originates behind the audience, viewers are likely to be startled, which can be inappropriate to the mood of the story. Worse, the audience may turn to see what caused the unexpected noise. This is called the  “exit-door” effect, because it pulls the viewer out of the story as if somebody had slammed the emergency exit.

Sound editors are much bolder about localizing individuated or punctual sounds in an Atmos mix.  With 64 different channels to play with, Atmos offers myriad possibilities for audio experimentation.  For content-providers, Atmos presents a “brave new world” for cinema sound.  But this leads to a larger question: What is it like to see a film in Atmos?

Multi-channel sound with a Scottish lilt

While I was in Los Angeles last August doing research, I decided to spend a sunny Sunday morning at the movies.  The City of Angels has a bevy of terrific movie theatres showing Hollywood’s latest, but the choice was easy. I headed to see Pixar’s Brave at Hollywood’s El Capitan Theatre, then one of only ten theatres in the country wired for Dolby Atmos.

El Capitan opened in 1926 as one of three theatres run by legendary showman Sid Grauman.  Unlike Grauman’s nearby Egyptian and the famous Chinese Theatre, El Capitan was a venue for live performances.  After a decline in attendance in the late 1930s, El Capitan was refurbished and reopened as the Hollywood Paramount Theatre.  For several years, it remained a flagship for Paramount Pictures until the late 1940s, when the U.S. Supreme Court and the Justice Department forced all of the studios to divest their exhibition holdings.  Until 1991, El Capitan was owned and managed by a series of different companies, including the Pacific Theatres Circuit.

That all changed in the late eighties when Disney offered to lease El Capitan from Pacific Theatres with an eye toward using it as a venue for premiering new films.  Disney spent millions restoring the theatre’s original décor, although it seems to have been “imagineered” into a faux 1920s picture palace, complete with a Mighty Wurlitzer organ.  Disney also restored El Capitan’s original name perhaps in an effort to sever the theatre from its earlier associations with Paramount.  El Capitan is now Disney’s own flagship theatre in Hollywood and is fully integrated with their other businesses.  Indeed, the Sunday morning that I attended Brave I was surrounded by families visiting it as one of the stops in Disney tour packages.

As a premium venue, El Capitan offers much more than your usual movie experience.  As I walked in to find a seat, a talented organist played a medley of songs from classic Disney films, like Pinocchio’s “When You Wish Upon a Star,” and from more recent titles, such as Toy Story’s “You’ve Got a Friend in Me” and The Lion King’s “Circle of Life.”

There was plenty of other pre-show entertainment.: a couple of trailers, a brief light show, and song and dance numbers featuring costumed Disney characters.  Unlike the organ medley, though, these live performances did not use music from Disney films, but instead drew from the Great American songbook. Mickey and Minnie danced to Astaire-Rogers tunes, followed by patriotic songs, including George M. Cohan’s “You’re a Grand Old Flag” and “The Yankee Doodle Boy.”  The program culminated with a short medley of Scottish songs that introduced Disney’s newest princess, Merida.

This final number provided a more or less seamless segue into the start of Brave.

I didn’t know quite what to expect from the film, which has hailed as a change of pace for Pixar, a company that had developed a reputation for targeting a “family film” demographic centered on pre-teen boys.   Despite the fact that Pixar had broken new ground with the film’s red-haired, tartan-clad heroine, Brave received middling reviews. By August, it was perceived as a bit of an underperformer, having earned “only” half a billion dollars worldwide. (Such is the high bar set by Pixar titles.)

I quite enjoyed Brave, not least because it was in Atmos.  For the most part, Atmos lived up to the hype, offering a sonic experience that was unlike anything I’d heard in theatres before.  In a way, Atmos simply refines things that could be accomplished in Dolby 5.1 or 7.1.  Yet certain moments of Brave lived up to the promise of a fully three-dimensional sound that matches a film’s 3-D images. I’m not an audio engineer or sound technician.  I’m really just a guy who likes going to the movies, albeit one who is a tad more attuned to the vagaries of digital surround sound mixes.  So I’m offering some “in the moment” impressions of the Atmos system.  If I’ve made any grievous errors in description, chalk it up to either faulty memory or the power of cognitive illusion.

I first became aware of Atmos as something different early on during a rather ordinary scene in which Merida receives “princess training” from her mother.  As Merida recites a poem, the Queen, standing above her, instructs her to project her voice saying, “Enunciate!  You must be understood from anywhere in the room or it’s all for naught.”

Cut to Merida. When she replies under her breath, “This is all for naught,” the Queen shoots back “I heard that!”

During this brief shot that holds on Merida, Emma Thompson’s mellifluous response as the Queen issues from one of the left rear surround speakers.

The localization of the Queen’s voice creates a brief “point of audition effect” as it realistically places us in the middle of the diagonal space that separates Merida from her mother. The moment also playfully demonstrates the Queen’s instruction to Merida to be heard from “anywhere in the room.”

Another example of Atmos’ innovative use of offscreen sound occurs during the family dinner scene in which Fergus is retelling the story of his confrontation with Mordu.  After Merida sits down at the table, Fergus is about to take a bite from a leg of poultry.  At this moment, we hear the sound of barking dogs swiftly panned through the right side surround speakers in the auditorium.

The dogs then burst into the frame from off right.

The use of spot sound effects in the surround speakers is quite conventional, but the panned barking had a smoothness and swiftness that I had not heard before.

This moment is interesting for another reason.  Although this is admittedly a bit speculative, I believe it showcases Atmos’ ability to exploit a kind of aural correlate of the Phi Phenomenon.  The Phi Phenomenon refers to an optical illusion involving the movement of light.  Gestalt psychologist Max Wertheimer noticed in experiments conducted in the early 1910s that when two lights were flashed on and off rapidly enough, subjects saw them not as two flashing lights, but rather as a single light that appeared to move back and forth.  Many neon signs exploit this perceptual illusion.

The same is true of this rapidly panned sound in Dolby’s Atmos, which is made possible by the system’s “pan-through array.”  Because the sound editor can use positional metadata to send the sound of the bark to each of the right side surround speakers for just a couple milliseconds of time, our mind does not hear it as a group of fragmented sounds, but instead hears it as a single sound that zips through the space of the auditorium.

Later, while galloping in the woods, Merida finds herself thrown into the middle of a Stonehenge-like circle.  As Merida gets her bearings, we hear a breathy, echoey, high-pitched sound coming from one of the right surround speakers.  Cueing us by Merida’s glance into the space off right, director Mark Andrews cuts to a shot over Merida’s shoulder that shows a blue wisp off in the distance.

The use of a sound effect in the surround channels to steer our attention to offscreen space may be one of the most conventional aspects of digital sound aesthetics.  Yet this moment is a bit unusual. It positions one localized sound effect against a bed of ambient sounds that are sent to all of the speakers in a geographical zone.  In fact, this is an aspect of Atmos that Dolby showcases to content-providers.  Unlike systems that are wholly channel-based, Atmos allows sound editors to locate a single sound effect in an individual speaker at the same time that other groups of sounds are fed to the system as a channel-based submix.  The combination of “beds” and aural objects is captured in a visual diagram provided by Dolby.

The graphic of the bed shows a variety of gray-colored flora and fauna.  The aural objects are represented as a green frog and a blue songbird.  When the two images are combined, the green frog and blue bird stand out as individually colored objects set off against the bed of gray background elements. Background and foreground effects can all be developed individually and then blended at a later stage of postproduction. Atmos refines the creative possibilities found in other digital surround sound systems in a way that preserves current workflows.

Up until now, I have not said much about Atmos’ ability to exploit an overhead plane of sound.  This may strike you as a bit curious since the legendary sound designer, Gary Rydstrom, discussed this aspect of Atmos in the Hollywood Reporter as one of the technology’s most appealing features.  Describing a scene where Merida goes to retrieve an arrow that she has launched, Rydstrom says:

You hear the arrow ‘swish’ go through the theatre and land way back behind the audience.  Then she goes into the forest.  I love putting sound in the ceiling, things like scary forest birds.  For a little girl, the forest feels even taller and more imposing if you can have weird sounds way up high.

Rydstrom’s description beautifully captures the way this moment from Brave works onscreen.   Yet because I had read his comments before seeing the film, it was a little less powerful than some other events on the overhead sound plane. A moment I found more striking comes when the queen realizes that a magic spell has turned her into a bear.  The bear flails about the room, ultimately falling backward onto her four-poster bed.

After falling through the bottom of the bed, the bear then bolts upright to smash through the canopy.  Aurally, this moment is rendered as a loud crash located in the speakers suspended from the ceiling.  The placement of the sound beautifully punctuates the bear’s sudden upward thrust, adding a sonic punch to the sight gag.

Probably the most vivid demonstration of Atmos’ capability comes in a scene in which Merida is caught in a thunderstorm.  Sitting in the balcony of El Capitan, I felt pulled into the thick of events unfolding onscreen.  If you shut your eyes, you could almost feel the patter of raindrops, the whoosh of the wind, and the violent clamor of thunderclaps.

Admittedly, such scenes can seem pretty powerful in a theatre using a more conventional digital surround system.  A Dolby 5.1 or 7.1 mix can create comparable aural immersion by simply sending submixes of the storm’s sounds to different zones within the theatre.  I suspect that the impact of the Atmos mix came less from its ability to isolate particular sound effects than it did from the additional subwoofers placed in the back corners of the theatre.  With three subwoofers, loud sounds seem flung at you from all directions.  Thanks to the additional LFE channel, the sound waves from those thunderclaps triggered even stronger shakes and rumbles.  (The extra subwoofers also enhanced Mordu’s ferocious roars during the epic confrontation, shown up top, that resolves Brave’s plot.)  The overhead speakers also played a subtle role in creating the feeling of being caught in a storm.  The sense of a three-dimensional environment is undoubtedly heightened by the sound of rain droplets falling and spattering above one’s head.

Is Dolby Atmos the great leap forward for cinema audio that its proponents claim?  The answer depends upon the weight you place on potentiality vs. established practice.  Atmos definitely creates opportunities for precise placement of sounds in the auditorium.  That in turn offers new prospects for audio/visual coherence.  As Dolby puts it in the white paper: “If a character on the screen looks inside the room toward a sound source, the mixer has the ability to precisely position the sound so that it matches the character’s line of sight, and the effect will be consistent throughout the audience.”

Yet the specific purposes to which Atmos was put in Brave – the use of spot sounds to activate offscreen space; the use of surround speakers for panned or moving sounds; the creation of a immersive, 3D aural environment; the use of loud noises to viscerally impact the audience – are all things that its predecessors accomplished, going all the way back to Dolby’s pioneering four-channel system.  Atmos does these things either a little better or a lot better, depending upon the specific system you’re comparing it with.

Perhaps my description of Brave suggests that the advantages of Atmos are more subtle than spectacular.  Perhaps you feel that contemporary movies are sound-polished enough already.  If so, Atmos probably won’t hold much appeal for you as a moviegoer.

The bigger question for me is whether it will be widely adopted by theatre owners.  A key aspect of Dolby’s sales pitch for Atmos is that it is scalable to almost any size of theatre.  If your theatre is too small for a 62.2 configuration, you can reduce the speaker array and get some of the benefits of Atmos’ improved surround definition and overhead sound plane.  Dolby says its minimum configuration for Atmos is 9.1.  But if the best that you can do for your theatre is 9.1, then perhaps Dolby’s 7.1 system is a more sensible option.

The exhibitor’s ability to mix and match components in Atmos was something I experienced firsthand during a recent visit to the ShowPlace ICON in Chicago.  The ICON has two screens wired for Atmos, but those auditoriums weren’t equipped with the optional subwoofers that were in the system at El Capitan.  Why? With two additional subwoofers, there is increased risk of sound bleeding over to the neighboring auditoriums of a multiplex.  This wasn’t a problem for El Capitan, a huge, standalone theatre.

In any case, the costs to upgrade all the screens in a multiplex would be prohibitive, particularly at a time when many theatre owners are still smarting from expenditures of converting to digital projection.  For that reason, Atmos may be introduced as 3D was, with one or two screens per venue at first.  The decision to do an Atmos upgrade may devolve upon the question of what particular sound system is good enough to meet the needs of both theatre owners and patrons.

Yet the threshold for “good enough” is not static, and theatre owners may find themselves under increasing pressure as home theatre technologies become ever more sophisticated.  If Quentin Tarantino is right that watching digital projection in a movie theatre is like watching a giant television screen in someone’s living room, then Atmos really offers exhibitors something to differentiate the multiplex from the home theatre.  With 4K televisions already showing up at big-box retailers, cinema audio may provide exhibitors with the best means of luring movie fans out of their living rooms.  After all, are you really ready to deploy a couple of dozen speakers around your walls and from your ceiling?

At several points in this post, I cited information made available in a white paper prepared by Dolby that explains the key features of Atmos to content providers and exhibitors.   Additionally, Dolby’s website offers lots of other information about their Atmos system: a list of theaters wired for Atmos, a roster of films mixed in the process, and a short video explaining some of the differences between Atmos and other systems.

Information about Brave in Atmos can be found in two articles published by The Hollywood Reporter that are available here and here.  There’s also a video interview with Brave’s sound design team.  A brief history of the El Capitan can be found on the theatre’s website.

Film scholars Jay Beck and Mark Kerins both have written excellent histories of Dolby’s Atmos’ predecessors.  Beck’s 2003 Ph.D. dissertation, “A Quiet Revolution: Changes in American Film Sound Practices, 1967-1979,” offers a terrific account of Dolby’s innovation of its pioneering four-channel stereo system.  For a sampling of Beck’s analysis of Dolby Stereo aesthetics, see his essay, “The Sounds of ‘Silence’: Dolby Stereo, Sound Design, and Silence of the Lambs” in Lowering the Boom: Critical Studies in Film Sound, coedited by Beck and Tony Grajeda.   Kerins’ work, on the other hand, focuses more squarely on Dolby 5.1 and what he calls a “digital surround sound style.”  See Kerins’ Beyond Dolby (Stereo): Cinema in the Digital Sound Age.

For more on Atmos, see Eric Dienstfrey’s excellent explanation on our UW media blog, Antenna.

Wanda, the biggest cinema chain in China and purchaser of the AMC chain in the US, recently announced a major commitment to Atmos in its Mainland cinemas.