By Randi Altman
Rob Legato’s resume includes some titles that might be considered among the best visual effects films of all time: Titanic, Avatar, Hugo, Harry Potter and the Sorcerer’s Stone, Apollo 13 and, most recently, The Jungle Book. He has three Oscars to his credit (Titanic, Hugo, The Jungle Book) along with one other nomination (Apollo 13). And while Martin Scorsese’s The Wolf of Wall Street and The Aviator don’t scream effects, he worked on those as well.
While Legato might be one of the most prodigious visual effects supervisors of all time, he never intended for this to be his path. “The magic of movies, in general, was my fascination more than anything else,” he says, and that led to him studying cinematography and directing at Santa Barbara’s Brooks Institute. They provided intensive courses on the intricacies of working with cameras and film.
Rob Legato worked closely with Technicolor and MPC to realize Jon Favreau’s vision for The Jungle Book, which is nominated for a VFX Oscar this year.
It was this technical knowledge that came in handy at his first job, working as a producer at a commercials house. “I knew that bizarre, esoteric end of the business, and that became known among my colleagues.” So when a spot came in that had a visual effect in it, Legato stepped up. “No one knew how to do it, and this was before on-set visual effects supervisors worked on commercials. I grabbed the camera and I figured out a way of doing it.”
After working on commercials, Legato transitioned to longer-form work, specifically television. He started on the second season of The Twilight Zone series, where he got the opportunity to shoot some footage. He was hoping to direct an episode, but the show got cancelled before he had a chance.
Legato then took his experience to Star Trek at a time when they were switching from opticals to a digital post workflow. “There were very few people then who had any kind of visual effects and live-action experience in television. I became second-unit director and ultimately directed a few shows. It was while working on Next Generation and Deep Space Nine that I learned how to mass produce visual effects on as big a scale as television allows, and that led me to Digital Domain.”
It was at Digital Domain where Legato transitioned to films, starting with Interview With the Vampire. He served as visual effects supervisor on this one. “Director Neil Jordan asked me to do the second unit. I got along really well with DP Philippe Roussselot and was able to direct live-action scenes and personally direct and photograph anything that was not live-action related — including the Tom Cruise puppet that looked like he’s bleeding to death.” This led to Apollo 13 on which he was VFX supervisor.
On set for Hugo (L-R): Martin Scorsese, DP Bob Richardson and Rob Legato.
“I thought as a director did, and I thought as a cameraman, so I was able to answer my own questions. This made it easy to communicate with directors and cameramen, and that was my interest. I attacked everything from the perspective of, ‘If I were directing this scene, what would I do?’ It then became easy for me to work with directors who weren’t very fluent in the visual effects side. And because I shot second unit too, especially on Marty Scorsese’s movies, I could determine what the best way of getting that image was. I actually became quite a decent cameraman with all this practice emulating Bob Richardson’s extraordinary work, and I studied the masters (Marty and Bob) and learned how to emulate their work to blend into their sequences seamlessly. I was also able to maximize the smaller dollar amount I was given by designing both second unit direction and cinematography together to maximize my day.”
Ok, let’s dig in a bit deeper with Legato, a card-carrying member of the ASC, and find out how he works with directors, his workflow and his love for trying and helping to create new technology in order to help tell the story.
Over the years you started to embrace virtual production. How has that technology evolved over the years?
When I was working on Harry Potter, I had to previs a sequence for time purposes, and we used a computer. I would tell the CG animators where to put the camera and lights, but there was something missing — a lot of times you get inspired by what’s literally in front of you, which is ever-changing in realtime. We were able to click the mouse and move it where we needed, but it was still missing this other sense of life.
For example, when I did Aviator, I had to shoot the plane crash; something I’d never done before, and I was nervous. It was a Scorsese film, so it was a given that it was to be beautifully designed and photographed. I didn’t have a lot of money, and I didn’t want to blow my opportunity. On Harry Potter and Titanic we had a lot of resources, so we could fix a mistake pretty easily. Here, I had one crack at it, and it had to be a home run.
So I prevised it, but added a realtime live-action pan and tilt wheels so we could operate and react in realtime — so instead of using a mouse, I was basically using what we use on a stage. It was a great way of working. I was doing the entire scene from one vantage point. I then re-staged it, put a different lens on it and shot the same exact scene from another angle. Then I could edit it as you would a real sequence, just as if I had all the same angles I would have if I had photographed it conventionally and produced a full set of multi-angle live-action dailies.
You edit as well?
I love editing. I would operate the shot and then cut it in the Avid, instantly. All of a sudden I was able to build a sequence that had a certain photographic and editorial personality to it — it felt like there was someone quite specific shooting it.
Is that what you did for Avatar?
Yes. Cameron loves to shoot, operate and edit. He has no fear of technology. I told him what I did on Aviator and that I couldn’t afford to add the more expensive, but extremely flexible, motion capture to it. So on Avatar instead of only the camera having live pan and tilt wheels, it could also be hand-held — you could do Steadicam shots, you could do running shots, you could do hand-held things, anything you wanted, including adding a motion capture live performance by an actor. You could easily stage them, or a representation of that character, in any place or scale in the scene, because in Avatar the characters were nine feet tall. You could preview the entire movie in a very free form and analog way. Jim loved the fact he could impart his personality — the way he moves the camera, the way he frames, the way he cuts — and that the CG-created film would bear the unmistakable stamp of his distinctive live-action movies.
You used the “Avatar-way” on Jungle Book, yes?
Yes. It wasn’t until Jungle Book that I could afford the Avatar-way — a full-on stage with a lot of people to man it. I was able to take what I gave to Jim on Avatar and do it myself with the bells and whistles and some improvements that gave it a life-like sensibility of what could have been an animated film. Instead it became a live film because we used a live-action analog methodology of acquiring images and choosing which one was the right, exact moment per the cut.
The idea behind virtual cinematography is that you shoot it like you would a regular movie. All the editors, cameramen or directors who’ve never done this before are now sort of operating the way they would have if it were real. This very flavor and personality starts to rub off on the patina of the film and begins to feel like a real movie; not animated or computer generated one.
Our philosophy on Jungle Book was we would not make the computer camera do anything that a real camera could not do, so we limited the way we could move it and how fast we could move it, so it wouldn’t defy any kind of gravity. That went part and parcel with the animation and movement of the animals and the actor performing stunts that only a human can accomplish.
So you are in a sense limiting what you can do with the technology?
There was an operator behind the camera and behind the wheels, massaging and creating the various compositional choices that generally are not made in a computer. They’re not just setting keyframes, and because somebody’s behind the camera, this sense of live-action-derived movement is consistent from shot to shot to shot. It’s one person doing it, whereas normally on a CG film, there are as many as 50 people who are placing cameras on different characters within the same scene.
You have to come up with these analog methodologies that are all tied together without even really knowing it. Your choices at the end of the day end up being strictly artistic choices. We’d sort of tap into that for Jungle Book and it’s what Jim tapped into when he did Avatar. The only difference between Avatar and our film is that we set our film in an instantly recognizable place so everybody can judge whether it’s photorealistic or not.
When you start a film, do you create your own system or use something off the shelf?
With every film there is a technology advance. I typically take whatever is off-the-shelf and glue it together with something not necessarily designed to work in unison. Each year you perfect it. The only way to really keep on top of technology is by being on the forefront of it, as opposed to waiting for it to come out. Usually, we’re doing things that haven’t been done before, and invariably it causes something new and innovative.
We’re totally revamping what we did on Jungle Book to achieve the same end on my next film for Disney, but we hope to make it that much better, faster and more intuitive. We are also taking advantage of VR tools to make our job easier, more creative and faster. The faster you can create options, the more iterations you get. More iterations get you a better product sooner and help you elevate the art form by taking it to the next level.
Technology is always driven by the story. We ask ourselves what we want to achieve. What kind of shot do we want to create that creates a mood and a tone? Then once we decide what that is, we figure out what technology we need to invent, or coerce into being, to actually produce it. It’s always driven that way. For example, on Titanic, the only way I could tell that story and make these magic transitions from the Titanic to the wreck and from the wreck back to the Titanic, was by controlling the water, which was impossible. We needed to make computer-generated water that looked realistic, so we did.
CG water was a big problem back then.
But now that’s very commonplace. The water work in Jungle Book is extraordinary compared to the crudeness of what we did on Titanic, but we started on that path, and then over the years other people took over and developed it further.
Getting back to Marty Scorsese, and how you work with him. How does having his complete trust make you better at what you do?
Marty is not as interested in the technical side as Jim is. Jim loves all this stuff, and he likes to tinker and invent. Marty’s not like that. Marty likes to tinker with emotions and explore a performance editorially. His relationship with me is, “I’m not going to micro-manage you. I’m going to tell you what feeling I want to get.” It’s very much like how he would talk to an actor about what a particular scene is about. You then start using your own creativity to come up with the idea he wants, and you call on your own experience and interpretation to realize it. You are totally engaged, and the more engaged you are, the more creative you become in terms of what the director wants to tell his story. Tell me what you want, or even don’t want, and then I’ll fill in the blanks for you.
Marty is an incredible cinema master — it’s not just the performance, it’s not just the camera, it’s not just the edit, it’s all those things working in concert to create something new. His encouragement for somebody like me is to do the same and then only show him something that’s working. He can then put his own creative stamp on it as well once he sees the possibilities properly presented. If it’s good, he’s going to use it. If it’s not good, he’ll tell you why, but he won’t tell you how to if fix it. He’ll tell you why it doesn’t feel right for the scene or what would make it more eloquent. It’s a very soft, artistic push in his direction of the film. I love working with him for this very reason.
You too surround yourself with people you can trust. Can you talk about this for just a second?
I learned early on to surround myself with geniuses. You can’t be afraid of hiring people that are smarter than you are because they bring more to the party. I want to be the lowest common denominator, not the highest. I’ll start with my idea, but if someone else can do it better, I want it to be better. I can show them what I did and tell them to make it better, and they’ll go off and come up with something that maybe I wouldn’t have thought of, or the collusion between you and them creates a new gem.
When I was doing Titanic someone asked me how I did what I did. My answer was that I hired geniuses and told them what I wanted to accomplish creatively. I hire the best I can find, the smartest, and I listen. Sometimes I use it, sometimes I don’t. Sometimes the mistake of somebody literally misunderstanding what you meant delivers something that you never thought of. It’s like, “Wow, you completely misunderstood what I said, but I like that better, so we’re going to do that.”
Part and parcel of doing this is that you’re a little fearless. It’s like, “Well, that sounds good. There’s no proof to it, but we’re going to go for it,” as opposed to saying, “Well, no one has done it before so we better not try it. That’s what I learned from Cameron and Marty and Bob Zemeckis. They’re fearless.
Can you mention what you’re working on now, or no?
I’m working on Lion King.