Tag Archives: Hulu

Creating and tracking roaches for Hulu’s 11.22.63

By Randi Altman

Looking for something fun and compelling to watch while your broadcast shows are on winter break? You might want to try Hulu’s original eight-part miniseries 11.22.63, which the streaming channel released last February.

It comes with a pretty impressive pedigree — it’s based on a Stephen King novel, it’s executive produced by J.J. Abrams, it stars Oscar-nominee James Franco (127 Hours) and it’s about JFK’s assassination and includes time travel. C’mon!

The plot involves Franco’s character traveling back to 1960 in an effort to stop JFK’s assassination, but just as he makes headway, he feels the past pushing back in some dangerous, and sometimes gross, ways.

Bruce Branit

In the series pilot, Franco’s character, Jack Epping, is being chased by Kennedy’s security after he tries to sneak into a campaign rally. He ducks in a storage room to hide, but he’s already ticked off the past, which slowly serves him up a room filled with cockroaches that swarm him. The sequence is a slow build, with roaches crawling out, covering the floor and then crawling up him.

I’m not sure if Franco has a no-roach clause in his contract (I would), but in order to have control over these pests, it was best to create them digitally. This is where Bruce Branit, owner of BranitFX in Kansas City, Missouri came in. Yes, you read that right, Kansas City, and his resume is impressive. He is a frequent collaborator with Jay Worth, Bad Robot’s VFX supervisor.

So for this particular scene, BranitFX had one or two reference shots, which they used to create a roach brush via Photoshop. Once the exact look was determined regarding the amount of attacking roaches, they animated it in 3D and and composited. They then used 2D and 3D tracking tools to track Franco while the cockroaches swarmed all over him.

Let’s find out more from Bruce Branit.

How early did you get involved in that episode? How much input did you have in how it would play out?
For this show, there wasn’t a lot of lead time. I came on after shooting was done and there was a rough edit. I don’t think the edit changed a lot after we started.

What did the client want from the scene, and how did you go about accomplishing that?
VFX supervisor Jay Worth and I have worked together on a lot of shows. We’d done some roaches for an episode of Almost Human, and also I think for Fringe, so we had some similar assets and background with talking “roach.” The general description was tons of roaches crawling on James Franco.

Did you do previs?
Not really. I rendered about 10 angles of the roach we had previously worked with and made Adobe Photoshop brushes out of each frame. I used that to paint up a still of each shot to establish a baseline for size, population and general direction of the roaches in each of the 25 or so shots in the sequence.

Did you have to play with the movements a lot, or did it all just come together?
We developed a couple base roach walks and behaviors and then populated each scene with instances of that. This changed depending on whether we needed them crossing the floor, hanging on a light fixture or climbing on Franco’s suit. The roach we had used in the past was similar to what the producers on 11.22.63 had in mind. We made a few minor modifications with texture and modeling. Some of this affected the rig we’d built so a lot of the animations had to be rebuilt.

Can you talk about your process/workflow?
This sequence was shot in anamorphic and featured a constantly flashing light on the set going from dark emergency red lighting to brighter florescent lights. So I generated unsqueezed lens distortion, removed and light mitigated interim plates to pull all of our 2D and 3D tracking off of. The tracking was broken into 2D, 3D and 3D tracking by hand involving roaches on Franco’s body as he turns and swats at them in a panic. The production had taped large “Xs” on his jacket to help with this roto-tracking, but those two had to be painted out for many shots prior to the roaches reaching Franco.

The shots were tracked in Fusion Studio for 2D and SynthEyes for 3D. A few shots were also tracked in PFTrack.

The 3D roach assets were animated and rendered in NewTek LightWave. Passes for the red light and white light conditions were rendered as well as ambient show and specular passes. Although we were now using tracking plates with the 2:1 anamorphic stretch removed, a special camera was created in LightWave that was actually double the anamorphic squeeze to duplicate the vertical booked and DOF from an anamorphic lens. The final composite was completed in Blackmagic Fusion Studio using the original anamorphic plates.

What was the biggest challenge you faced working on this scene?
Understanding the anamorphic workflow was a new challenge. Luckily, I had just completed a short project of my own called Bully Mech that was shot with Lomo anamorphic lenses. So I had just recently developed some familiarity and techniques to deal with the unusual lens attributes of those lenses. Let’s just say they have a lot of character. I talked with a lot of cinematographer friends to try to understand how the lenses behaved and why they stretched the out-of-focus element vertically while the image was actually stretched the other way.

What are you working on now?
I‘ve wrapped up a small amount of work on Westworld and a handful of shots on Legends of Tomorrow. I’ve been directing some television commercials the last few months and just signed a development deal on the Bully Mech project I mentioned earlier.

We are making a sizzle reel of the short that expands the scope of the larger world and working with concept designers and a writer to flush out a feature film pitch. We should be going out with the project early next year.

Qwire’s tool for managing scoring, music licensing upped to v.2.0

Qwire, a maker of cloud-based tools for managing scoring and licensing music to picture, has launched QwireMusic 2.0, which expands the collaboration, licensing and cue sheet capabilities of QwireMusic. The tool also features a new and intuitive user interface as well as support for the Windows OS. User feedback played a role in many of the new updates, including marker import of scenes from Avid for post, Excel export functions for all forms and reports and expanded file sharing options.

QwireMusic is a suite of integrated modules that consolidates and streamlines a wide range of tasks and interactions for pros involved with music and picture across all stages of post, as well as music clearance and administration. QwireMusic was created to help facilitate collaboration among picture editors and post producers, music supervisors and clearance, composers, music editors and production studios.

Here are some highlights of the new version:
Presentations — Presentations allow music cues and songs to be shared between music providers (supervisors and composers) and their clients (picture editors, studio music departments, directors and producers. With Presentations, selected music is synced to video, where viewers can independently adjust the balance between music and dialogue, adding comments on each track. The time-saving efficiency of this tool centralizes the music sharing and review process, eliminating the need for the confusing array of QuickTimes, Web links, emails and unsecured FTP sites that sometimes accompany post production.

Real-time licensing status — QwireMusic 2.0 allows music supervisors to easily audition music, generate request letters, and share potential songs with anyone who needs to review them. When the music supervisor receives a quote approval, the picture editor and music editor are notified, and the studio music budget is updated instantly and seamlessly. In addition, problem songs can be instantly flagged. As with the original version of QwireMusic, request letters can be generated and emailed in one step with project-specific letterhead and signatures.

Electronic Cue Sheets — QwireMusic’s “visual cue sheet,” allows users to review all of the information in a cue sheet displayed alongside the final picture lock.  The cue sheet is automatically populated from data already entered in qwireMusic by the composer, music supervisor and music editor. Any errors or missing information are flagged. When the review is complete, a single button submits the cue sheet electronically to ASCAP and BMI.

QwireMusic has been used by music supervisors, composers, picture editors and music editors on over 40 productions in 2016, including Animals (HBO); Casual (Hulu); Fargo (FX); Guilt (Freeform); Harley and the Davidsons (Discovery); How to Get Away With Murder (ABC); Pitch (Fox); Shameless (Showtime); Teen Wolf (MTV); This Is Us (NBC); and Z: The Beginning of Everything (Amazon).

“Having everyone in the know on every cue ever put in a show saves a huge amount of time,” says Patrick Ward, a post producer for the shows Parenthood, The West Wing and Pure Genius. “With QwireMusic I spend about a tenth of the time that I used to disseminating cue information to different places and entities.”

The Path‘s post path to UHD

By Randi Altman

On a recent visit to the Universal Studios lot in Los Angeles, I had the pleasure of meeting the post team behind Hulu’s The Path, which stars Aaron Paul and Hugh Dancy. The show is about a cult — or as their members refer to it, a movement — that on the outside looks like do-gooders preaching peace and love, but on the inside there are some freaky goings-on.

The first time I watched The Path, I was taken with how gorgeous the picture looked, and when I heard the show was posted and delivered in UHD, I understood why.

“At the time we began to prep season one — including the pilot — Hulu had decided they would like all of their original content shows to deliver in UHD,” explains The Path producer Devin Rich. “They were in the process of upgrading their streaming service to that format so the viewers at home, who had the capability, could view this show in its highest possible quality.”

For Rich (Parenthood, American Odyssey, Deception, Ironside), the difference that UHD made to the picture was significant. “There is a noticeable difference,” he says. “For lack of better words, the look is more crisp and the colors pop. There, of course, is a larger amount of information in a UHD file, which gives us a wider range to make it look how we want it to, or at least closer to how we want it to look.”

L-R: Tauzhan Kaiser, Craig Burdick (both standing), Jacqueline LeFranc and Joe Ralston.

While he acknowledges that as a storyteller UHD “doesn’t make much of a difference” because scripts won’t change, his personal opinion is that “most viewers like to feel as if they are living within the scene rather than being a third-party to the scene.” UHD helps get them there, as does the team at NBCUniversal StudioPost, which consists of editor Jacqueline LeFranc, who focuses on the finishing, adding titles, dropping in the visual effects and making the final file; colorist Craig Budrick; lead digital technical operations specialist Joe Ralston, who focuses on workflow; and post production manager Tauzhan Kaiser.

They were all kind enough to talk to us about The Path’s path to UHD.

Have you done an UHD workflow on any other shows?
Ralston: We have a lot of shows that shoot UHD or high resolution, but The Path was our first television show that finished UHD all the way through.

What is it shot on?
Ralston: They shoot Red 3840×2160, and they also shoot 4800×2700, so almost 5K. UHD is technically twice the height and twice the width of HD, so while it’s still 16×9, resolution-wise it’s double.

From an infrastructure perspective, were you guys prepared to deal with all that data?
Ralston: Yes. At the facility here at NBCUniversal StudioPost, not only do we do TV work, but there’s remastering work — all the centennial titles, for example.

Kaiser: We we’ve done Spartacus. All Quiet on the Western Front, The Birds, Buck Privates, Dracula (1931), Frankenstein, Out of Africa, Pillow Talk, The Sting, To Kill a Mockingbird, Touch of Evil, Double Indemnity, Holiday Inn and King of Jazz.

Ralston: The infrastructure as far as storage and monitoring were already in place here. We knew that this was coming. So slowly the facility has been preparing and gearing up for it. We had been ready, but this was really the first that requested end-to-end UHD. Usually, we do a show that maybe it’s shot UHD or 5K, but they finish in HD, so when we leave the editorial room, we’re then in an HD world. In this case, we were not.

LeFranc: Joe’s group, which is digital tech ops, doesn’t really exist in other places that I know of. They develop, train and work with everybody else in the facility to develop these kind of workflows in order to get ahead of it. So we are prepared, adequately trained and aware of all the pitfalls and any other concerns there might be. That’s a great thing for us, because it’s knowledge.

Other shows have gone UHD, but some in season two, and they were playing catch up in terms of workflow.
Ralston: We’d been thinking about it for a long time. Like I said, the difference with this show, versus some of the other ones who do it is that everyone else, when it got to color, went to HD. This one, when we got to color, we stayed UHD all the way through from there on out.

So, that was really the big difference for a show like this. The big challenges for this one were — and Jacqueline can go into it a little bit more — when you get into things like titling or creating electronic titles, there’s not a lot of gear out there that does that.

Jacqueline, can you elaborate on that?
LeFranc: There were obstacles that I encountered when trying to establish the initial workflow. So, for example, the character generator that is used to create the titles has an option for outputting 4K, but after testing it I realized it wasn’t 4K. It looked like it was just up-rezed.

So I came up with a workflow where, in the character generator, we would make the title larger than we needed it to be and then size it down in Flame. Then we needed a new UHD monitor, the Sony BVMX300. The broadcast monitor didn’t work anymore, because if you want to see UHD in RGB, it has to have a quad-link output.

Craig, did your color process change at all?
Budrick: No, there wasn’t really any change for me in color. The creative process is still the creative process. The color corrector supports a higher resolution file, so it wasn’t an issue of needing new equipment or anything like that.

What systems do you use?
Budrick: We are primarily an Autodesk facility, so we use Flame, Flame Premium and Lustre for color. We also have Avids.

Can you walk us through the workflow?
Ralston: We don’t do the dailies on this project here. It’s all done in New York at Bling. We receive all the camera master files. While they do use drones and a couple of other cameras, a large percent of the show is shot on Epic Red Dragon at 3840×2160.

We get all those camera master files and load them onto our server. Then we receive an Avid bin or sequence from the client and bring that into our Avid in here and we link to those camera master files on the SAN. Once they’re linked, we then have a high-res timeline we can play through. We take the low-res offline version that they gave us and we split it — our editor goes through it and makes sure that everything’s there and matched.

Once that part is complete, we transcode that out to the Avid codec DNX-HR444, which is basically 440Mb and a UHD file that the Avid is outputting. Once we get that UHD file out of the Avid, we flip that UHD DNX-MXF file into a DPX sequence that is a UHD 3840×2160 DPX sequence. That’s where Craig would pick up on color. He would take that DPX sequence and color from there.

Craig, in terms of the look of the show, what direction were you given?
Budrick: They shoot in New York, so the DP Yaron Orbach is in New York. Because of that distance, I had a phone conversation with them to start the look of the show. Then I do a first-day pass, and then he receives the file. Then, he just gives me notes via email on each scene. Then he gets the second file, and hopefully I’m there.

Can you give me an example of a note that he has given?
Budrick: It just might be, you know, let’s add some saturation, or let’s bring this scene down. Maybe make it more moody. Bring down the walls.

Overall, as the show has gone along and the stories have developed it’s gotten a little darker and more twisted, it’s leaned more toward a moody look and not a whole lot of happy.

Ralston: Because of the distance between us and the DP, we shipped a color-calibrated Sony HD monitor to New York. We wanted to make sure that what he was looking at was an exact representation of what Craig was doing.

Jacqueline, any challenges from your perspective other than the titles and stuff?
LeFranc: Just the differences that I noticed — the render time takes a little longer, obviously, because the files are a little bigger. We have to use certain SAN volumes, because some have larger bandwidths.

Ralston: We have 13 production volumes here, and for this particular show — like the feature mastering that we do — the volume is 156TB Quantum that is tuned for 4K. So, in other words, it performs better with these larger files on it.

Did you experiment at all at the beginning?
Ralston: For the first three episodes we had a parallel workflow. Everything we did in UHD, we did in HD as well — we didn’t want the producer showing up to a screening and running into a bandwidth issue. In doing this, we realized we weren’t experiencing bandwidth issues. We kind of underestimated what our SAN could do. So, we abandoned the HD.

Do you think finishing in UHD will be the norm soon?
Ralston: We were unofficially told that this time next year we should plan on doing network shows this way.

Technicolor creates sixties soundscape for Hulu’s ‘11.22.63’

By Jennifer Walden

Beloved politician — now there’s an oxymoron. I can almost hear the collective “pffff” that term would elicit from today’s younger voters. However, voters of a certain age may remember one such president who could pull off that title: John F. Kennedy. So if you’ve had enough of this election year’s hoopla, then turn off the news channels and turn on Hulu. Their new series 11.22.63, based on a book by Stephen King, transports viewers back to the 1960s, a time when racism, sexism, domestic abuse and mistreatment of mental patients prevailed. (It wasn’t the glory days, but every generation and president has their battles… even JFK.)

11.22.63 follows the newly divorced English teacher Jake Epping (James Franco), who steps out of 2016 and into 1958 via a time portal in the utility closet of a small-town diner. His mission is to prevent the assassination of John F. Kennedy by unraveling the conspiracy theories that surround the event.

Michael Wilhoit

Michael Wilhoit

Sounds of the Sixties
Setting the stage of early ‘60s sound is supervising sound editor Michael Wilhoit, who is based at the Technicolor Sound facility on the Paramount lot in Hollywood. He got involved early, working with director Kevin Macdonald, executive producer Bridget Carpenter and associate producer Jill Risk during editorial on the pilot episode — well before the score and visual effects were created. “The sound we established in the pilot was going to be the continuing style of sound for all the episodes,” explains Wilhoit. “Jill and Bridget were the leading force for us on the whole series. They were involved in all of the sound design spotting sessions and they really wanted to have something in the track besides the score. Bridget was the one who signed off on everything for sound.”

One big decision they made early on was how to handle the time travel event. “We purposefully didn’t want to make it over the top. We wanted to include the audience without taking them out of reality and making it too sci-fi or too bold,” says Wilhoit. The time travel effect, sonically and visually, is very subtle. It’s not the earth-shattering epic thunderstorm of Terminator, for example. It’s a delicate blend of music — by composer Alex Heffes — and sound design. “We just wanted to bring the audience into this place and not lose them by overdoing our job. It’s the same for the ambiences and other sounds too. We tried not to hit people over the head. When we do our jobs right no one knows we’re here.”

The ‘60s soundscape is more mechanical and analog than modern day, with rotary phones with real metal ringers, clacking typewriters and big clunky cars — even the shoes of the day made more noise. Although the elements that make up the ambiences are louder than today’s sounds, the environments that Wilhoit and his sound effects editor, Dino Dimuro, created feel subtle and real, and they don’t draw unnecessary attention. Wilhoit and Dimuro really hit their mark without over shooting it.

Another sci-fi situation in the series involves the “past pushing back.” Whenever the characters get too close to changing the past, unexpected events cause them to fail. As with the time travel effect, the “past pushing back” effect errs on the side of realism. It was a reoccurring challenge throughout the show. Instead of designing one signature sound for the past pushing back, Wilhoit and Dimuro worked with sounds that were relevant to each situation on screen. For example, when Jake is back in 1958, he tries to call his father from a phone booth and the past pushes back. Wilhoit and Dimuro set up the uneasy feeling of the scene by adding distant dog barks, crickets and a mournful train horn as Jake approaches the booth. Once Jake is on the phone, they manipulated and distorted the voices on the other end. He and Dimuro added crackling static and high-pitched tones that interfere with the phone call; they added buzzing on the flickering lights. Out of nowhere a car races down the street and crashes into the phone booth, all of which was carefully crafted with sound.

“Because you don’t see the past pushing back you have to convey that with sound,” says Wilhoit. “My whole thing was making sounds stutter. Sound design wise I wanted there to be a stuttering of reality. I wanted there to be a dysfunctional stuttering sound.” He achieved this by editing the effects in Avid Pro Tools 11.

Matching the VFX
For several VFX-led scenes, Wilhoit and his team had to design sound without the benefit of actually seeing the visual effects. One of the early VFX-dependent scenes happens in Episode 1. Jake is hiding in a dark room in the basement of the Dallas Convention Center. It’s another situation of the past pushing back, so the lights flicker and buzz. Jake starts to hear things emerging from the shadows; it’s a swarm of cockroaches coming after him.

“I had to create a whole sound texture for these cockroaches that none of us ever saw until we were nearly done with the mix. Then at the very end we were able to make slight adjustments to make it work once the visual effects were finished,” says Wilhoit.

Another interesting VFX-dependent scene that takes place at the Dallas Convention Center is when John F. Kennedy is addressing a large audience. According to Wilhoit, that entire sequence was fabricated. “That was completely shot on greenscreen, but when you watch it you would never know because you can see and hear all of these people in this convention center. You see and hear the president up there, and that is unbelievable to me.”

JFK’s speech is an original recording that Wilhoit and dialogue/ADR editor Kimberly Ellis cleaned up using iZotope RX Advanced. There was no reverb inherent to that original track so the mixers were able to add that on the dub stage, effectively putting the speech into the 14,000-seat theater. Ellis edited the period-specific reactions in a loop group, and additional crowd sounds were added to fill in the space.

The loop group tracks were an essential element that Wilhoit used to help build a convincing early 1960’s soundscape. They added the right flavor without being over the top. “Because the show takes place mainly from 1958 into the early 1960’s, you won’t hear people say the same things that you would hear today, or hear the same reactions. The loop group sound had to be very specific in regards to the lingo of the time. For instance, they were saying things like ‘swell’ instead of ‘cool.’”

The Mix
11.22.63 was mixed in 5.1 surround on Stage 7 at Technicolor Sound on the Paramount lot by re-recording mixers Kevin Roache (sound effects/Foley) and Pete Elia (dialogue/music). Wilhoit notes that the mixers’ contributions on the dub stage went beyond balancing EQ and levels. “Kevin was able to take my effects tracks and make them that much more interesting on the dub stage. We have Pro Tools 11 and a ton of plug-ins that we all use. I make sounds and they twist them to make them even crazier. The re-recording mixers are like sound designers too. They bring everything to another level. It was definitely a collaborative effort between sound editorial and mixing.”

The season finale of 11.22.63 aired Monday, April 4 on Hulu, but all episodes are available for streaming, so binge away!

Jennifer Walden is a writer and audio engineer based in New Jersey.