“There’s a perception out there that digital effects are a black box, that it just gets shipped off and the directors are just handed this work,” Vaziri comments at one point in the video. “[That] couldn’t be further from the truth. We work directly with filmmakers to achieve their vision.”
Set during the Reign of the Empire, Beyond Victory introduces players to an original story that blends the thrilling world of podracing, a stellar cast, powerful narrative and mixed reality play. To celebrate the launch, we sat down with Beyond Victory‘s director, Jose Perez III, for an exclusive behind-the-scenes look at the creative vision, development journey and personal influences that shaped this experience.
Jose Perez III(Credit: ILM & Lucasfilm)
Let’s start with the basics, for those who haven’t heard yet, what is Star Wars: Beyond Victory – A Mixed Reality Playset and what makes it different from previous Star Wars experiences?
Star Wars: Beyond Victory is a mixed reality playset that gives you three ways to experience the fun of the Star Wars galaxy. We have Adventure mode, a short story about an up-and-coming Podracer who’s struggling with grief and the desire for fame. Then we have Arcade mode, which is a really fun, replayable experience that gives you a taste of old-school arcade games with a new mixed reality (MR) twist. And finally, we have Playset mode, where you can literally bring your favorite Star Wars toys to life, scale them up, and have them interact with each other. This is our first time experimenting with mixed reality at this scale, and we wanted to mix it up, no pun intended.
Can you tell us your role in bringing this project to life?
I am the director of Star Wars: Beyond Victory. My job was to work with all the talented artists, programmers, designers, writers, and actors to help bring this experienceto life. I get to wear a lot of different hats over the course of development, which keeps me really excited. I came up with the original story, and then worked with our writers and the story team to help flesh it out and give it texture. In this role, I assisted with casting, and I directed the performance capture and voiceover. I was there every day working with the designers, production designers, and artists to help shape the look of the experience and how it feels to move around in mixed reality or drive your Podracer. It’s one of the best jobs in the world, and I’m a very lucky person to have it.
Concept art by Evan Whitefield (Credit: ILM & Lucasfilm).
Piggybacking on that, could you describe how your core team at ILM is organized and how you work together in developing a production like this?
Our team is highly cross-disciplinary. The key roles include designers, engineers, and programmers. We have the entire ILM Art Department and a fantastic production team that helps us pull all of this stuff together. We also have marketing folks who join us, especially as we get towards the end of the project to help show our work to the public. I think how we develop it is where things get most interesting. We like to maintain a culture of kindness, but we also like to be honest when something isn’t working and do our best to make it better. It’s a very iterative, humbling, and egoless process. It’s a lot of really smart, intelligent people working together to try and make the best thing they can on the hardware that we have. We try to keep it honest so everyone should be able to say what they need to say, and we really focus on what’s on the screen — what is the best experience for our guests.
Where did the original idea for a mixed reality Star Wars playset come from? Was this always envisioned as an MR experience?
The original idea was actually a virtual reality (VR) playset for filmmakers to help them visualize and compose scenes. It was a tool I created with a few friends in the Advanced Development Group at Lucasfilm and ILM, for directors working on big Hollywood movies. We found that it was a simple, fun tool for them, and when mixed reality became a viable technology, we knew it could be a cool experience that would easily translate to digital action figures.
Can you tell us about why you decided to make the podracing in this experience something that’s top-down on a holotable in third-person vs. a first-person POV?
It’s not truly ‘top-down’ as much as it is a 3D diorama when you’re standing next to it. It was definitely a conscious choice to make it third-person to fit into what we were trying to do here, which is pushing the boundaries of mixed reality. Early on, we knew we wanted to lean into the “Toy” vibe of the Playset and do something unique with the technology. This approach felt like the natural way to achieve that. I’m a big fan of 1980s retro games, so for me, this was about taking those classic arcade concepts and adding a whole new dimension.
Concept art by Casey Straka.(Credit: ILM & Lucasfilm)
How did you balance innovation with staying true to the Star Wars legacy and canon?
I’m a huge Star Wars fan, so I love working within the established canon. Our innovation came from the way we approached storytelling. This isn’t a galaxy-spanning event; it’s a smaller, personal story. Telling a story in mixed reality is hard, and we made some big choices, like letting the camera cut to express the narrative while you’re looking at miniatures. The key was to balance this innovation with ensuring all the characters and the world fit seamlessly within the broader Star Wars galaxy.
Were there any particular Star Wars films, shows or eras that inspired the tone and style of this experience?
The main inspiration was definitely The Phantom Menace [1999] and the podracing scene. Beyond that, we used the Star Wars galaxy as a palette to tell stories that were interesting to us and that would deepen the world.
Can you explain how you landed on the three distinct modes? How do you balance development for them all since they’re all so different?
We settled on three modes to offer players a variety of experiences. Adventure mode is for those who want a guided story, while Arcade is for replayability and pure fun. Playset is the ultimate sandbox for creativity. The three modes mirror how I experienced Star Wars as a kid: I’d go see the movie (story), hit up the arcade afterward to play the latest Star Wars game, and then go home to play with my toys. This is just a way of bringing a modern version of that nostalgic experience to people today. Balancing development was a challenge because they are so different, but we approached each one as its own mini-project while maintaining a consistent visual style and user interface across all three. This allowed our teams to focus on the unique requirements of each mode without starting from scratch every time.
Concept art by Chris Voy (Credit: ILM & Lucasfilm).
Mixed reality is still new to a lot of fans. How did you approach that, especially for younger players or those new to immersive tech?
Mixed reality is definitely new, and that’s actually really exciting for us. One of the things we love to do here at ILM is really push on new technologies, so it’s a joy to work with Meta and continue to push the boundaries of mixed reality, virtual reality, and, hopefully in the future, augmented reality. For this experience, we knew we had to make it intuitive and accessible. We treat every one of our experiences like it’s the first time someone has ever put on a headset, and this was no different. Making it accessible and user-friendly is something we always come back to; we want to politely walk you through the experience and ensure it’s enjoyable in the most delightful way possible.
Was there a moment during development that made you feel, “This is it. This is Star Wars.”?
Anytime you work on a Star Wars project with ILM and Lucasfilm, you’re going to have those moments. For this one, a couple of moments stand out, especially during the voice recording sessions. Hearing Greg Proops doing the voice for Fode, or Lewis MacLeod voicing Sebulba — it felt like we were right there, talking to those characters! Those performances and the incredible vibe they brought were instantly recognizable. The score was done by Joe Trapanese and Clark Rhee, and what was so awesome about them doing it is that they brought their own unique vibe to the music. We were also able to include some of composer John Williams’ music, and when you mix that in with the new score, you get a fresh, new version of Star Wars that is still very much Star Wars. It’s very exciting.
The audio in this experience is exceptional. Can you talk about what it was like working with Skywalker Sound on Beyond Victory?
Working with the team at Skywalker Sound is always an amazing experience — I’ve been collaborating with them for over a decade now, and they just always bring the heat. They are masters of their craft. It was a true collaboration; they didn’t just provide us with sounds — they worked with us to build a rich, immersive soundscape that elevates the entire experience. They have an incredible library of assets they can pull from across all the films and animated shows. The audio they created for the Podracing alone makes the experience so much more beefy and visceral. Additionally, Kevin Bolin, who is one of the main audio supervisors, provided a lot of great suggestions and even co-directed a couple of parts of this experience. They are truly the best.
(Credit: ILM & Lucasfilm).
Speaking of sound, let’s talk about the cast of Beyond Victory. What was it like working with such a stellar cast? Were they only involved in the voiceover or did any also do motion capture work?
We are always fortunate to get an amazing cast of voice actors, and this was no different. Between Greg Proops, Fin Argus, Lewis MacLeod, as well as Lilimar Hernandez and Bobby Moynihan — we just had such a great time. One of the things that was so fun is that we actually did a full performance capture for this. The audio that you hear was captured at the same time as they were doing the mocap, so it was super fun to see Greg Proops, Bobby Moynihan, Fin Argus, and all these people in the same room collaborating to bring this to life. They all did such an amazing job and they really elevated the entire experience.
And that’s not even counting the loop group! At Skywalker Sound, we have a loop group of great voice actors who come together to help fill in the world, doing a bunch of background voices and stormtrooper voices. They always do such an amazing job and have worked on the cartoons and films, which brings an authentic Star Wars feel because you’re hearing voices familiar from other Star Wars stories as well. Yes, we had an amazing cast.
I felt like I was reliving my childhood while playing in Playset mode. Were you a fan of the toys growing up and was the intention of Playset to bring some of that nostalgia to life?
Oh yeah, I was a huge fan of Star Wars toys growing up and I’m a huge fan of Star Wars toys now. When I was a kid, I had a bunch of different ones — I had the Ewok Village, I had the Millennium Falcon for a little bit. One of my saddest memories is when I was heading into fourth grade and I gave all my Star Wars toys to Goodwill because I thought I was too old for them, and I immediately regretted it afterwards. It feels like I’ve spent my whole life trying to rebuild that collection! So, this is probably me just tapping into some childhood trauma and trying to bring some of that back [laughs]. Today, my office is full of Star Wars toys.
This must have been a massive cross-disciplinary effort. Can you talk a bit about the collaboration between designers, engineers, writers and the teams at Lucasfilm & Skywalker Sound?
It is a real undertaking. We have a lot of really smart people with a lot of opinions, and getting everybody onto the same page and making sure that we’re working on something we are all proud of is hard to pull off, but I think we did a really good job. Our production team is a big part of that, making sure that all the different disciplines are talking and coming together for the proper meetings. It is a massive cross-disciplinary effort, not just within the people working on Beyond Victory, but you have to remember that we need to fit into the entire Star Wars galaxy. So, we have to be cognizant of all the other projects going on and make sure we fit in that world, too, without breaking canon. A lot of work goes into pulling all of this together, and a great team and production process made it all happen.
(Credit: ILM & Lucasfilm).
We absolutely love seeing Star Wars comics character Grakkus the Hutt in this. Without getting too spoiler-y, is there a moment in this experience that you think fans are especially going to love? Something that will make them pause and smile?
Hopefully there are a couple of moments like that! Grakkus the Hutt is amazing. He was awesome in the comic books, and we just knew we had to bring him into this experience — he’s just too cool. I can’t wait for people to see him in all his glory when he’s standing above you; he’s literally like 12 feet tall! But I think for me, the real moment was getting to see Sebulba in person. Watching him walk around, just seeing the creature that Sebulba is — for me, as someone who loves The Phantom Menace and the prequels so much, it was really cool. It definitely brought me a lot of nostalgia.
ILM celebrates its 50th anniversary this year, and interactive experiences have continued to play an important role in ILM’s diverse range of storytelling. How does Beyond Victory help carry this interactive legacy forward?
It’s incredible to be celebrating our 50th anniversary this year. We’ve done a lot of interactive work through Lucasfilm and ILM, but Beyond Victory marks a new step for us. We’re breaking technological ground by pioneering at this scale in mixed reality. It also, in an unusual way, echoes our early film history, when we were working with miniatures and seeing the world through that lens. As far as carrying our interactive legacy forward, I hope that people see this project as a successful push into new territory. This is the first mixed reality Star Wars project with a full, integrated experience — a cohesive story, an arcade mode, and a customizable playset. At the heart of this, like all ILM projects, is really the story, and I hope people really appreciate it and that these characters can go forward into the galaxy. We’re always trying to do something different, and we hope the community appreciates this push.
Any final message you’d like to share with ILM.com’s readers?
Thank you to the entire Star Wars and ILM fan community. We’re thrilled by the love we’ve received as we explore new realms like mixed reality. We couldn’t do this without you!
Concept art by Stephen Zavala (Credit: ILM & Lucasfilm).
Industrial Light & Magic has unveiled a new trailer and key art for the podracing adventure that’s coming this fall.
Industrial Light & Magic and Lucasfilm announced today that Star Wars: Beyond Victory – A Mixed Reality Playset, the next groundbreaking entry in interactive Star Wars storytelling, will launch on October 7, 2025, exclusively for Meta Quest 3 & 3S headsets.
“This experience is designed to celebrate storytelling, action, imagination and everything we love about Star Wars,” said director Jose Perez III. “We wanted to give players a new way to step inside the galaxy and make it their own.”
ILM’s Mohen Leo and Scott Pritchard and Lucasfilm’s TJ Falls are among the winners for “Outstanding Special Visual Effects in a Season or a Movie.”
The team from Andor pose in the press room with the award for outstanding special visual effects in a season or a movie during night one of the Creative Arts Emmy Awards on Saturday, Sept. 6, 2025, in Los Angeles. (Credit: Richard Shotwell/Invision/AP)
The 2025 Creative Arts Emmy Awards took place on September 6, and Lucasfilm’s Andorseries took home four wins, including “Outstanding Special Visual Effects in a Season or a Movie.” Industrial Light & Magic’s Mohen Leo – who served as Andor‘s production visual effects supervisor – took home the award along with ILM visual effects supervisor Scott Pritchard and Lucasfilm’s visual effects producer TJ Falls.
The other Emmy recipients for “Outstanding Special Visual Effects in a Season or a Movie” include special effects supervisor Luke Murphy, special creature effects lead Neal Scanlan, Hybride visual effects supervisor Joseph Kasparian, Scanline visual effects supervisor Sue Rowe, In-House visual effects supervisor Paolo D’Arco, and digital colorist Jean-Clément Soret.
ILM’s Mohen Leo, production visual effects supervisor of Andor, attends the Governors Gala at the 2025 Creative Arts Emmy Awards (Credit: Invision/AP).
—
Lucasfilm announces the full cast for the Star Wars feature directed by Shawn Levy and coming to theaters in May, 2027.
Ryan Gosling (left) and Flynn Gray on set for Star Wars: Starfighter (Credit: Lucasfilm & Ed Miller).
Production of Star Wars: Starfighteris officially underway with a newly-revealed cast alongside Ryan Gosling that includes Flynn Gray, Matt Smith, Mia Goth, Aaron Pierre, Simon Bird, Jamael Westman, Daniel Ings, and Amy Adams.
“To join this storytelling galaxy with such brilliant collaborators onscreen and off, is the thrill of a lifetime,” director Shawn Levy told StarWars.com. Levy joins Lucasfilm president Kathleen Kennedy as producer on Starfighter, with a screenplay by Jonathan Tropper.
Learn the inspiring story of a group of dedicated ILM and Lucasfilm employees who turned their dreams into a reality….
By Lucas O. Seastrom
“It is a period of intrigue,” begins the opening text crawl of a little-known Star Wars story. “Imperial outposts scattered across the galaxy search for signs of the fledgling rebellion. Intrepid rebel agents have infiltrated the Empire’s Logistics, Deployment, and Allotment Center – LDAC – on planet Yerbana. From the heart of this Imperial base, the rebels have carved out a secret outpost to monitor enemy activity, contact other rebels, and recharge all the while avoiding the eyes of the Empire….”
No, it’s not an outline for a future Star Wars movie. It is, in fact, a playful backstory imagined by a passionate group of Industrial Light & Magic and Lucasfilm employees to contextualize a unique gathering place deep within the company’s San Francisco headquarters.
Not far from ILM’s performance capture stage and IT department, a massive, Imperial propaganda poster hangs on the wall.
Careful observers may discover that the poster is, in fact, a door. A gentle nudge to the left reveals a secret hideout straight from a galaxy far, far away…
(Credit: ILM).
The “Rebel Hideout,” as it is formally known, is presented as a makeshift refuge for hidden operatives, tucked away inside an Imperial base (its acronym, LDAC, “coincidentally” the same as the former name of Lucasfilm’s headquarters, Letterman Digital Arts Center). Pieces of furniture, equipment, and technology from across the galaxy have been requisitioned and adapted into the relatively cozy space. At times, sirens blare a warning, or the roar of a spaceship’s engines is heard overhead. Monitors allow the rebels to spy on Imperial activities, all the while enjoying a well-stocked snack bar and most impressive music system (the room even sports a “disco mode”).
The result of more than a decade of committed planning and effort from a passionate group of employees, the Rebel Hideout is a homemade lounge designed specifically as a fun-filled gathering place. “The fact that this is employee-created is the most joyous part of the entire thing,” notes staff R&D engineer Mike Jutan, one of the project’s originators.
“We’re not bragging about this room,” adds ILM’s head of CG, Michael DiComo, another project lead. “We are as amazed as anyone. How in the world did it get this good? We had dreams, and we’re so happy to be part of it, but we couldn’t have guessed it would be this great because everyone went so over the top. It’s the ILM spirit of everyone collaborating, doing more, and asking, ‘What do you need me to do?’”
The story of the Hideout’s creation has as many twists and turns, trials and triumphs, as any Star Wars movie….
The Early Concepts
Before joining ILM in 2007, Mike Jutan interned at Pixar Animation Studios, just across San Francisco Bay in Emeryville. The company was already well-known for its playful, collaborative culture in a space designed for casual interactions between employees. Its campus even featured “secret” lounge areas, often with elaborate theming, including one located inside a compact air duct only accessible via a crawl space.
“At Pixar they talk about the central atrium in the building,” Jutan tells ILM.com, “and how Steve Jobs designed the space with the bathrooms in the center of the building so that everyone has to cross paths with each other, and when you do, you strike up random conversations. Just the idea of artists and engineers unintentionally crossing paths was really captivating to me.”
Arriving at ILM’s San Francisco office, an enthusiastic Jutan was eager to help introduce more of these like-minded spaces at the Letterman campus. It was a poignant vision, considering that Pixar had originally took inspiration from ILM’s former home at the Kerner facility in nearby San Rafael, where the Lucasfilm Computer Division (from which Pixar spun off in 1986) was once fully integrated within the visual effects company’s stimulating, creative work setting, where casual “hallway meetings,” employee band performances, and Friday afternoon “ergo parties” were regular occurrences.
An early concept for an employee lounge by Chris Bonura took on a fully Imperial theme (Credit: ILM & Chris Bonura).
“It all started when we asked for $50.00 to retouch the pool cues,” Jutan reflects with a laugh. Pool tables were one amenity in what he describes as a “multipurpose room” that existed on the Letterman campus, where employees often played games, relaxed, or held art classes. Jutan wanted to find ways to improve the space with specific theming.
By 2013, a small group of ILMers, including Jutan and DiComo, had originated a concept for a Star Wars lounge designed to evoke the Mos Eisley Cantina. An early proposal detailed a space that “represents our company personality” and facilitated “casual, collaborative conversation.” They were soon meeting with Lynwen Brennan, then ILM’s general manager and today Lucasfilm’s president and general manager. “We explained a concept where we could scrounge together some different items to make a little lounge space,” recalls DiComo. “And she told us, ‘No, dream big. How great could this be?’”
The group broadened their ambitions. Current day real-time principal creative Landis Fields produced a digital walkthrough of an elaborate space that felt like an immersive, Star Wars movie set. Soon they organized a lunchtime event with over 100 employees to introduce the concept, exchange ideas, and recruit volunteers to help create it. “This was going to be a crowd-sourced, employee-driven project,” as DiComo notes. New contributors, like senior R&D engineer David Hirschfield, became involved at this stage.
Stay on Target
Over a period of more than five years, the cantina lounge concept was met with enthusiasm but was ultimately delayed. Availability of time, resources, and an adequate space shifted repeatedly due to business priorities. Then the global pandemic changed not only the prospects of building such a lounge, but the entire landscape of collaborative work in general.
The concept might’ve been abandoned during such a transformative period. But in the wake of the pandemic, the small group that had envisioned the cantina became only more committed to finding a way to bring people back together in person, and ILM and Lucasfilm’s leadership took notice. With new plans to renovate the San Francisco workspace, the lounge team was given a dedicated room and a small budget to build something new.
“Lynwen and the Lucasfilm leadership team were kind enough to help us do it,” Jutan explains. “We were prepared to rally the troops and have everyone there to make it happen. Our chance finally came, and we were going to take full advantage of it. We spun up again as if nothing had ever paused.”
With the new opportunity came a new concept for another type of Star Wars setting. A “hidden room” was discussed, and once again, Landis Fields created a digital walkthrough. From outside, a bookcase full of Imperial volumes and trinkets hid a small, sliding window where a Rebel inside ensured you were clear to enter. The case then moved across the wall to reveal a space that greatly resembled the ultimate creation.
Members of the team and special guests Tom Spina (center) and friends visit the space early in development (Credit: ILM).
“Landis sort of kit-bashed all of these different Star Wars ideas into the design to see what might be possible,” DiComo recalls. The group shifted from an explicit speakeasy concept to something more inclusive. “This is a place where you can come get coffee, take a quick break, have a meeting, enjoy some music, read a book, or sit around and work on your laptop,” notes Jutan. “There’s no ‘one size fits all.’ People want different things out of a space like this, but the common thread is bringing people together.”
By 2023, production manager Julie Stallone had joined the team as project producer, handling daily logistical needs, coordinating a schedule, and ensuring the team stayed on budget. They proceeded with an initial plan to construct some furniture and design elements on their own and collect licensed prop replicas and toys to provide accents. They would also partner with an independent replica maker, Tom Spina, for additional features. But a fortunate surprise caused yet another change of course.
From the Set to the Hideout
Learning about the Hideout project, Lucasfilm archivist Portia Fontes contacted the team offering use of a number of screen-used props and set pieces from recent productions, including Rogue One: A Star Wars Story (2016), Solo: A Star Wars Story (2018), Star Wars: The Rise of Skywalker (2019), and Andor (2022-25). The group’s response was a collective “WHAT?!” “We could never have built anything as amazing as these set pieces with the time and budget available,” says DiComo.
Fontes collaborated with Colin Merchant, a member of the Andor Props Department in England, to curate a selection of pieces. Soon after, senior producer John Harper and the Lucasfilm Online team offered additional, custom-made furniture from their livestream stage at a recent Star Wars Celebration, as well as additional screen-used props from Star Wars productions. “It was another spit-take moment,” as Jutan quips.
Mike Jutan (standing) and David Hirschfield inspect original props from a Star Wars production (Credit: ILM).
These developments would define the Rebel Hideout’s ultimate design and layout. Lucasfilm director of franchise content and strategy, Pablo Hidalgo, helped the group refine the room’s specific context within the Star Wars storyline, ultimately writing the Hideout’s “opening crawl” and related notes.
“When we realized that we had all sorts of different props available to us, having a specific story structure helped limit what items we would use,” Hidalgo explains. “Some things fit the story, and some didn’t. From there, we built out the story that fit the context of this room and aligned with the characteristics of being rebels. It’s in the classic trilogy era, with the Rebellion and Empire. We also use some sequel trilogy props from the Resistance and First Order if they have a timeless character to them.”
A group, including Jutan, Hirschfield, and Hidalgo, reviewed prop lists and visited an off-site storage facility to consider their options. They chose everything from a Hammerhead Corvette pilot’s chair seen in Rogue One to an Imperial security camera from Andor. Other set pieces included Babu Frik’s work table and part of a Star Destroyer workstation, both from The Rise of Skywalker, a tactical screen divider from the Yavin 4 base in Rogue One, and wall panels from the Aldhani garrison in Andor.
A major discovery was the Millennium Falcon’s own tech station as seen in its original form when Lando Calrissian (Donald Glover) owned the ship in Solo. “As soon as we found the console, it just looked incredible, and it wasn’t even lit up yet,” recalls Hirschfield. “I was smitten. It was pretty big, but we had to use it.” Some balked at the size, wondering how it could fit into the already tight space, but Hirschfield insisted, suggesting it could be outfitted as a control for different room functions.
The tech station from the Millennium Falcon as it appeared in Solo: A Star Wars Story (2018) (Credit: ILM).
“An Integration Challenge”
The team created a top-down rendering of the room with accurately-scaled pieces for furniture and components, which Jutan and Hirschfield call “dollhousing.” Space was key, both in terms of packing in as many authentic details as possible and for maintaining appropriate room for access and flow. Some items, like a giant vaporator, were cut during this phase due to limitations.
“We liked the basic layout, but it still looked like a conference room where we were stashing Star Wars stuff,” recalls DiComo. “How do we make it look like an actual Star Wars room? It became an integration challenge. We needed to make everything fit into the room and look as if it had always been there. We’d use tubes, hoses, weathering, grime, and greeblies on the wall to help blend it together. We moved the panels into place; the couch didn’t fit, so we cut the back off; we turned one of the radar screens on its side to help separate the rooms; and then that allowed room for the Millennium Falcon station.”
Michael DiComo (right) and David Hirschfield move licensed prop replicas donated by Lucasfilm’s licensing team (Credit: ILM).Rebecca Forth at work restoring a screen-used prop (Credit: ILM).
The couch was a former Star Wars Celebration prop, designed to look like a kyber crystal crate as seen in Rogue One. As they prepared to cut off the detailed back portion to allow it to sit flush with the wall, DiComo had an idea. “I thought, ‘We can’t get rid of the back part of this couch!!’” he explains. “It had giant hinges on it and an awesome shape and Star Wars greeblies all over it. So I suggested that we mount it on the wall in the kitchen, almost like it was this waste retrieval or energy storage system. All of the tubes and hoses go inside it. What would’ve been scrap became this amazing piece on the wall.”
By this stage, Kyle Johnson, a former workplace services specialist with Lucasfilm, had become an integral member of the team, whom they call their “secret weapon.” An experienced craftsman, designer, and set builder, Johnson took the lead in rebuilding, fabricating, and installing a number of details throughout the room, not least of which included a massive Imperial archway that forms a key focal point, helping to break up the standard 90-degree angles in the space.
“We had to make everything actually work together in the room where people could sit on something, bump into something, or push the buttons on something,” Johnson says. “How do we cut everything down to make it fit well in the space? Doing traditional set work, you can position things all over the place so long as it looks good in the shot. With this, you have to make it work with a purpose that fits in with the rest of the room, and it has to look really good.”
The Hideout’s entryway, custom-designed and built by Kyle Johnson (Credit: ILM).Panel sections under construction in the facility’s workshop. (Credit: ILM).
Johnson also developed the Hideout’s entryway. The original bookcase concept was adapted into a sliding door concealed as an Imperial propaganda poster, which Johnson designed in collaboration with Hidalgo, concept artist Katarina Kushin, and the Lucasfilm Art Department. The poster slides open to reveal a custom-made Imperial doorway. “You get the feeling like you’re entering another place, not just going through a door,” Johnson notes. “It’s 18 inches deep with lights on the side. You’re moving through a narrow tunnel, almost.”
Bringing the Room to Life
Another critical step in creating the Hideout was building and installing an electronic system to run lighting, sound, and video. Members of the ILM Electronics Club would take the lead for a number of these tasks, including systems engineer Trent Bateman and layout supervisor Tim Dobbert.
“My first project was helping to get the Millennium Falcon console online,” says Bateman. “Tim and I came in to figure out how to get the lights to simply work. We tried lots of different methods and couldn’t figure it out. Tim suggested that maybe these props were wired differently because they were made in the United Kingdom. So then we got it to light up, and we determined what the right voltages were. From there, we had to figure out how to make everything work. We developed several iterations of the circuit boards to find the best way to light everything without blowing the circuits or frying the micro-controllers. We had to build a network so that everything could talk to each other. That took about two months. Once that was in place, we replicated and grew the system across the entire room.”
An example of the custom circuit boards (both front and back) designed by Trent Bateman and Tim Dobbert for the Hideout (Credit: ILM).
Head of the Visual Effects Editorial Department for ILM’s San Francisco and Vancouver studios, Lorelei David, had joined the Electronics Club with no prior experience in the field. Mentored by her colleagues, she joined the Hideout team to help lead the hardware creation.
“Trent had the micro-controllers, and he designed these beautiful, custom circuit boards,” David says. “We realized it needed a lot of soldering, more than we could do on our own. That’s when we decided to have a ‘soldering party’ in a big conference room at the office. We invited anyone in the company who wanted to learn. We provided instructions, references on a screen, and examples for them to look at. It was a great opportunity to meet a bunch of people from across the company.”
Employees gather for a “soldering party” to help create the many circuit boards needed throughout the Hideout (Credit: ILM).
Media systems engineer Paul DeBaun, R&D principal engineer and architect Nick Rasmussen, and former AV design engineer Greg St. Germain took the lead on the audio and video systems, equipping iPads throughout the room to run everything from graphic displays to location views to static (all authentically sourced from Star Wars films). In addition to ship flybys and music features, the Hideout also includes a standard ambient soundtrack with various technological effects.
“We built a 10-channel speaker system out of old parts that we had on hand, including two subwoofers,” DeBaun notes. “We ran the wiring for the system throughout the ceiling and used QLab to run everything. We also worked on the dimmer packs for the lighting. There are about 36 channels of adjustable lighting patterns throughout the room.” Hirschfield adds, “We were perfectly willing to beg and borrow as much as we could. We had a budget, but we also kept finding these opportunities to adapt existing tools to make the room better.”
It’s All in the Details
Senior lighting artist Rebecca Forth had been leading set decoration since the beginning of the year, and now her sub-group worked to paint and detail props out in the hallway. “For me, this project felt similar to what it must’ve felt like to work in the ILM Model Shop back in the day,” Forth comments. “It felt like this was the closest I’d ever get to that tactile experience of putting your hands on everything, and making little mistakes that actually turn into a great feature. It was about having everyone together and trying to figure out how things would function.”
One of the last major steps for integrating details in the room involved a weekend visit from Robb De Nicola, Patrick Louie, and Max Frey from the Tom Spina Designs crew. They brought their expertise in custom design, painting, and weathering to help boost the team on their final push.
The crew at work installing set pieces, electronics, and other features (Credit: ILM).
Among the dozens of minute tasks the Spina artists performed was taking a snowtrooper helmet (one of many replica props donated by Lucasfilm’s licensing team) and aging it. “They spent maybe 30 minutes and came back with this snowtrooper helmet and had a wampa slash across the face, it was painted and weathered with dirt,” Jutan says. “Their skill was nuts.” Throughout their visit, they assisted the Hideout team in mining their leftover set pieces for greeblies and details that could be adapted into features for the room. “The lesson from that is we can use anything,” says DiComo. “If you mix things together the right way, it has that Rebel, scavenged vibe.”
“For the most part, we wanted to restore each item to look as it did on screen, as well as give it a longer life,” Forth explains about the many screen-used props incorporated into the room. “Many of these were built to last for the length of the shoot. One of the tougher projects was the pilot’s chair from Rogue One. There were some wooden pieces that had shattered, which we had to carefully glue back together. The cushions had been adhered with glue tape that was disintegrating, so we put in new velcro strips that could last much longer. The headrest had some missing hardware that needed to attach it to the base.
“We didn’t want to remove any intentional dirt or weathering from the items,” Forth continues. “This stuff had been in storage, so it had some real dirt and dust, but then it also had intentional dirt. You had to be really careful when you were cleaning so that you didn’t take that off. It was about restoring the piece and keeping intact the initial intention and craft of the artist who’d put it together.”
An example of the weathering detail applied throughout the Hideout (Credit: ILM).An original pilot’s chair from the Hammerhead Corvette that appeared in Rogue One: A Star Wars Story (2016). Its restoration was led by Rebecca Forth (Credit: ILM).
Practically everything, save one Andor piece dubbed “Admiral Snackbar” by the team, required extensive reconstruction or modification. “It’s all MDF [medium-density fibreboard] and staples,” notes Johnson. “There were a lot of weird structural requirements involved to make things durable and functional. We had to tear stuff apart and reframe it to support more weight.”
An entirely original piece in the Hideout was an industrial-style fan in the ceiling, an idea that dated all the way back to Field’s original safehouse concept. “I really wanted to make sure that something was moving,” says DeBaun. “Most everything in the room is still, except for the fan.” Using a fan acquired by Hirschfield and a cover made by Johnson, DeBaun mechanized the piece to spin gently, adding tubing and related detail inside the fan’s housing. As an accompaniment, he went to even greater lengths to create a self-described “impossible shadow” on the floor.
“We can’t physically make that shadow in the space because of the height of the ceiling,” DeBaun explains. “So we project the shadow to spin in time with the fan’s rotation position so that it matches.” The result is a subtle but poignant accent that pulls the room’s many details together in a believable way. “It has a lot of capability to tell a story,” DeBaun notes, who hopes to incorporate a new passing shadow effect within the year. “No one talked about doing all of that,” adds DiComo. “Paul just dreamed it up and did it. A rudimentary sketch became this unbelievable thing.”
The rotating industrial fan and its projected “impossible shadow” effect (right) were chiefly created by Paul DeBaun (Credit: ILM).
The Hideout team also knew that they wanted a unique insignia for their space, another project that Johnson took the lead on, working with associate producer Michelle Thieme, executive design director Doug Chiang, and other members of the Lucasfilm Art Department. Inspired by the shape and silhouette of the iconic Yoda Fountain at the entrance to the Letterman campus, Johnson describes it as “our signet,” in reference to the icons used by characters in The Mandalorian (2019-23). (Jennifer Foley, manager of Lucasfilm’s Company Store, even ensured that special crew shirts would be available for the team within a matter of days.)
The Rebel Hideout’s emblem (Credit: ILM).
The Circle is Now Complete
Over weekends, late nights, and even the morning of the Hideout’s debut, the team worked tirelessly to complete the room. After many unexpected challenges and a massive amount of work – all accomplished in addition to the team’s regular day jobs – the Hideout’s opening in May 2024 was a resounding success. Since then, it’s hosted not only casual meetings and hangouts for employees, but interviews, portrait shoots, family tours, and parties. “Sometimes parents are more excited to see the Hideout than kids are,” says David with a laugh. “On one tour, we had a group of kids, and they were running all over, pushing all of the buttons. It was a good way of testing out the room’s durability.”
(Credit: ILM).
“We don’t want this to feel like a museum where you can look but not touch,” Bateman adds, explaining various updates that continue to be incorporated into the room. “We want visitors to feel like they are actually in Star Wars, and that means allowing them to not only play with the props, but for the props to play back. To that end, we’ve worked together to come up with various Easter eggs throughout the room (like a ‘Red Alert’ siren and ‘Disco Mode’), as well as more involved additions like a ‘Rebel DJ’ activity where guests can use switches on the Millennium Falcon console to compose music.” Updates and revisions have continued, and have even inspired ideas for entirely new themed rooms.
Employees gather during the Hideout’s unveiling in May of 2024 (Credit: ILM).
Channeling the spirit of ILM’s fun-infused, creative culture that has endured for half a century, the Rebel Hideout is a full-circle achievement, maintaining the company’s storied identity in a brand-new way. “‘Ego-less collaboration’ is the phrase we use all the time,” DiComo adds. “It’s who we are. When you have something special like the Hideout, it amplifies the whole feeling. This is why I’ve been here for 30 years – the spirit of these people.”
“This has been like an old-fashioned barn-raising,” Jutan concludes. “Everyone pulls together to create something that’s much more amazing than its individual parts. It’s like every movie and visual effect that we make. One of the first times we toured [Lucasfilm senior vice president of creative innovation, digital production and technology] Rob Bredow through the room, he said that the project was done purely in ILM’s style: If a project is worth doing, it’s worth over-doing.”
(Credit: ILM.com).
—
Lucas O. Seastrom is the editor of ILM.com, Skysound.com, and a contributing writer and historian for Lucasfilm.
Celebrating Ten Years of Immersive Entertainment at ILM
By Amy Richau
“ILM Evolutions” is an ILM.com exclusive series exploring a range of visual effects disciplines and highlights from Industrial Light & Magic’s 50 years of innovative storytelling.
In immersive stories, the fan is the hero.
Industrial Light & Magic (ILM) has always been at the forefront of innovation, drawing audiences into new worlds by pushing technological boundaries. As part of our special series, “ILM Evolutions,” ILM.com talked with Vicki Dobbs Beck (vice president, immersive content innovation), Julie Peng (director of production), Tim Alexander (visual design director), Ben Snow (senior visual effects supervisor), and Shereif Fattouh (executive producer) about the past, present, and future of ILM’s immersive storytelling.
ILM’s LiveCGX team, including visual effects supervisor Mohen Leo (bottom).
A New Way to Tell Stories
“Let’s invite our fans to step inside our stories in ways that had never before been possible.”
– Vicki Dobbs Beck
While ILMxLAB was formally established in 2015 to explore the possibilities of immersive storytelling, the seeds of this endeavor actually began much earlier for Vicki Dobbs Beck. In the 1990s, Beck worked at Lucasfilm Learning, where a certain prototype caught her attention. “It was called Paul Parkranger and the Mystery of the Disappearing Ducks,” Beck tells ILM.com. “And what was really cool about all of the projects we were doing at that time is they really did sit at the intersection of storytelling, interactivity, and high-fidelity media – such that it was back then – all through an educational lens.”
Fast-forward to Beck’s time at ILM as head of strategic planning, she started bringing together talent from ILM and LucasArts (now Lucasfilm Games). “It was kind of this little rebel unit that was doing some pioneering R&D [research and development] in high-fidelity, real-time graphics,” says Beck. “Their success gave us confidence that the foundation was in place to build an immersive storytelling studio, expanding on the R&D work done by teams like the Lucasfilm Advanced Development Group (ADG).”
In 2015, ILM and Lucasfilm announced the formation of ILM’s Experience Lab (ILMxLAB) – a new division that would combine the talents of Lucasfilm, ILM, and Skywalker Sound. Lynwen Brennan, then Lucasfilm executive vice president and ILM president, announced that “The combination of ILM, Skywalker Sound, and Lucasfilm’s story group is unique and that creative collaboration will lead to captivating immersive experiences in the Star Wars universe and beyond. ILMxLAB brings together an incredible group of creatives and technologists together to push the boundaries and explore new ways to tell stories. We have a long history of collaborating with the most visionary filmmakers and storytellers, and we look forward to continuing these partnerships in this exciting space.”
The Holocinema team.
From its inception, a studio telling immersive stories with emerging technology platforms made ILMxLAB an appealing destination. Julie Peng, who worked in Lucasfilm Animation as a production manager for projects like Star Wars: The Clone Wars (2008-13) and Strange Magic (2015), was looking to break into the emerging interactive storytelling space when she received a call about a new ILM division that would focus on technology like augmented and virtual reality. “When we started, we were five people,” remembers Peng. “I did my best to take care of any need that arose, big and small, from developing the production infrastructure to writing job descriptions, to ordering pizza and running to the store for batteries. It was about doing whatever was needed to build a team and start exploring what we could bring to the immersive entertainment space.”
In 2016, the studio debuted its first VR experience, Star Wars: Trials on Tatooine, where the Millennium Falcon lands in front of players, and they help R2-D2 and Han Solo with repairs. This was an important step in the studio’s goal of creating a living world. “Everybody was just so blown away by the scale,” says Beck, “because that’s something that VR is so good at – delivering scope and scale.”
Looking to the future was also always a part of the plan. “Because we were so early in the whole immersive storytelling space, we really wanted to help drive the industry,” says Beck. “So we actually very consciously shared our prototypes in public. We spoke about them. We made them available to people because we wanted to actively inspire others to create in this space alongside us.”
Over time, the team evolved into a mix of creatives from the film industry and people with backgrounds in games and interactive development. While bringing in developers with both backgrounds was essential, it also brought challenges for Peng in her role as production manager. “Early on, I realized that they spoke two different dialects,” says Peng. “They used similar terminology, but their approaches to making a creative product were quite different in terms of process and priorities. I found myself becoming a bridge, translating concepts and driving the development of a common language so we could all communicate effectively.”
The team also had to be comfortable with fluidity as the technology they were working with was constantly evolving. Peng noted staying abreast of what was going on in the industry was key, as well as the leadership team being willing to take some risks. “I always call it ‘holding hands and jumping off the cliff together’.”
The First Big Leaps
“It [VR] really is like stepping into a different world, and it feels totally natural once you’re there.”
– Julie Peng
Visual effects supervisor Tim Alexander became involved with ILMxLAB after a history in traditional visual effects, including the 2015 blockbuster Jurassic World. He was also a lifelong gamer intrigued by the work ADG was pioneering at the time: bringing real-time, game engine-type techniques into visual effects. When director Alejandro G. Iñárritu approached ILM about a collaboration on a virtual reality project, Alexander came aboard as visual effects supervisor. The result was CARNE y ARENA, which debuted in 2017.
Still early in ILMxLAB’s history, CARNE was an ambitious project involving a short VR piece bookended by physical experiential rooms that put the audience into a story of immigrants being detained while crossing the border from Mexico to the United States. At the beginning of the experience, participants are brought into a physical holding cell (where the temperature inside is cold) where they have to remove their shoes and items like backpacks. “There are ambient noises and real artifacts like abandoned shoes that have been found in the desert, from people crossing,” notes Alexander.
The key art for CARNE y ARENA.
Participants are fitted with a VR headset and led barefoot into a 50-foot-by-50-foot room full of sand. In the VR portion of the experience, they assume the role of a group of immigrants attempting to cross the U.S.-Mexico border at night when they are stopped by U.S. Border Patrol agents. After the VR story, participants exit and are led down a hallway where video monitors play interviews of the real people CARNE is based on. “He [Iñárritu] cast people that had crossed the border as the people within this experience and wove a story around that, so you actually see the real people and hear their experiences,” says Alexander.
CARNE was a challenge from an artistic and engineering standpoint. What Iñárritu and Alexander wanted to do was sometimes hindered by the current technology. Wanting the images to appear as photoreal as possible, the team realized the immersive film’s computing requirements outweighed what was possible in headsets at the time, so Lutz Latta, ADG graphics engineer, designed a supercomputer with four high-end GPUs (graphics processing unit) to handle work such as calculating shadows in the film.
Other challenges included allowing participants to traverse and turn around in a 50-foot-by-50-foot room. “At the time, there was no way to really run a VR headset over more than 100 feet. You were lucky if you could get five feet away because of the HDMI cables and all kinds of things,” remembers Alexander. VR tracking abilities at the time were also far below where ILM’s engineers wanted them to be. “So then we started mixing in stuff that we know from visual effects of how to track cameras in large spaces. A motion capture stage was built to track the headset instead of what we would usually track the camera in. So it started becoming a mixture of different things that we knew how to do for different reasons, and kind of applying it to this situation.”
A final frame from CARNE y ARENA.
The newness of the technology and the goals the team wanted to achieve with CARNE meant everyone had to adapt and be ready for anything. “It was the first project in my career that I was actually concerned that I would not be able to deliver,” says Peng. “Because in all of my past projects, I would have a production plan, A, B and C, D and E in my back pocket. We were working with new technology and making something that had never been created before. There was no model of how to do that, which made me feel like I was operating without a parachute. That can be very nerve-wracking but also exhilarating when you actually finish the project. That sense of completion and accomplishment was huge.”
Audience reactions to the very visceral experience were all over the map. “We had people that really wanted to get into the middle of it, and they would look at every character and perhaps even jump behind a virtual bush to hide, while others might hang back to observe the scene, whether due to fear or other emotions that came up,” says Alexander. “The overall sense that I got was that people really understood what Alejandro was trying to say,” notes Alexander. “They heard it, and they understood what he was trying to express through that story.”
The studio’s debut with The VOID, Star Wars: Secrets of the Empire, also took place in 2017. At The VOID, up to four fans would suit up with their gear: a VR headset connected to a backpack laptop and haptic vest. From there, teams of fans were immersed in ILM’s digital world; in this case, Secrets connected to Rogue One: A Star Wars Story (2016), giving fans an adventure of a lifetime on Mustafar near Vader’s castle. While infiltrating an Imperial base, they would traverse the facility together and try to recover a key artifact.
Dropping Into the Story
“If we’re creating an experience, we want people to feel like they’re genuinely in a Star Wars project.”
While working on Secrets of the Empire, Ben Snow (visual effects supervisor for Star Wars: Attack of the Clones [2002] and Iron Man [2008]) was recruited to work on a connected story that was in development for home use, Vader Immortal. In the project’s early days, a prototype was put together to see what it was like to be in the same (virtual) space as Darth Vader – spoiler: it’s terrifying. At the same time, Oculus was quietly working on the first Quest headset, revolutionary with its tetherless execution, which ultimately influenced the amount of lightsaber play in the story. The stars and companies aligned, and Oculus Quest became the platform partner for release.
In Vader Immortal, fans take the role of an unnamed pilot who finds themself inside Darth Vader’s castle on Mustafar. The fan’s interactions with Vader were, of course, key to the success of the project. “Mustafar should be scary,” notes Snow. “The confrontation of meeting Vader should be scary. Because that’s what he is.” The Immortal team used scans of Vader’s costume from Rogue One (based on the original 1977’s Star Wars: A New Hope) and built on them with new scans to push the realism even further.
Concept art from Vader Immortal: A Star Wars VR Series by Russell Story.
The team worked internally with Lucasfilm to develop story ideas for three episodes. David S. Goyer,screenwriter of The Dark Knight Rises (2012), wrote scripts around them, injecting his own characters. These were similar to traditional film scripts, which then had to be made more interactive by adding lines of dialogue for the fan to perform certain tasks. The production brought together the film and games world as they put it all together. “In film visual effects, you get a script, you break it down. These are the assets you have to build,” explains Snow. “Interactive entertainment is much more free form and evolutionary. It was an interesting blend between those two mediums.”
The goal with Immortal was always the same: create an experience unique to virtual reality that you couldn’t experience by watching a movie. “One of the things that excited us,” says Snow, “was this was a chance to eavesdrop on Vader a little bit. We had the moment where Vader takes off his helmet, and he’s looking at a memory, almost, of Padmé. You’ve been climbing around, find yourself in Vader’s chamber, and you’re peering through these walls at him. We felt that moment of actually being an interloper, and seeing a side of the character you hadn’t seen before was something that was unique to what we could do in VR.”
Another element distinct to Immortal was making Vader the fan’s own teacher during the experience. The Sith Lord’s introduction is fittingly terrifying for such an iconic character. Initially, when Vader stepped up to the fan, he had a few lines of dialogue. But those lines were eventually cut after some internal tests of the experience. “Vader’s in the distance, and he comes toward you, and you hear the heavy breathing and footfalls,” says Beck, “and he keeps walking toward you, and it becomes more and more intimidating. Almost no one heard the dialogue because you’re so overwhelmed by his presence that it’s all that you can absorb.” Adding to the power of that moment was the eye-tracking in the experience, so no matter the height of the fan, Vader was looking right at you. “And the fact that you’re being acknowledged by a character like Vader is just mind-blowing,” adds Beck.
Actor Maya Rudolph (left) performs the voice ZOE-3 in Vader Immortal as director Ben Snow (middle) and writer and executive producer David S. Goyer look on.
Shereif Fattouh came to ILM from an AAA games (high-budget, high-profile games from large studios) background, working on titles like Battlefield and Dead Space at Electronic Arts. Interested in story-driven projects, Fattouh worked on The VOID projects Ralph Breaks VR (2018) and Avengers: Damage Control (2019). The development of a new headset, the Apple Vision Pro, led to Fattouh’s involvement in What If…? – An Immersive Story (2024), an experience that uses both mixed reality and virtual reality in addition to hand and eye-tracking through Apple’s innovative headset technology.
Marvel Studios’ What If…? series gave the developers a great amount of freedom in one of the most popular story worlds on the planet – the Marvel Cinematic Universe. “What If…? is such a great vehicle from the comic books and then to the animated show, where you get to just play in a sandbox,” says Fattouh. “What if this happened, and it’s a completely different version of it, and that kind of creative freedom just allowed us to tell the story that we wanted.”
Similar to previous ILM projects,the What If…? team was working on a project without the tech they would need to bring the experience to fans, as the Apple Vision Pro was being created in parallel. “We started development really early on,” says Fattouh. “It was a great collaboration with Marvel Studios, Disney+, and Apple, but we were definitely doing early, early testing and kind of figuring it out as we went.”
A final frame from What If…? – An Immersive Story.
What If…? – An Immersive Story took about 18 months from the conception of this particular idea as an experience to arriving in fans’ hands. Getting there involved finding the balance between the fans watching the story unfold and directly engaging with the characters and environments. “It’s really subjective,” says Fattouh. “There’s no right answer. How much do we want the audience to really observe this amazing story that’s being told and being kind of talked at versus going in and doing things and impacting the narrative? So that was really one of the biggest challenges throughout the whole life cycle. Playtesting it and figuring out, ‘Okay, is it feeling right? Is this beat too long? Is it too short? Do we want to have people jump in and get into the action a little bit faster?’”
During What If…? – An Immersive Story,the Watcher enters the room where a fan is situated. Throughout the story, fans see and interact with versions of some of their favorite Marvel heroes and villains, including Wong, Thanos, Hela, and Wanda. Fans are active participants in the story and get to use iconic items from the Marvel universe, like the Time Stone, to move the story forward.
Fattouh also notes how What If…? gives fans a unique way to experience a familiar Marvel moment near the beginning of the experience. “You don’t really know what’s going on because it starts with a disembodied voice, and you’re in space,” says Fattouh, “and then we kind of kick off in a very Marvel way, where it has that iconic Marvel logo flip book entry. But we did a very 3D spatialized version, where it’s coming into your living room. Just getting to see the smile on people’s faces when they saw something they’ve seen a lot in the films, but to see it really coming out in your living room … it set the right tone of, ‘Oh, this is something different.’”
Marvel director Dave Bushore (center) confers with Immersive crew members during production of What If…?, including: Maya Ramsey, Patrick Conran, Marissa Martinez-Hoadley, Indira Guerrieri, and Joe Ching.
What the Future Holds
After ten years, the team remains small, retaining its nimbleness on a quest for innovative excellence. Working with multiple partner studios and collaborators, the immersive team staggers projects, with typically two in production at a time, and with a production timeline of between 12 to 24 months. “I think over time, our goal will be to expand that capacity and capability,” says Beck. “It might mean expanding it in other studio locations – maybe in London or in Vancouver. The size of the team we have is really nice because everybody knows each other. We can iterate together, and that’s a really important part of interactive, immersive experience development.”
The immersive team has high hopes looking to the future as the technology reaches a wider group of people. “Venues like Star Wars Celebration are always amazing,” says Peng, “because the technology is still growing, and it gives us a chance to share our stories directly with fans. It’s also rewarding to see the accessibility of our experiences making it feel entirely organic and inclusive for everyone.”
Beck looks forward to hands-free AR glasses that can deliver a high-fidelity image with a wide field of view. “We are very excited about this idea of storyliving at city or world scale,” says Beck. “Geo-located content where you could be out in the world in your glasses and little story moments would unfold in the real world.” Beck also sees more people who don’t consider themselves gamers gravitate towards immersive stories. “And I think that’s really great for us because we’re interested in that intersection of story and interactivity and putting you at the center of that experience.”
ILM’s team on What If…? won an Emmy for Outstanding Innovation In Emerging Media Programming. From left: Elizabeth Walker, Ian Bowie, Lutz Latta, Marvel’s Dave Bushore, Vicki Dobbs Beck, Mark Miller, My-Linh Le, Julie Peng, Pat Conran.
Looking ahead, the future of immersive stories is limited only by the imaginations of writers, designers, and engineers devoted to bringing these experiences to audiences. “I think that there’s a huge opportunity for ILM in immersive entertainment broadly defined,” notes Beck. “When we first started, the word “immersive” almost always meant virtual reality, then it included augmented reality, and eventually mixed reality. But now, it’s being used to include linear content or pre-rendered content, but that’s very immersive through screen technology, like Abba Voyage (2022), as an example. The opportunity is to take our talents across the global studios, which include the highest quality visuals and sound, and couple that with the real-time understanding and capability, bringing those things together. I think that we’re going to start to see an increasing desire for interaction, where you are actually in an experience, doing something meaningful that makes the overall experience even more personal. And beginning to understand what that is and taking steps toward a storyliving future. I think that’s the big opportunity for ILM.”
– Amy Richau is a freelance writer and editor with a background in film preservation. She’s the author of several pop culture reference books including Star Wars Timelines, LEGO Marvel Visual Dictionary, and Star Wars: The Phantom Menace: A Visual Archive. She is also the founder of the 365 Star Wars Women Project – that includes over 90 interviews with women who have worked on Star Wars productions. Find her on Bluesky or Instagram.
ILM visual effects supervisors Mohen Leo and Scott Pritchard, along with members of their talented crew, discuss the process behind building the TIE Avenger as it journeyed from concept to screen.
By Jay Stobie
(Credit: ILM & Lucasfilm).
For many Star Wars enthusiasts, the word “avenger” conjures up images of Captain Needa’s Imperial Star Destroyer Avenger, the TIE Avenger starfighter featured in Lucasfilm Games’s Star Wars: TIE Fighter (1994) video game, or even Marvel’s prestigious superhero collective. The second season of Andor (2022-2025) has now pushed its own TIE Avenger to the forefront of that list, as the epic series chronicled Cassian Andor’s (Diego Luna) theft of the prototype craft from a Sienar Fleet Systems test facility. Outfitted with advanced armaments and a hyperdrive, the TIE Avenger transported Cassian to Yavin 4 before playing a key role in rescuing Bix Caleen (Adria Arjona) and Wilmon Paak (Muhannad Ben Amor) from Imperial forces on Mina-Rau.
Industrial Light & Magic’s Mohen Leo, whose resume boasts projects like Ant-Man (2015), The Martian (2015), and Rogue One: A Star Wars Story (2016), served as Andor’s production visual effects supervisor for both seasons of the series, while ILM visual effects supervisor Scott Pritchard (Star Wars: The Force Awakens [2015], Avengers: Infinity War [2018], Avengers: Endgame [2019]) oversaw the creative output of the work across ILM’s global studios in London, Vancouver, and Mumbai. Leo and Pritchard gathered alongside CG supervisor Laurent Hugueniot, modeler Owen Rachel, texture artist Emma Ellul, look development artist Renato Suetake, animation supervisor Mathieu Vig, and compositing supervisor Claudio Bassi to chart the TIE Avenger’s course from conceptualization to the completed sequences seen in season two.
Constructing the Concept
The TIE Avenger prototype is first unveiled at the beginning of season two, resting in its Sienar hangar bay before being commandeered by Cassian and embarking on a dramatic escape. “The idea for the opening sequence began with [showrunner] Tony Gilroy wanting to start season two off with a big, classic Star Wars action sequence,” Mohen Leo tells ILM.com. “That initially came out of an outline that Tony gave us in 2022. Early on, a big story point became that Cassian doesn’t know how to fly it, so the Avenger had to have completely unfamiliar controls, and the interior had to look different from any TIE fighter or ship that you’ve ever seen before.”
When it came to the Avenger’s look and layout, Leo worked closely with production designer Luke Hull. “Luke explored various prototype airplanes, and then we played around with the idea of what the ship needed to do in terms of the chase sequence. We wanted something that wasn’t just a dogfight. If he immediately jumps in and it’s just a chase, it’d be difficult to do something original with that,” adds Leo. “Luke had already decided to build a full-sized practical TIE Avenger. As far as its physical construction, the wings were inspired a bit by the TIE interceptor.” While Andor’s Avenger shares a name with the craft from the TIE Fighter game, it maintains its own design lineage. “I don’t think the previous ship was a strong influence,” Leo begins. “When we were designing our Avenger, how the ship functioned became something Luke and I reverse-engineered based on what we wanted the ship to do. That dictated the look.
(Credit: ILM & Lucasfilm).
“I put together a pitch deck for the Avenger before we got into previs when the directors weren’t even on yet,” Leo continues. “I wanted to make sure that the ship and the weaponry, in particular, were based on real weapons and felt both dangerous and aggressive. The team based the TIE’s fold-out Gatling-like cannons on the United States military’s M61 Vulcan rotary cannon. Hull wanted the Sienar base itself to feel like a Skunk Works test facility or NASA’s Jet Propulsion Laboratory.
“It was a back-and-forth between previs and Luke Hull and the art department in terms of the ship’s design,” Leo notes. “We’d say, ‘We need guns that fold out,’ and then Luke would go, ‘Let me see where we can fit those in.’ It was almost as much driven by the necessity of the functionality as it was by the aesthetics.” Once the additional armaments, including external launchers and a powerful cannon below the cockpit, were set, the team pitched the action sequence to Tony Gilroy. “We blocked the whole sequence with a temp model, and Tony generally really liked it.”
Assembling the Avenger
“As the studio-side visual effects supervisor, I was involved in pre-production through to the end,” Leo shares. “I also guided the previs development with The Third Floor’s Jennifer Kitching and collaborated with Luke Hull on how we would make the practical build service what we needed to do in the visual effects sequence.” The creative dialogue between the ILM visual effects team and the production designer was vital in ensuring that the computer graphics (CG) starfighter built by ILM would be identical to the full-sized practical ship that was constructed to be used on the Sienar hangar, Yavin 4, and Mina-Rau sets.
“Because we had a practical version of the Avenger during the shoot, we were able to scan that and provide lots of references,” Leo details. As such, the full-scale Avenger proved beneficial for Owen Rachel, the ILM modeler responsible for building the CG Avenger. “My job was to take [the practical model] and replicate it as a digital version. There wasn’t much design work that we had to do other than replace some structural bits, like the Gatling guns as they come down,” Rachel outlines. “We did have to create the laser cannon that comes out from underneath the cockpit. It’s an intricate design because it’s both delicate and powerful at the same time. It felt a bit like the inside of a watch,” recalls CG supervisor Laurent Hugueniot, who was in charge of the team’s 3D output.
The practical TIE Avenger prop on set at Pinewood Studios (Credit: ILM & Lucasfilm).
Texture artist Emma Ellul tackled the job of texturing the TIE Avenger. “We had great reference images, which was super helpful. I tried to focus on real-life objects, too, such as stealth planes. They’re quite smooth and angular, and I’d see how specularity affects the metal. Not every sheet of metal is made the same, so it has a slightly different bend or warping to it. I incorporated that, especially on the paneling on the outside of the wings,” Ellul relays. “There were a lot of nooks and crannies to look at and a lot of small decals everywhere, which I had to match one-to-one with the practical model. It was an awesome asset to texture. Who doesn’t want to texture a TIE fighter? And then I had to destroy it and chuck laser blasts all over it [laughs].”
Look development on the Avenger was handled by Renato Suetake, who asserts, “As a look dev artist, I get the model and textures so I can put them together and make the shaders. I make sure the shaders and materials react precisely like the reference we have in any situation or lighting condition. Certain shots jumped between the prop filmed on set and the CG version, so the digital Avenger had to be identical. At the same time, because the prop wasn’t made of metal, we still had to make it believable as an actual spaceship that flies.” From the Avenger’s weapons to the hangar explosions to the collapsing ice arch, Leo also credits the effects artists who contributed to the sequence, revealing, “In general, all of those things are just massive, complex simulation work.”
Pairing Computer Graphics and Practical Effects
As Andor’s ILM visual effects supervisor, Scott Pritchard helmed his team at ILM’s London studio, while coordinating the work at ILM’s studios in Vancouver and Mumbai. When it came to the Avenger’s breakout from the Sienar hangar, Pritchard observes that the production sought to use the “best tool for the job,” often pairing ILM’s CG expertise alongside special effects supervisor Luke Murphy’s practical effects. Highlighting a shot where an Imperial range trooper takes aim at the Avenger, Pritchard beams, “There’s a huge staged explosion along the back wall that was done by hanging a line of charges. They explode in sequence, so they explode outwards from the center. That in itself is impressive because it gives us some great visual reference to go on and actual practical elements to incorporate into the final comp.
(Credit: ILM & Lucasfilm).
“There’s a significant amount of work involved in painting out the actual charges and all the little fragments that get blown off properly, as well. It gives you such a great base to work off when you’re putting together a shot like that,” continues Pritchard, who then shifts focus to the Avenger’s weapons blasting through the hangar. “A lot of these explosions are practical, but we’ve enhanced them by adding sparks and additional explosions in CG. Making all this work seamlessly is a great testament to the comp and effects team.”
Compositing supervisor Claudio Bassi concurs, believing that the practical effects supplied ILM with valuable reference for lighting purposes. Bassi also states that, despite the presence of the practical Avenger, the TIE’s wings during Niya’s (Rachelle Diedericks) inspection are actually CG. “The hangar set didn’t have a roof, so we often replaced the wings as it was easier to integrate the CG roof.” Although the hangar set was extremely large, Pritchard highlights the fact that ILM had to extend the hangar to an even greater width, and the entirety of the front section that opens toward the snowy exterior is also CG.
Maintaining a Match
Of course, having both a practical and digital Avenger presented its own challenges when it came to assuring that the details matched, particularly regarding how much damage the CG version sustained at Sienar in comparison to the practical model that was filmed on the Yavin 4 set. “Working with the art department, we knew that the Avenger had gone through the dogfight at Sienar base and should have scorch marks where lasers had hit it,” Leo remembers. “We counted the number of rockets it fired in the first sequence because there’s no way for him to restock in space. We took four specific missiles off the practical build, which we then reversed in digital effects to choose the four that he fires in the opening sequence.”
Hugueniot emphasizes that the same held true for the havoc wrought upon the Sienar hangar itself, commenting, “Not all shots are worked on one after another in story order. There’s a big job of keeping track of what’s going on in every shot. All the scorch marks on the walls, everything that’s been knocked down from the ceiling, and which lights are working in each shot. That was quite a job [laughs].” Bassi agrees, divulging, “We kept track of the marks where the Avenger scratched the floor and which lights broke, and we had a system to recognize them in shot order.”
(Credit: ILM & Lucasfilm).
That level of realism was reflected in animation supervisor Mathieu Vig’s mission to make the Avenger look “heavy and dangerous, and as if it’s made of metal, not just pixels.” Having the Avenger scrape along the deck helped achieve this. “We’re used to seeing them [TIE fighters] flying very gracefully,” Vig explains. “Usually, we don’t animate them bumping around, so setting the weight is harder than you might think. In a hangar setting, there are so many physical elements to consider, such as the actor in the cockpit doing specific movements that we have to take into account. All of this is a carefully interlocking puzzle.”
Diving Into the Details
While analyzing the projectiles under the practical Avenger’s wings to model them for its digital counterpart, Owen Rachel recognized an intriguing connection. “When we were trying to work out how the missiles fire, we realized the design on the set was similar to those seen in Star Wars: A New Hope [1977], as they go into the exhaust port on the Death Star,” conveys Rachel. As it turns out, the design was a one-to-one match, so Rachel subsequently modeled the Avenger’s projectiles after the proton torpedoes that Luke Skywalker (Mark Hamill) fired at the first Death Star. Effort was also invested in preventing the Avenger’s Gatling-style spray of laser fire from appearing as though it simply hovered in mid-air. “We gave them a bit of an offset and some randomness in both their position in the stream and in their x- and y-axis, so we could get more chaos into that stream,” Pritchard elaborates.
Even the red light that flashes along with the hangar’s klaxon alarm was not nearly as simple as one might assume. ILM had to maintain a perfect rhythm between the flashing lights and klaxon, occasionally analyzing where the visual effects team needed to extend or shift the red light so it all remained in sync. “Compositing is basically the last step in the visual effects pipeline that ensures that all elements are integrated and the CG matches with the plate that has been shot on set,” describes Bassi, who worked alongside Pritchard to successfully pitch the idea that the overall light energy of the hangar would get progressively darker and moodier as the Avenger knocked lights off the ceiling.
A live-action plate (top) was captured on the set with practical explosion elements, which were later integrated with ILM’s work (Credit: ILM & Lucasfilm).
Matching the interior views of the practical and CG Avenger cockpits proved to be another challenge. “ILM’s Vancouver studio did a hologram of Cassian in season one that was absolutely fantastic and so lifelike. We reused that for Cassian’s head,” Hugueniot recounts. Filming Diego Luna in the practical cockpit occurred toward the end of the shoot, as Leo clarifies, “That was the very last thing we shot on the whole project—Diego in a motion base cockpit that we could move around and rattle. I think Diego had a really good time shooting those bits [laughs].”
In Awe of the Avenger
With season two now streaming on Disney+, the visual effects team has been able to view the completed episodes and finally share their work on the TIE Avenger prototype with the world. “I couldn’t even tell which Avenger was CG and which wasn’t,” laughs Emma Ellul, referring to the Sienar sequence. “The blend between the hangar, the ship taking off, and the chaos unfolding is so seamless. It was such an exciting bit to watch.”
The audience’s overwhelmingly positive response to the opening scenes has been equally uplifting for ILM, as the sequence fulfilled what the team set out to do. “When we were talking in previs, part of the idea was that it should feel breathless. Every time Cassian has solved one problem, the next problem comes up. There should never be a moment for him to relax until it’s over,” says Mohen Leo, who praises the sound design provided by Skywalker Sound. “One of the things that always happens after we’re done but makes such an impact is the sound. The sound that Skywalker put to the engines, weapons, and all of that makes such a huge difference.”
The TIE Avenger’s action-packed escape consists of a relatively small amount of screen time—but as Leo and his team have outlined, ILM imbued each facet of the Avenger and its accompanying environments with an extraordinary amount of time, energy, and expertise. So, the next time you rewatch Andor, don’t be afraid to press pause amidst the thrilling moments and soak up the wonders that ILM worked to allow the Avenger to ascend to the stars.
Discover more about the visual effects of Andor on ILM.com:
Jay Stobie (he/him) is a writer, author, and consultant who has contributed articles to ILM.com, Skysound.com, Star Wars Insider, StarWars.com, Star Trek Explorer, Star Trek Magazine, and StarTrek.com. Jay loves sci-fi, fantasy, and film, and you can learn more about him by visiting JayStobie.com or finding him on Twitter, Instagram, and other social media platforms at @StobiesGalaxy.
The final part of ILM.com’s discussion with Andor‘s overall visual effects producer and production visual effects supervisor covers the influence of Rogue One, collaborating with Tony Gilroy, their favorite moments from season two, and more.
By Mark Newbold
In part one of our conversation, TJ Falls (vice president of visual effects at Lucasfilm and Andor’s visual effects producer) and Mohen Leo (Andor’sproduction visual effects supervisor) discussed location shooting and the logistics of bringing Andor (2022-25) to audiences worldwide. Now, we continue our dive into the Emmy-nominated second season and the teamwork required to shepherd the story from the page to the screen.
It takes an army to bring a film or TV series from the imagination of the writers to screens around the world, and that means teamwork is key, as Mohen Leo explains.
“This project was somewhat unique in terms of how collaborative people were. You have certain projects where the director’s attitude is, ‘This is what I want, I don’t care how you do it, just figure it out.’ This was a case of everyone collectively understanding that we were trying to get as much value on screen as possible. That meant I could go to [editor] John Gilroy and say, ‘Hey, that choice you made will cost a lot of money; is it really worth it? It doesn’t feel like this is where we want to put all the effort.’ There were specific instances where he would say, ‘Okay, give me some time, I’ll have a look. If there’s a different way to cut this, I’ll let you know.’ Sometimes he came back and said, ‘Yep, I’ve managed to get rid of the shot and it feels just as good.’ That allows us to take those funds and put them elsewhere to make something else bigger and more exciting.”
Alan Tudyk (top) performs as K-2SO with motion capture (Credit: ILM & Lucasfilm).
Flexibility, trust, and an understanding of team dynamics meant that the Andor team could make required adjustments and pivot, making the most of the skills at hand and sharing the load across departments, something that started at the very beginning of the series.
“That comes from the partnership we had through season one to season two,” TJ Falls notes. “It was an intentionally designed paradigm between [showrunner] Tony Gilroy and our producer, Sanne Wohlenberg. Our brain trust [Tony Gilroy, John Gilroy, Wohlenberg, Falls, Leo, and production designer Luke Hull] was involved in every key decision. As the show moved from start to finish, we were involved in those conversations, so it wasn’t the top brass dictating what the need was; it was a collaboration of ideas to make sure that it was the best version possible for Tony.”
Leo shares an example. “The Yavinian doodar, the creature at the end of episode two [‘Sagrona Teema,’ directed by Ariel Kleiman], that came through the trees, snatched the two rebels, and carried them off into the jungle. There was a lot of handwringing at the beginning because, from a visual effects perspective, you question whether we really want to build a fully computer graphics creature just for one shot. That’s a big ask.
“It’s also in the back of your mind that it’s going to turn into something much bigger,” Leo continues. “Then you try to cover yourself to make sure that it works for all these other things, but throughout, Tony kept saying, ‘I just need the one shot.’ Tony wants this, but we can’t spend too much money on this creature, so how do we make it possible? Ultimately, everyone worked together with the director [Ariel Kleiman], the director of photography [Christophe Nuyens], and the editor [Craig Ferreira] to make it possible to have this creature in there for one shot, and it worked out great. On many other projects, you would have abandoned it because there would have been this fear that it spirals out of control.”
Green screen was utilized at an exterior location in the United Kingdom to portray a view on Coruscant (Credit: ILM & Lucasfilm).
“In a number of situations, we were the first stop in terms of Star Wars lore, where Tony would ask, ‘How do I do this kind of thing in Star Wars? How does that work in Star Wars?’ We’re able to help there. Same with Luke Hull. However, knowledge of our own world was equally as important for a show as grounded as Andor. For me, a big part of it was using things that were not just from Star Wars, but from other films, documentaries, and news clips.
“There’s a shot in episode three [‘Harvest,’ directed by Kleiman] where we see the troop transport on Mina-Rau and the TIE fighter appears low behind it,” Leo continues. “There’s a fly by as they’re all looking at it. Watching reference of Apache helicopters was one of our inspirations, and I found this incredible shot of a troop transport driving through the desert, and out of the dust cloud, came this helicopter, which goes right by them. I showed it to the director and I said, ‘Can we do this shot?’ And Ariel was like, ‘Oh yeah, absolutely. Let’s do it.’”
Sometimes, as in this case, previsualization from reference material is a huge part of the process, giving form to the action and allowing the production to have a rough version of the episode to build from.
“Tony and the director would quite often call on the visual effects team to pitch ideas for shots,” says Leo, “so Jennifer Kitching, our previs supervisor at The Third Floor, would dig around for reference and try things out. Even on big establishing shots, we were always trying to find something real, so [ILM visual effects supervisor] Scott Pritchard and I identified shots of Manhattan, Tokyo, and Hong Kong, very specific shots. Then we could determine the feel of the shots, but we’re ultimately doing it on Coruscant rather than New York or Hong Kong.”
Palmo City’s central plaza on Ghorman was shot as a backlot set at Pinewood Studios with digital extensions (Credit: ILM & Lucasfilm).
Famously, in the 1970s and 80s, ILM used traditional matte paintings to establish new locations, the principle of which is still at the core of creating an establishing shot. The technique, however, now resides in the digital realm, often with the aid of live-action background plates. Andor treats viewers to a number of establishing shots on Ghorman and Coruscant, a process that takes a considerable amount of time and effort, depending on the requirements of the shot.
“If you’re travelling through the digital location and have a bunch of different angles on it, we will build a full 360-degree environment,” explains Leo. “But if it’s for a single shot, we may do it as a bespoke shot. What worked really well on season one and into season two was that we based things on real cities. You can find open-source 3D street maps of Tokyo or New York, and we would basically fly around and find an angle and think, ‘Okay, that’s a cool angle; this feels organic. Now take that but replace all of the buildings with Coruscant buildings.’ You end up with something that feels organic and real.”
It’s an approach Leo picked up from the director of Rogue One.
“I have to give credit for having learned this approach to Gareth Edwards,” he explains. “When we built the city of Jedha, we had blocks of neighborhoods based on layouts from parts of Morocco. Then, Gareth asked us to do something which seemed really strange at the time. He said, ‘I want you to drop 300 random cameras into the CG model of the city, anywhere you like, and show me the pictures.’ We wrote a script that dropped a camera at every intersection and then rendered a view in every direction. We sent those to Gareth, and he picked from those, the idea being that rather than artificially building a view to the camera, you would scout the artificial city just as you would scout a real location and go, ‘I found this really cool angle here.’ That way, you ended up with compositions that felt much more interesting than if you simply asked someone to put some buildings in the background.”
Elements of the City of Arts and Sciences in Valencia, Spain were utilized for Coruscant (Credit: ILM & Lucasfilm).
Coming from a visual effects background as Edwards does – as most recently evidenced by his work with ILM on 2025’s Jurassic World Rebirth – his fluency in the language of visual effects gave the crew a tremendous advantage on Rogue One.
“What I really appreciate about Gareth is that he has this really disciplined approach to thinking about whether you could have done a visual effects shot in the real world, and would it have felt the same way?” Leo continues. “I took that forward into our approach to Andor. Quite often, if we did a layout of visual effects and everything fit neatly into frame, Gareth would say, ‘That feels artificial. Make it so that something uncomfortably sticks out of frame, and as the shot progresses, I have to pan and tilt from one thing to the other, because both of them won’t fit in the frame at the same time.’ That makes it feel real and organic. I always appreciate how much I learned from Gareth about shot design.”
“That ethos fits really well with the aesthetic that Tony wanted for Andor,” adds Falls. “It was a constant conversation that we would have with our directors and DPs to make sure things weren’t too pretty. Mohen would often say, ‘It’s too clean, how do we make it look not as good, so that it looks even better?’ That was a lot of fun, and it really maintained that beautiful look from Rogue One as part of a storytelling thread that was done visually.”
With Andor now delighting viewers both old and new, the look and feel of the show has become one of its most celebrated talking points. Given that, could – or should – that aesthetic be carried over to the next Star Wars project or not? Mohen Leo has his own thoughts on that.
“Andor took inspiration from Rogue One, but Rogue One is primarily a war film, whereas Andor is a spy drama, so Luke Hull made the aesthetic even more grounded. What does this world look like from the perspective of an ordinary person who lives in it? I certainly hope that as we move forward, every project develops its own look. I wouldn’t want everything to look like Andor because that would be boring. The joy that I got out of working on this series is that it proves that you can make something that looks very different but still feels like it belongs in the same galaxy, so I hope that future projects will strike out in different directions and try different things.”
Cassian’s first encounter with the deadly Imperial security droid on Ghorman, later reprogrammed as his companion, K-2SO (Credit: ILM & Lucasfilm).
Understanding that each project needs and deserves its own visual identity within the broader Star Wars galaxy has changed the people who worked on Andor. As he moves on to new projects, TJ Falls reflects on one of the most important lessons he learned from the show.
“It was Tony and Sanne who said, ‘Let the experts be the experts.’ Because of that, every artist felt incredibly valued, and their contribution was fully appreciated. That message was constantly sent down from Tony: Let the best idea win. If an artist had something cool to contribute, it made its way up and it was credited and talked about.”
“The thing that I hope we can take forward is collaboration across departments,” says Leo. “Andor was completely generous in that everyone would happily let someone else do something if it made the result better, so there were no fiefdoms. We were able to put so much value on the screen because every problem was solved together, and that’s something that comes from the top down, in this case, from Tony.
“When there isn’t a sense of shared ownership and a clear creative direction, sometimes the frustration can trickle all the way down through the process,” Leo continues, “not just through the shoot and on the client side, but into the visual effects work and with the artists. Someone can change their mind at any minute and tell you to do something differently. For me, that was the most positive difference about Andor. It’s a culture that says there are no egos; it’s not about anyone standing out and making a name for themselves; it’s all about the collaboration. So I hope that’s something I encounter again on future projects.”
Tudyk performs as K-2SO alongside a final frame created by ILM (Credit: ILM & Lucasfilm).
When pondering each of their favorite moments in season two, Leo is quick to answer, “Cassian stealing the TIE Avenger and escaping in episode one [‘One Year Later,’ directed by Ariel Kleiman] was certainly the one I was involved in the longest, all the way from the beginning pitching storyboards for the action, right down to it being the last thing we shot with Diego.
“What I like about it is that on the one hand it’s a very classic Star Wars sequence with the spaceship and a dogfight,” Leo continues, “but we found a way to still make it fit within Andor by designing it in a way that it starts very practical in a real hangar with a real ship and stunts, and bit by bit we transition into something that’s pure computer graphics, but it all fit into the style the show, so I’m really pleased with that.”
Falls is equally quick to respond. “My favorite is the opening shot from episode eight [‘Who Are You?’ directed by Janus Metz], which is a long lens establishing shot of Ghorman, orbiting around the city. We had Hybride [Ubisoft’s visual effects branch] working on the look of the plaza, and ILM took on the high establishing shots of Ghorman from the air. The shot went through a number of rounds of honing it into what Mohen was thinking, pitching the idea without the visual was tricky, trying to get everyone to understand what it was that was being described. Once we started to get the visuals into motion with previs, it started to click with everybody. Then it came alive in shot production. I think it’s absolutely gorgeous.”
—
Mark Newbold has contributed to Star Wars Insider magazine since 2006, is a 4-time Star Wars Celebration stage host, avid podcaster, and the Editor-in-Chief of FanthaTracks.com. Online since 1996. You can find this Hoopy frood online @Prefect_Timing.
In part one of a two-part story, the production’s visual effects producer and visual effects supervisor discuss the effort to create over 4,000 effects shots for the Emmy-nominated Lucasfilm series.
By Mark Newbold
“It was a good opportunity to expand our horizons,” says TJ Falls, vice president of visual effects at Lucasfilm, about the team’s work to create a grounded aesthetic for both seasons of Andor (2022-25). After Rogue One: A Star Wars Story (2016) established the tone for the adventures of Cassian Andor (Diego Luna), the Andor production opted to utilize a number of existing locations for filming in the United Kingdom and around the world. It was a tactic previous Star Wars productions also chose (for example, 1999’s Star Wars: The Phantom Menace traveled to Italy and the Caserta Palace for the interior of the Theed Palace on Naboo), but integrating these locations to such a degree was something new for Industrial Light & Magic, a choice Falls appreciates.
“It allowed us to go out in the world and find a real base reference,” explains Falls, who was also the overall visual effects producer for Andor. “That was something the team worked hard to capture. We’re actually there in the city or in the mountains, so it was wonderful to be able to tie real-world locations into our digital work.”
The debut season of Andor leaned heavily into this physical integration. But, with a very real-world, global pandemic happening around the production, season one had its international travel wings clipped, as Falls explains.
“We couldn’t travel, but we still managed to gather reference material, including some for the ship-breaking yards on Ferrix. For season two, we were fortunate enough to finally be able to travel, so we flew to Lake Como and the Italian Alps to capture plates for Ghorman, among other locations.”
The Mothma estate on Chandrilla utilized aerial plates shot in Spain (Credit: ILM & Lucasfilm).
Joining Falls, production visual effects supervisor Mohen Leo picks up the conversation.
“Being able to travel to Spain for a variety of locations on season two allowed [production designer and executive producer] Luke Hull to rely much more heavily on the look of existing locations that were compatible, particularly the Senate building. Once we did the first location scout at the City of Arts and Sciences in Valencia, we were looking around, thinking, ‘Wow, it looks like Coruscant already.’ That made a huge difference, having that basis, both for interior and exterior spaces, so we could then use visual effects to build on and make it feel like Star Wars.”
The practicalities of having a ready-built set in the form of an existing building clearly had their benefits. Still, the broader task of adding visual effects presented its own challenges, as Leo explains.
“One thing I took away from the project is to push as much as possible for real locations,” he says. “Using an existing building during a shoot allows people to make informed decisions that stick, because if you have something that already looks 50%, 60%, or 70% the way you want it to, everyone has the confidence to say ‘Okay, this is the frame that we want, and we understand that we’re going to put this building in the background. Also, you have the composition of the lighting and the weight of the architecture, which makes it much easier, rather than having a blank canvas in post-production and then debating what it should look like.
“For example,” Leo continues, “there were the mountains around Ghorman. A couple of people from the production team and I went to Italy and did a two-day helicopter shoot. We felt strongly that even those locations where we would never actually shoot with a full crew or with actors should be based very specifically on real landscapes. That allowed us to put the Star Wars architecture in there and have that foundation.”
With the tremendous amount of work required to bring these locations to life, the balance between real locations and visual effects is a delicate one, based on story requirements, budget, and time.
“When we go location scouting, I always ask the director of photography [for season two, Damián García, Christophe Nuyens, and Mark Patten], ‘What are we keeping from the location?’” says Leo. “Because there has to be value in us being there. We were on location in Spain, and a Coruscant scene was discussed, which involved two people standing by a railing, looking out across the fictional cityscape. If we’re going to replace the whole city, then we don’t need to shoot that in Spain.”If you want that view, we can shoot that back in London on a green screen set because it’s easier, and we’ll have more control over the lighting. That, for me, is the main thing, having a clear idea when you go on location of what we keep from the location, and why we are there?”
The original location plate (top) shot at the City of Arts and Sciences in Valencia, Spain opposite the final shot (bottom) with the Coruscant skyline (Credit: ILM & Lucasfilm).
The use of natural light throughout the series is even more impressive when considering the balance between physical structures and digital extensions. Bathing the action in brightness or shadow, regardless of where and how it was shot, Leo explains, is how this integration was managed.
“We work very closely with the DP on that,” says Leo. “There are scenes where people walk directly from a stage set in London onto something that’s on location in Valencia. In the context of the story, it feels like one continuous location, even though they were shot months apart in two different countries. Obviously, we take lots of photographic reference. We have the plates of the one side at hand when we’re doing the other, and we’re constantly checking to make sure things fit together. On this project, we had a plan for each of those things before we went on location and shot it. We’re not trying to force things together in post; they’re meant to go together.”
“That’s exactly it,” adds Falls. “It’s the collaboration with the DP and lighting team, but also with previs, with techvis, and knowing that we’re going from studio space to location space. We had the opportunity to plan that out very specifically, each step of the way. And what helped us succeed is that we had a plan, and we were able to push it through to the best of each department’s abilities to deliver on it.”
Having a plan is essential to any well-run production, and on a visual effects-heavy series like Andor,it’s even more vital. Managing the process requires unique skills and systems to marshal all the information and elements into one place, as Falls explains.
“You’ve got to manage all these people and figure out who’s doing what, breaking it down to what the responsibilities of each person are. You start with something that’s massive, and we start to split things up between our teams and vendors. Ghorman is primarily a Hybride sequence; we’ve got Scanline VFX dealing with Mina-Rau, and we work with [ILM visual effects supervisor] Scott Pritchard to ask how we’re going to slice up this pie.
“It’s like eating an elephant one bite at a time,” Falls adds with a smile. “That translates from the production side into post and dealing with our vendors, and it’s all about clear communication, having people that you can build a shorthand with and have trust with, and then let them do what they do and not overmanage it.”
Actor Joplin Sibtain (Brasso) atop the speeder prop rigged to a camera vehicle (top) with a final frame from Mina-Rau (below) (Credit: ILM & Lucasfilm).
Truly a mammoth task, but that’s just the start of it. “Then, each individual team brings their expertise to build it right back up the mountain,” Falls continues, “so that Mohen has the opportunity to have that creative outlook over everything, I make sure it’s moving at the pace that it’s supposed to and that we’re hitting our schedule and staying on budget while making sure that [creator and showrunner] Tony Gilroy is getting what he wants for his vision of the show.”
There are many unsung heroes on any production, and amongst those are the production managers (including Frédérique Dupuis and Alyssa Cabaltera from ILM and Anina Walas from Lucasfilm, among others), who, on the visual effects team, juggle countless shots and give structure to the process for both the production and the partner studios. In its completed form, Andor might appear to be a graceful swan, but under the water’s surface, its legs are furiously kicking to propel it forward, as Mohen Leo elaborates.
“The visual effects production team has to keep track of over 4,000 shots, and each one of those shots has dozens and dozens of assets, be it art and reference or photography and scans, and they have to funnel all of that to where it needs to land and then send any questions back to me in a manageable way. I answer the creative questions. The logistical and organizational work is done by a team of incredibly diligent people without whom none of this would be possible.”
Along with this beehive of activity tracking all the elements, a database system, unique to each production, needs to be put in place.
“We find on each show that you have similar tool sets and similar ways of databasing things,” Falls says, “but you have to build it around the specific challenge of the show and the personalities involved. It’s about what Mohen likes and the types of data that we’re getting in.
“You have people like [on-set visual effects supervisor] Marcus Dryden, who was on set managing that side of things. His role was specific to season two, and it worked really well, that marriage of supervision responsibilities between me and our Lucasfilm production team and our production manager, and the coordinators building the database. That worked well for Mohen to get the notes in and out and track the scans and the data, but presenting it in forms that fit the specific way we were working with our vendors on this show. It wasn’t groundbreaking, but it was specific to what we needed.”
Palmo City’s central plaza on Ghorman utilized the massive backlot Pinewood Studios (top), and was later completed with visual effects (bottom) (Credit: ILM & Lucasfilm).
The database is set up, a system is in place, production managers have a process, and the elements are tracked as they come in. “It’s absolutely critical because it gives me the luxury to say, ‘Hey, where’s that scan from that location that we shot in that scene six months ago in Valencia?’” explains Falls. “And within 10 seconds, somebody will go, ‘Here it is.’ That shouldn’t be taken for granted because I’ve been on many shows where that can turn into an archaeological dig that can take days, or sometimes you don’t find it at all.”
With this bespoke Andor structure in place for season one, Leo could then take that and refine it even further for season two, a huge advantage, especially considering episodic television wasn’t a familiar environment for him.
“Season one was a big learning experience,” explains Leo. “I’d never done episodic television before; I’d only done movies, so dealing with that much content in such a compressed time was challenging. Also, the interaction with editorial is slightly different on episodic television. With every project, there’s an element of adjustment, but, there’s also an element of learning.”
“We had the luxury of a number of production staff carrying over from season one to season two,” says Falls. “So we learned in real time and adjusted things to fit. You could port it, but it wouldn’t necessarily work as succinctly as it does when it’s crafted around the group, and for season two in particular, I felt that we ended up crafting a really great system. The team was unbelievably adept in making sure that every person got exactly what they needed as quickly as humanly possible.”
The script is the tramline for everything that ends up on-screen, but in the realm of visual effects and working with the rest of the crew, there needs to be a clear understanding of what’s required and how to do it, something that comes from the top, as Leo explains.
“When we’re planning a shoot, we sit down with the director, the cinematographer, and the assistant director and ask, ‘What are you trying to achieve, what do we need to contribute in terms of the visual effects, and how do we make sure we get what we need during the shoot?’ Then we take meticulous notes.”
However, it doesn’t always go as smoothly as planned. “We’re staring at the monitor as they’re shooting, but then somebody drops the microphone into frame, so that’s something we have to paint out,” Leo continues. “Maybe we have to do a set extension that we didn’t expect. Then there’s a step in post-production where, along with editorial, we’re looking at the early versions of the cuts, and that’s where we do something called the statement of work, where we look at each individual shot and go, ‘Okay, here’s all of the things we need to do for this particular shot across the various disciplines in order to complete it.”
An aerial view of the Ghorman set on the backlot (top) and final frame (bottom) (Credit: ILM & Lucasfilm).
Like all aspects of a production, visual effects come at a cost, with so many highly skilled experts putting their time and craft into a project. The team is responsible for both managing costs and ensuring that additional required effects can be covered within the allotted budget.
“There’s a constant ebb and flow of evaluation, so we work closely with editorial, seeing the working cuts,” Falls notes. “We go in with [editor] John Gilroy and they show us little pieces, and that allows the opportunity for some give and take as we evaluate things and look at shots and go, ‘Well, this is more than we had planned, or maybe there’s another sequence where they’re using less than what we had planned,’ and so there’s a little bit of horse-trading that happens.
“What we strive for,” Falls continues, “is to not say we can’t do something because it wasn’t planned. If there are 10 additional seconds needed in the show, how can we do it? Can we find a way that still delivers everything that’s needed, but also in line with the number of resources we allotted? Then, we’re back on budget, or I have to figure out how to take care of it, but we always start with what is the creative desire for the scene. How is it furthering the story? We don’t want anything that’s egregious or over the top just for the sake of being something flashy, so we have to make sure that everybody is in agreement that ‘Okay, it’s more than expected but it serves the story, it does what Tony needs, and now it’s our job to figure out how can we make it work.’ I think we did a pretty good job of that.”
Mark Newbold has contributed to Star Wars Insider magazine since 2006, is a 4-time Star Wars Celebration stage host, avid podcaster, and the Editor-in-Chief of FanthaTracks.com. Online since 1996. You can find this Hoopy frood online @Prefect_Timing.
SDCC’s hottest ticket brought the first-time Comic-Con guest and friends to preview the Lucas Museum of Narrative Art, and ILM.com was there in the room.
By Clayton Sandell
George Lucas takes the stage at San Diego Comic-Con (Credit: Lucasfilm).
Star Wars creator and Industrial Light & Magic founder George Lucas recently made his San Diego Comic-Con debut, but the Force has been strong at the show for decades.
Inside the convention center’s massive Hall H, a record Sunday crowd of 6,500 screaming and cheering fans greeted Lucas as he walked onstage to give the first public preview of the Lucas Museum of Narrative Art.
Co-founded by Lucas and his spouse, Mellody Hobson, the museum is set to open in Los Angeles in 2026. Lucas describes the building as a “temple to the people’s art.”
“This museum is dedicated to the idea that stories and mythology are extremely important to society in creating community,” Lucas told the crowd. “Art illustrates that story.
“It’s mythology,” he continued. “People believe it, and it binds them together with a common belief system. And what we’re doing here with the museum is to try to make people aware of the mythology that we live by. And at the same time, let them have an emotional experience looking at art.”
Lucas was joined by two Academy Award-winning filmmakers: director Guillermo del Toro and Lucasfilm’s senior vice president and executive design director Doug Chiang. Actor and artist Queen Latifah moderated the panel.
“What is amazing about this collection is that it will give you a step-by-step look at how a form of expression came to inform what we are today,” said del Toro, a Lucas Museum board member and longtime ILM collaborator on films includingPacific Rim (2013) and the upcomingFrankenstein (2025).
Director Guillermo del Toro (left) at ILM’s San Francisco studio during work on Pacific Rim (2013) with visual effects art director Alex Jaeger (center) and visual effects supervisor John Knoll (Credit: ILM & Greg Grusby).
The Lucas Museum’s renowned collection includes items from both the original and prequel trilogy eras of Star Wars, including filming miniatures created by the ILM Model Shop, concept art, creature maquettes, costumes, a full-scale version of Anakin Skywalker’s N-1 starfighter fromStar Wars: The Phantom Menace (1999), speeder bikes fromStar Wars: Return of the Jedi (1983), and Luke Skywalker’s X-34 landspeeder fromStar Wars: A New Hope (1977).
The pieces will share exhibit space with an eclectic mix of visual art: paintings by artists including Norman Rockwell, Frida Kahlo, and Maxfield Parrish; original art created for Iron Man’s first comic cover in 1968; the first-ever 1934 Flash Gordon comic strip drawing; and Peanuts illustrations drawn by Charles M. Schulz.
“These are all very emotional pieces,” said del Toro. “This is celebrating things that speak to all of us, collectively or individually.”
Lucas says his art collecting began in college when he bought his first comic illustrations. His multifaceted collection today has grown to around 40,000 items.
“I’ve been doing this for 50 years now. And then it occurred to me: ‘What am I going to do with it all? Because I refuse to sell it,’” Lucas explained. “I said I could never do that. It’s just it’s not what I think art is. I think it’s more about an emotional connection with the work.”
Lucas’s first appearance at San Diego Comic-Con brings an association that began a long time ago full circle. In 1976 – ten months before his space fantasy adventure Star Wars hit theaters – a few dozen lucky attendees got a preview of the comic book adaptation of the film led by Marvel’s Roy Thomas and Howard Chaykin. They were joined by Charles Lippincott, Lucasfilm’s vice president of advertising, publicity, promotion, and merchandising. During a panel that didn’t start until 8 p.m. on Thursday, July 22, the trio also revealed a few still images from the upcoming movie to a room that had plenty of empty seats.
Visual effects art director Doug Chiang at work on Terminator 2: Judgment Day (1991) (Credit: ILM).
Chiang, a celebrated artist himself who first joined Lucasfilm as creative director at ILM in 1991, described growing up loving comic books at a time when comic book art didn’t get much respect.
“I think what’s remarkable about George is that he leads from the heart, and this museum is him. It’s his gift to help celebrate this,” said Chiang. “Narrative art is a way to educate kids and say, ‘It’s okay to draw your fantasy, draw things from your mind, embrace comic books.’ It shouldn’t be left out of art. What’s fantastic is that I think the museum will inspire the next Norman Rockwell or Frank Frazetta.”
—
Clayton Sandell is a Star Wars author and enthusiast, TV storyteller, and a longtime fan of the creative people who keep Industrial Light & Magic and Skywalker Sound on the leading edge of visual effects and sound design. Follow him on Instagram (@claytonsandell) Bluesky (@claytonsandell.com) or X (@Clayton_Sandell).
Teams from across ILM’s global studios are recognized for their innovative work for television this past year.
Among the 14 nominations for the second season of Lucasfilm’s Andorseries on Disney+, ILM and their collaborators have earned one for “Special Visual Effects in a Season or a Movie.” The nominees include production visual effects supervisor Mohen Leo, visual effects producer TJ Falls, special effects supervisor Luke Murphy, creature effects and droid supervisor Neal Scanlan, ILM visual effects supervisor Scott Pritchard, Hybride visual effects supervisor Joseph Kasparian, Scanline visual effects supervisor Sue Row, MidasVFX visual effects supervisor Paolo D’Arco, and digital colorist Jean-Clément Soret.
Alongside the Andor nomination for “Special Visual Effects in a Season or a Movie” is season two of The Lord of the Rings: The Rings of Power on Amazon Prime. The nominees among ILM artists and their partners include production visual effects supervisor Jason Smith, visual effects producer Tim Keene, visual effects producer Ann Podlozny, visual effects co-producer James Yeoman, ILM visual effects supervisor Daniele Bigi, DNEG visual effects supervisor Greg Butler, Rodeo FX visual effects supervisor Ara Khanikian, The Yard visual effects supervisor Laurens Ehrmann, and special effects supervisor Ryan Conder.
Earning a nomination for “Special Visual Effects in a Single Episode” is the premiere entry from season two of the Apple TV+ series Severance, “Hello, Ms. Cobel.” The nominated ILM artists and their collaborators include production visual effects supervisor Eric Leven, production visual effects producer Sean Findley, ILM visual effects associate supervisor Shawn Hillier, ILM visual effects associate supervisor Radost Ridlen, ILM environments lead Martin Kolejak, ILM producer Brian Holligan, ESE visual effects supervisor Alex Lemke, ESE visual effects supervisor Michael Huber, and on-set visual effects supervisor Djuna Wahlrab.
New series exploring ILM’s 50-year legacy kicks off with new interviews featuring original Star Wars animator Chris Cassidy and current ILM animation supervisors Rob Coleman and Hal Hickel.
By Jamie Benning
From left: animator Peter Kuran, production coordinator Rose Duignan, director George Lucas, animation and rotoscope supervisor Adam Beckett during production of Star Wars: A New Hope (1977) (Credit: ILM & Lucasfilm).
“ILM Evolutions” is an ILM.com exclusive series exploring a range of visual effects disciplines and highlights from Industrial Light & Magic’s first 50 years of innovative storytelling.
Animation has been woven into the DNA of Industrial Light & Magic’s story since its earliest days. From utilizing legacy techniques in Star Wars: A New Hope (1977) to the groundbreaking blend of live-action and animation in Who Framed Roger Rabbit (1988), ILM has continually redefined the possibilities of visual storytelling.
In this two-part article, we explore ILM’s journey from early work with rotoscoping, stop-motion, and go-motion to the development of sophisticated digital character animation in Jurassic Park (1993), the Star Wars prequel trilogy, and beyond. Part one focuses on the key innovations that culminated in Rango (2011), ILM’s first fully animated feature film. Part two examines how the studio expanded on these foundations in Transformers One and Ultraman: Rising(both 2024), solidifying its role as a leader not only in visual effects but also in feature animation.
Early Innovations and Handcrafted Beginnings
In 1975, as Star Wars, later retitled Star Wars: A New Hope, entered production, Industrial Light & Magic was a fledgling outfit assembled to help realize George Lucas’s ambitious vision. Animation quickly proved essential to the storytelling – Lucas’s needs were varied, including spaceship models firing laser bolts, glowing lightsaber blades, a holographic chess game, and stylized targeting displays.
To create the signature blaster bolts, California Institute of the Arts graduate Adam Beckett was hired in July 1975 to lead a small team in creating the animation and rotoscoping – including a young Peter Kuran. “I was initially shooting wedges and different colors for the laser beams and stuff like that. I was learning to use the equipment. We all were,” Kuran told The Filmumentaries Podcast.
“I actually did the first perspective beams,” said Kuran. “What was being tested was just kind of like back and forth – no perspective on it. I had suggested that we try that, and I actually got a very chilly response. So I decided to stay late one night and do a test and took it to the lab myself. It ran as a daily the next day, and [visual effects supervisor] John Dykstra liked it, so I wound up being the chief of that, at least for the time being.”
The iconic lightsaber effects were outsourced to Van Der Veer Photo Effects for the first film but later brought in-house at ILM. The process began by generating mattes from the live-action prop blades. Early experiments with retroreflective material and spinning poles proved too complex and were eventually streamlined. The mattes were rephotographed and colored frame by frame, with hues used to help audiences distinguish between each character’s weapon – blue for Obi-Wan Kenobi, red for Darth Vader – setting the look for the Star Wars saga for decades to come.
Lightsabers were created with hand-drawn animation in the original Star Wars trilogy, as seen here with Obi-Wan Kenobi (right, Alec Guinness) and Darth Vader (Bob Anderson/James Earl Jones) in Star Wars: A New Hope (Credit: ILM & Lucasfilm).
“At first, ILM didn’t have the resources to do all the opticals themselves,” animator Chris Casady tells ILM.com. “They sent shots out to Van Der Veer, Cinema Research, and Modern Film Effects. Those places were the old guard – they’d done work on Logan’s Run (1976), Soylent Green (1973), that kind of thing.
“But the goal was always to bring everything in-house,” Casady adds. “And once ILM got the optical department up and running in Van Nuys, the quality jumped. We had more control, and it just looked better.”
Beckett, as described by Casady, “was without a doubt a genius. Adam was extremely brilliant. He wanted to be able to put some of his psychedelic style into Star Wars. He thought it was almost an obligation to one-up 2001: A Space Odyssey [1968]. But Lucas wanted something more realistic.”
Casady noted Beckett’s work on the Death Star superlaser charging sequence, explaining that “Adam did a tremendous amount of work putting together that Death Star laser tunnel shot – all those rings and green things flashing down the middle. It’s built up of multiple passes, multiple exposures, multiple pieces of artwork.” The platform on which the live-action actors were standing was completely hand-drawn by Peter Kuran.
Casady added that “Adam’s signature work is the electrocution of R2-D2,” an entirely hand-drawn effect requiring precision to make the electricity feel convincing on screen.
“I really was brought in at a grunt level to make garbage mattes on the animation stand at night to free up the VistaVision cameras in the daytime,” Casady explained. “Every time they filmed the spaceship on stage … everything outside the blue is considered garbage; it’s got to be masked out. So, my job was to make this matte and block out the garbage.
“On film, my mattes fell below the threshold of black, so it became black,” Casady continues. “Famously, when the film was first released on VHS … my mattes were visible in the negative. … The audience saw my garbage mattes as irregular shapes that jumped every six or eight frames. So that’s the only time people got to see my work on the film!”The animation team also solved another subtle but crucial challenge: making the miniature spaceship models feel more plausible in their scenes.
“There was a shot of a TIE Fighter flying past the camera, and they were concerned it looked too flat,” said Casady. “So they asked if we could paint in some reflections – highlights that would suggest the ship was catching light from the environment. It wasn’t baked into the model photography, so we had to add those glints manually, frame by frame, right onto the animation cels. Just little touches of light to make it feel like the ship belonged in that space.”
Animation and rotoscope supervisor Peter Kuran works with an animation camera during production of Star Wars: The Empire Strikes Back (1980) (Credit: Terry Chostner & ILM).
Kuran told The Filmumentaries Podcast, “I just thought that that was something that was needed.”
By the time Star Wars: Return of the Jedi (1983) came around, ILM was called on to create yet another iconic animated visual effect: Emperor Palpatine’s Force lightning. Composed of hand-drawn electrical arcs, the effect required animator Terry Windell to conjure a sense of living, dangerous energy – a visual shorthand for the raw power of the dark side. During his career, Windell brought his animation skills to Poltergeist (1982) and Ghostbusters (1984), among many others.
Though Peter Kuran had since left ILM, his company, Visual Concept Engineering, took on the painstaking task of rotoscoping each frame of the lightsaber combat between Luke and Vader. In total, 102 lightsaber shots were completed for the final film in the trilogy.
While rotoscoping and hand-drawn animation effects remained essential throughout the early 1980s, ILM was already looking ahead, seeking ways to evolve another time-honored technique: stop-motion animation.
As with the lightsabers and blaster bolts, the Emperor’s “Force lightning” in Star Wars: Return of the Jedi (1983) was also created with hand-drawn animation (Credit: ILM & Lucasfilm).
The Rise of Go-Motion
Before work began on Return of the Jedi, “Go-Motion” – a breakthrough in dimensional animation pioneered by ILM’s Dennis Muren, Phil Tippett, Stuart Ziff, and Tom St. Amand – offered a major refinement to traditional stop-motion by introducing motion blur, an effect crucial to achieving realistic movement. Unlike standard stop-motion, where models remain static during each frame’s exposure, go-motion employs stepper motors driven by a motion-control system. These motors subtly shift the puppet during the open-shutter phase, simulating the kind of motion blur found in live-action 24fps cinematography.
“The significance is that we got it working,” Ziff told Cinefex, downplaying the complexity of a system that required months of development before the first usable shot could be captured.
Ziff’s engineering expertise led to the development of a modular rig dubbed the “Dragon Mover,” which connected to the model’s limbs via rods and enabled precise, repeatable motion sequences. Tippett, St. Amand, and Ken Ralston meticulously animated both walking and flying versions of the puppet, blending mechanical precision with handcrafted nuance.
“We started off with some of the more complicated shots,” Tippett told Cinefex, recalling the weeks spent programming movement cycles before finally achieving a fluid, natural gait. This meant that the process became easier over time, a testament to the artists’ dual roles as problem solvers. The result was a new level of fluidity and realism, particularly evident in the scenes featuring the film’s dragon, Vermithrax Pejorative.
The Vermithrax Pejorative in Dragonslayer (1981) (Credit: ILM & Paramount).
Blending Animation with Live-Action: A New Frontier
ILM’s reputation for innovation took a significant leap forward with Who Framed Roger Rabbit. Directed by Robert Zemeckis, the film demanded the seamless integration of hand-drawn, cel-animated characters with live-action performances and practical on-set effects. ILM’s task was to anchor the animated characters convincingly in the real world.
Visual effects supervisor Ken Ralston oversaw the technical and creative challenges of making cartoon characters interact believably with real environments. “The animation had to exist in a real world, with real lighting, perspective, and interaction. That had never been done before at this level,” Ralston told Cinefex.
“It was great for me because I am a huge fan of those early cartoons by the great Warner Brothers directors, Tex Avery and Chuck Jones. And when that showed up with the intent that Bob [Zemeckis] wanted for it, man, that was a match made in heaven. And it was brutal, but it was great at the same time. It keeps you going. And when you see results on something that’s finally coming together, it’s a blast,” Ralston explained to The Filmumentaries Podcast.
Marking a turning point in hybrid filmmaking, they also decided to discard the traditional locked-off camera in favor of dynamic movement. To support this, ILM developed new methods to track live-action camera motion and translate it into data that animators could use to maintain consistent character positioning and perspective. “The opening camera crane shot proved to be historic. … No one had ever done a crane drop with a live-action camera and planted an animated character firmly on the ground,” Zemeckis recalled to Cinefex.
An animation cel from Who Framed Roger Rabbit (1988), created by the team supervised by Richard Williams. ILM was then responsible for compositing the animated characters with the live-action footage (Credit: ILM & Disney).
ILM and the special effects team constructed practical rigs to simulate interactions between live-action props and invisible cartoon characters. In one sequence, when Roger Rabbit turns a water faucet, a hidden mechanism releases a perfectly timed spray – a practical effect used to sell the interaction.
To match the shifting light within live-action environments, ILM tracked moving shadows and highlights, ensuring the animated characters were illuminated just like the actors. “If a light in the scene was swinging, … then the Toon characters would have to be lit in exactly the same way,” said Ralston. Animators relied on detailed lighting references to maintain visual consistency frame by frame.
Performance presented its own challenges. Bob Hoskins, cast as Eddie Valiant, was required to act opposite characters that weren’t physically present. “What I had to do was spend hours developing a technique to actually see, hallucinate, virtually to conjure these characters up,” he told Cinefex. To assist, Charles Fleischer, the voice of Roger Rabbit, wore a full Roger costume off-camera and delivered his lines live. “Although he was on the other side of the camera, I was able to talk to him as if he were right next to me. We could even ad-lib together,” Hoskins said.
After principal photography wrapped, ILM tackled the complex process of optical compositing while Richard Williams’s animation team in London produced the character animation. ILM integrated those elements into the live-action footage. “Every frame had to go through multiple passes to create tone mattes, shadow mattes, and interactive lighting effects. It wasn’t just a matter of drawing the character,” explained optical supervisor Edward Jones. “Every single frame had to be drawn, rechecked, and composited with multiple elements to make sure the animation fit seamlessly into the live-action,” Zemeckis recalled.
The result was a groundbreaking fusion of animation and visual effects that redefined the possibilities in cinematic storytelling. It was a winning combination of traditional techniques and innovation that was widely praised. The film won Best Visual Effects and a Special Achievement Award at the 1989 Academy Awards. Many saw the film as the zenith of the photochemical era, even to the extent that it was perceived as too complex to repeat.
In fact, it wasn’t until a decade later that ILM revisited this hybrid format with The Adventures of Rocky and Bullwinkle (2000), applying many of the same techniques with enhanced digital compositing tools to a new generation of animated characters.
Actor Bob Hoskins (Eddie Valiant) is suspended before a blue screen on ILM’s main stage. In this sequence, his character interacts with animated co-stars Bugs Bunny and Mickey Mouse (Credit: ILM).
When Dinosaurs Ruled the Visual Effects World
While go-motion had proven a valuable innovation throughout the 1980s, it was the advent of computer graphics (CG) character animation that truly revolutionized ILM’s approach in the 1990s. In the last year of the decade, ILM laid the groundwork on James Cameron’s The Abyss (1989), animating the fully CG pseudopod – a water-based, tentacle-like entity. For Cameron’s next film, Terminator 2: Judgment Day (1991), ILM once again raised the bar with the liquid metal T-1000.
It was the digital dinosaurs in Jurassic Park that marked a true turning point – not just in terms of spectacle – but as a clear signal that traditional methods like stop-motion and go-motion were being eclipsed by a new era of photorealistic CG. ILM animator Steve Williams, who had previously worked with Mark Dippé on The Abyss and Terminator 2, pushed the idea of fully computer-rendered dinosaurs further. The results were astonishing. Steven Spielberg’s action-horror hybrid delivered creatures that felt real. Animals that moved and breathed with skin that stretched and muscles that flexed.
As a veteran stop-motion animator, Phil Tippett famously quipped at the time: “I’ve just become extinct.” The line – part joke, part reality – captured the profound shift unfolding across visual effects departments. Tippett’s line was given to the film’s Dr. Malcom, played by Jeff Goldblum.
A computer-graphics Brachiosaurus seen with live-action actors in the foreground in Jurassic Park (1993) (Credit: ILM & Universal).
By the time Jurassic Park hit screens, the industry had begun pivoting decisively toward digital techniques, a shift witnessed firsthand by animator Rob Coleman.
“There were only 6 animators at ILM for Jurassic Park,” he tells ILM.com. “It was the film that inspired me to cut my reel and send it in. … And I came in as ILM’s animator number 9 in October of ‘93 (4 months after the film’s release) when it was still very early days for computer graphics.”
To bridge the gap between stop-motion and computer animation, the team developed a hybrid technique known as the Dinosaur Input Device or D.I.D. This setup used a dinosaur armature fitted with sensors and encoders, allowing animators to physically manipulate the model while their movements were captured and translated into digital data. The goal was to combine the skill and experience of the traditional animators and strengths of the computer artists and technicians. While the results weren’t always ideal – much of the animation still had to be keyframed in the computer – it marked a pivotal step. The future of filmmaking was taking shape, frame by frame.
Animator Tom St. Amand (left) and lead animator Randy Dutra of the Tippett Studio pose with the Dinosaur Input Device (D.I.D.) used on Jurassic Park (Credit: ILM & Tippett Studio).
The Challenge of Digital Characters: The Star Wars Prequels
Following ILM’s work in the 1990s on films like The Flintstones (1994), Casper (1995), Forrest Gump (1994), and Jumanji (1995), George Lucas was getting ready to revisit the galaxy far, far away. This time, with a vision that demanded unprecedented integration of digital characters and live-action performances. The Star Wars prequels would become a proving ground for ILM’s rapidly expanding digital animation capabilities.
Leading that charge was Rob Coleman, by then an animation supervisor at ILM. He found himself tasked with something the company had never fully tackled before: nuanced, verbal performances from fully digital characters who needed to share the screen – and emotional space – with real actors.
“It was all those things, plus we didn’t have a staff that actually had spent their time learning how to do nuanced performances,” Coleman recalls. He would tell director Joe Johnston for Light & Magic Season 2 that it was Dragonheart (1996) that really set the groundwork. “That was a huge leap for us. George was watching, and when he saw Dragonheart, he said, … ‘We are ready to go.’
Draco the dragon (voiced by Sean Connery) flies towards Bowen (Dennis Quaid) in Dragonheart (1996) (Credit: ILM & Universal).
“Most of the people at ILM had been flying spaceships and doing robots and maybe having dinosaurs smash around,” Coleman adds, “but they weren’t doing verbal performances where they were to hold their own with Natalie Portman and Liam Neeson and Ewan McGregor.” And to bring multiple CG characters like Jar Jar Binks, Watto, and Sebulba to life in Star Wars: The Phantom Menace (1999), Coleman had to shift the team’s mindset. His growing team of 65 animators needed to think less like technicians and more like performers.
“We videotaped our actors so we had what they were doing physically, and we could look at them speaking to work out the lip sync. But pretty early on in Phantom Menace, I knew that I wanted to get into the subtext, not just the text. What’s going on inside the heads of the characters. If we could achieve that, we were gonna have believable performances, and the audience would have a connection with Watto, Jar Jar, Sebulba, and Boss Nass in that first film.”
The next major test came with Star Wars: Attack of the Clones (2002) and the digital resurrection of a beloved character: Yoda. Unlike Jar Jar or Watto, Yoda had already been established in the original trilogy as a practical puppet, sculpted by Stuart Freeborn and brought to life by puppeteer Frank Oz. Coleman’s team needed to preserve that legacy while updating the character with a broader range of expression.
“I went back and looked at Empire and it was nothing like I remembered because I’d grown up. It had changed what we expected,” Coleman says. “So what I was trying to achieve is what I remembered Yoda doing in terms of expressiveness and honoring how Frank moved him. Frank actually came by ILM, held up his hand, showed me the position of his fingers inside Yoda’s head. I had him pantomime some Yoda with me so I could see what he was doing.”
To ensure authenticity, Coleman and his team rigorously tested Yoda’s new digital incarnation. He recalls the moment he shared the first test with George Lucas. “There is footage of me presenting the first digital Yoda on the From Puppets to Pixels [2002] documentary. That is the real footage of me doing that, even though I asked the documentary not to shoot it. I’m so happy they did. I was really nervous, and I presented three speaking shots and three non-speaking shots on purpose because I was trying to show them that we could maintain performance without the crutch of dialogue. That was a focused decision because I knew from watching countless movies and TV, editors routinely cut to their action shots – the non-verbal reaction shot. I wanted to earn one of those, and we did.”
Jar Jar Binks (right, Ahmed Best) performs opposite Queen Amidala (Natalie Portman) in Star Wars: The Phantom Menace (1999) (Credit: ILM & Lucasfilm).
That approach paid off. One of Yoda’s most effective digital moments came not during a battle or speech but in a quiet reaction. “There’s a shot of Yoda in Palpatine’s office where Palpatine says something, Yoda’s leaving, and he turns, and he looks over his shoulder, and you can tell he doesn’t trust him,” Coleman notes. “And that’s all in facial performance, all keyframe, frame-by-frame animation. It ended up on the movie poster.”
Coleman’s work continued into Star Wars: Revenge of the Sith (2005), by which point ILM had solidified its reputation as a pioneer in digital character animation. The scope of the prequel work, in retrospect, still feels enormous to the animation director.“I kind of got swept up in it all. Jim Morris [ILM’s general manager from 1993 to 2005] had put me forward for the role. Jim had taken me aside, and he said, ‘I think you’ve got the right temperament to work with George.’ So he sent me over … and dropped me off in London for a two-week interview with George Lucas, which I passed.”
Decades later, Coleman is reflective about the experience. Even as ILM continued to push forward in their abilities to mimic life, it was paradoxically the artists themselves that felt like the imposters. “Twenty-five years on, it’s kind of surreal to think back that I actually did that. I know that’s me. There are pictures of a younger me doing it. And I have all the memories, but sometimes it feels like it was someone else.”
Animation director Rob Coleman at work on The Phantom Menace (Credit: ILM).
Cursed Flesh and Living Tentacles: The Pirates Breakthrough
When Pirates of the Caribbean: The Curse of the Black Pearl (2003) set sail, ILM faced a major challenge. Bringing the cursed crew of the Black Pearl to life wasn’t just about creating convincing skeletons – it was about making them believable next to live-action characters.
Hal Hickel, animation supervisor, explains to ILM.com that “It was a really complicated problem because the idea was that under moonlight these guys are skeletons, but in shadow, they’re flesh and blood.” Each shot became a complex blend of live-action photography and animation, requiring seamless transitions between the two. “You couldn’t just cut to them and show them in full skeletal form under neutral lighting,” he said. “It all had to be motivated by the lighting in the scene.”
The work paid off, but it was only the beginning. For the sequel, Pirates of the Caribbean: Dead Man’s Chest (2006), director Gore Verbinski raised the bar with Davy Jones and his crew. These characters were fully digital – and fully expected to carry the emotional weight of their scenes.
Speaking about Bill Nighy’s portrayal of Davy Jones, Hickel notes that “Bill gave such a brilliant performance. We didn’t want to lose any of the little stuff. The slight squint of an eye, the tiny sneer.” Rather than relying solely on motion capture, the team blended Nighy’s reference footage with keyframe animation, ensuring that none of his subtle acting choices were lost. “We wanted the tentacles to feel alive but they had to support the emotion in his face, not steal focus.”
Davy Jones (Bill Nighy) in Pirates of the Caribbean: Dead Man’s Chest (2006) (Credit: ILM & Disney).
Animating Davy Jones’s tentacle beard posed its own technical challenges. “It was a mix of hand animation and simulation,” Hickel explains. “We animated parts of it for performance reasons, but we also let physics take over for the secondary motion, so it didn’t look fake or overly choreographed.” This approach required close collaboration between animators, rigging artists, and the simulation team to keep everything feeling realistic and responsive.
The complexity of Davy Jones and his crew pushed ILM to overhaul their pipeline. “We had to rethink a lot of how we built and rendered these characters,” Hickel says. Advances made for Pirates laid the foundation for ILM’s later work on projects like Transformers (2007) and The Avengers (2012).
Beyond the technical achievements, Pirates also marked a shift in how digital characters were treated on screen. As Hickel puts it, “It wasn’t just about creating spectacle. Gore trusted us to handle real character beats with these CG characters. It was an amazing opportunity.” Through a mix of performance, artistry, and cutting-edge technology, ILM helped create one of cinema’s most memorable digital villains. They had steered animation into entirely new waters.
The Leap to Full-Length Animation: Rango
After working with Industrial Light & Magic on three Pirates of the Caribbean films, director Gore Verbinski approached the studio with an ambitious proposal: to produce a fully animated feature. He had been particularly impressed by ILM’s work on Davy Jones and believed the studio could bring that same level of sophistication to Rango – a surreal Western populated by anthropomorphic desert creatures.
“We approached Rango the way we approach live-action visual effects,” visual effects supervisor John Knoll told Cinefex, “building out environments with a cinematic mindset rather than adhering to the rigid, modular workflow of conventional animated features.”
A defining innovation was the film’s approach to lighting and cinematography. Renowned director of photography Roger Deakins consulted on the project, bringing principles of real-world filmmaking into the animated space. “We lit Rango the way we’d light a live-action film, with practical principles of cinematography in mind,” Deakins told Cinefex.
Rango‘s (2011) namesake, as voiced by Johnny Depp (Credit: ILM & Paramount).
ILM’s animation director, Hal Hickel, emphasized that they wanted the characters to inhabit their world with mass and texture. “We didn’t want our characters to feel overly polished or weightless,” he told Cinefex. “Gore wanted them to move with a slight awkwardness as if they truly existed in this dusty, unpredictable world.”
“He didn’t want to go head to head with Pixar or Disney or DreamWorks or Illumination. If they’re all over here, he wanted to go over there, aesthetically, in every way,” Hickel tells ILM.com. “Gore understood that the look of the film that he wanted to do was what we ended up calling ‘photographic.’ So not photoreal, but definitely not cartoony – the shot glass with whiskey in it, those kinds of things all had this patina of realism. So that seemed like a really good fit with us at ILM.”
Rather than using motion capture, Verbinski shot sessions with the actors performing together in a theatrical setting simply to inspire the animation. “It wasn’t about mapping motion one-to-one,” says Hickel. “It was about understanding the rhythm, the beats, the subtle mannerisms that would inform the final animated characters.” The result was a film that felt authored – visually distinct and emotionally resonant. For ILM, Rango marked another turning point.
“We knew this was an experiment,” said Knoll, “but we also knew it was an opportunity to redefine what ILM could do. Looking back, I think we did just that.”
Lead animator Maia Kayser at work on Rango (Credit: ILM).
Having left ILM before production on the film, Rob Coleman is still captivated by Rango. “It came about because John Knoll and Hal Hickel built a fantastic relationship with Gore Verbinski,” he says, “and they demonstrated to him through Pirates of the Caribbean that ILM had acting animators, and Gore is an actor’s director. They needed the right director with the right focus and the right mixture of talents and just bravado to say, ‘Yeah, we’re going to do this.’ And to hit ILM at the right time to make it, I think it’s still a marvel. I went back and watched it a couple years ago. It’s incredible what they did and what they achieved.”
“Every animator I know who worked on Rango had a ball and tells me continuously, ‘Gosh. Let’s get another Gore film going,’” says Hickel. “Yeah, they ate it up. He just really wanted people to feel like we were all filmmakers. You’re not the visual effects people up there, and I’m the filmmaker down here. We’re all filmmakers. We’re making this movie together.” That sense of collaboration was an ethos that ILM started in 1975 and continues to carry forward to this day.
Rango went on to win the Academy Award for Best Animated Feature in 2012.
Jamie Benning is a filmmaker, author, and podcaster with a lifelong passion for sci-fi and fantasy cinema. He hosts The Filmumentaries Podcast, featuring twice-monthly interviews with behind-the-scenes artists. Visit Filmumentaries.com or find him on X (@jamieswb) and @filmumentaries on Threads, Instagram, and Facebook.
Guided by visual effects supervisor John Knoll, ILM embraced continually evolving methodologies to craft breathtaking visual effects for the iconic space battles in First Contact and Rogue One.
By Jay Stobie
Visual effects supervisor John Knoll (right) confers with modelmakers Kim Smith and John Goodson with the miniature of the U.S.S. Enterprise-E during production of Star Trek: First Contact (Credit: ILM).
Bolstered by visual effects from Industrial Light & Magic, Star Trek: First Contact (1996) andRogue One: A Star Wars Story (2016) propelled their respective franchises to new heights. WhileStar Trek Generations (1994) welcomed Captain Jean-Luc Picard’s (Patrick Stewart) crew to the big screen, First Contact stood as the first Star Trek feature that did not focus on its original captain, the legendary James T. Kirk (William Shatner). Similarly, though Rogue One immediately preceded the events ofStar Wars: A New Hope (1977), it was set apart from the episodic Star Wars films and launched an era of storytelling outside of the main Skywalker saga that has gone on to include Solo: A Star Wars Story (2018), The Mandalorian (2019-23), Andor (2022-25), Ahsoka (2023), The Acolyte (2024), and more.
The two films also shared a key ILM contributor, John Knoll, who served as visual effects supervisor on both projects, as well as an executive producer on Rogue One. Currently, ILM’s executive creative director and senior visual effects supervisor, Knoll – who also conceived the initial framework for Rogue One’s story – guided ILM as it brought its talents to bear on these sci-fi and fantasy epics. The work involved crafting two spectacular starship-packed space clashes – First Contact’s Battle of Sector 001 and Rogue One’s Battle of Scarif. Although these iconic installments were released roughly two decades apart, they represent a captivating case study of how ILM’s approach to visual effects has evolved over time. With this in mind, let’s examine the films’ unforgettable space battles through the lens of fascinating in-universe parallels and the ILM-produced fleets that face off near Earth and Scarif.
A final frame from the Battle of Scarif in Rogue One: A Star Wars Story (Credit: ILM & Lucasfilm).
A Context for Conflict
In First Contact, the United Federation of Planets – a 200-year-old interstellar government consisting of more than 150 member worlds – braces itself for an invasion by the Borg – an overwhelmingly powerful collective composed of cybernetic beings who devastate entire planets by assimilating their biological populations and technological innovations. The Borg only send a single vessel, a massive cube containing thousands of hive-minded drones and their queen, pushing the Federation’s Starfleet defenders to Earth’s doorstep. Conversely, in Rogue One, the Rebel Alliance – a fledgling coalition of freedom fighters – seeks to undermine and overthrow the stalwart Galactic Empire – a totalitarian regime preparing to tighten its grip on the galaxy by revealing a horrifying superweapon. A rebel team infiltrates a top-secret vault on Scarif in a bid to steal plans to that battle station, the dreaded Death Star, with hopes of exploiting a vulnerability in its design.
On the surface, the situations could not seem to be more disparate, particularly in terms of the Federation’s well-established prestige and the Rebel Alliance’s haphazardly organized factions. Yet, upon closer inspection, the spaceborne conflicts at Earth and Scarif are linked by a vital commonality. The threat posed by the Borg is well-known to the Federation, but the sudden intrusion upon their space takes its defenses by surprise. Starfleet assembles any vessel within range – including antiquated Oberth-class science ships – to intercept the Borg cube in the Typhon Sector, only to be forced back to Earth on the edge of defeat. The unsanctioned mission to Scarif with Jyn Erso (Felicity Jones) and Cassian Andor (Diego Luna) and the sudden need to take down the planet’s shield gate propels the Rebel Alliance fleet into rushing to their rescue with everything from their flagship Profundity to GR-75 medium transports. Whether Federation or Rebel Alliance, these fleets gather in last-ditch efforts to oppose enemies who would embrace their eradication – the Battles of Sector 001 and Scarif are fights for survival.
From Physical to Digital
By the time Jonathan Frakes was selected to direct First Contact, Star Trek’s reliance on constructing traditional physical models (many of which were built by ILM) for its features was gradually giving way to innovative computer graphics (CG) models, resulting in the film’s use of both techniques. “If one of the ships was to be seen full-screen and at length,” associate visual effects supervisor George Murphy told Cinefex’s Kevin H. Martin, “we knew it would be done as a stage model. Ships that would be doing a lot of elaborate maneuvers in space battle scenes would be created digitally.” In fact, physical and CG versions of the U.S.S. Enterprise-E appear in the film, with the latter being harnessed in shots involving the vessel’s entry into a temporal vortex at the conclusion of the Battle of Sector 001.
Despite the technological leaps that ILM pioneered in the decades between First Contact and Rogue One, they considered filming physical miniatures for certain ship-related shots in the latter film. ILM considered filming physical miniatures for certain ship-related shots in Rogue One. The feature’s fleets were ultimately created digitally to allow for changes throughout post-production. “If it’s a photographed miniature element, it’s not possible to go back and make adjustments. So it’s the additional flexibility that comes with the computer graphics models that’s very attractive to many people,” John Knoll relayed to writer Jon Witmer atAmerican Cinematographer’s TheASC.com.
However, Knoll aimed to develop computer graphics that retained the same high-quality details as their physical counterparts, leading ILM to employ a modern approach to a time-honored modelmaking tactic. “I also wanted to emulate the kit-bashing aesthetic that had been part of Star Wars from the very beginning, where a lot of mechanical detail had been added onto the ships by using little pieces from plastic model kits,” explained Knoll in his chat with TheASC.com. For Rogue One, ILM replicated the process by obtaining such kits, scanning their parts, building a computer graphics library, and applying the CG parts to digitally modeled ships. “I’m very happy to say it was super-successful,” concluded Knoll. “I think a lot of our digital models look like they are motion-control models.”
John Knoll (second from left) confers with Kim Smith and John Goodson with the miniature of the U.S.S. Enterprise-E during production of Star Trek: First Contact (Credit: ILM).
Legendary Lineages
In First Contact, Captain Picard commanded a brand-new vessel, the Sovereign-class U.S.S. Enterprise-E, continuing the celebrated starship’s legacy in terms of its famous name and design aesthetic. Designed by John Eaves and developed into blueprints by Rick Sternbach, the Enterprise-E was built into a 10-foot physical model by ILM model project supervisor John Goodson and his shop’s talented team. ILM infused the ship with extraordinary detail, including viewports equipped with backlit set images from the craft’s predecessor, the U.S.S. Enterprise-D. For the vessel’s larger windows, namely those associated with the observation lounge and arboretum, ILM took a painstakingly practical approach to match the interiors shown with the real-world set pieces. “We filled that area of the model with tiny, micro-scale furniture,” Goodson informed Cinefex, “including tables and chairs.”
Rogue One’s rebel team initially traversed the galaxy in a U-wing transport/gunship, which, much like the Enterprise-E, was a unique vessel that nonetheless channeled a certain degree of inspiration from a classic design. Lucasfilm’s Doug Chiang, a co-production designer for Rogue One, referred to the U-wing as the film’s “Huey helicopter version of an X-wing” in theDesigning Rogue One bonus featurette on Disney+ before revealing that, “Towards the end of the design cycle, we actually decided that maybe we should put in more X-wing features. And so we took the X-wing engines and literally mounted them onto the configuration that we had going.” Modeled by ILM digital artist Colie Wertz, the U-wing’s final computer graphics design subtly incorporated these X-wing influences to give the transport a distinctive feel without making the craft seem out of place within the rebel fleet.
While ILM’s work on the Enterprise-E’s viewports offered a compelling view toward the ship’s interior, a breakthrough LED setup for Rogue One permitted ILM to obtain realistic lighting on actors as they looked out from their ships and into the space around them. “All of our major spaceship cockpit scenes were done that way, with the gimbal in this giant horseshoe of LED panels we got from [equipment vendor] VER, and we prepared graphics that went on the screens,” John Knoll shared with American Cinematographer’s Benjamin B and Jon D. Witmer. Furthermore, in Disney+’s Rogue One: Digital Storytelling bonus featurette, visual effects producer Janet Lewin noted, “For the actors, I think, in the space battle cockpits, for them to be able to see what was happening in the battle brought a higher level of accuracy to their performance.”
The U.S.S. Enterprise-E in Star Trek: First Contact (Credit: Paramount).
Familiar Foes
To transport First Contact’s Borg invaders, John Goodson’s team at ILM resurrected the Borg cube design previously seen in Star Trek: The Next Generation (1987) and Star Trek: Deep Space Nine (1993), creating a nearly three-foot physical model to replace the one from the series. Art consultant and ILM veteran Bill George proposed that the cube’s seemingly straightforward layout be augmented with a complex network of photo-etched brass, a suggestion which produced a jagged surface and offered a visual that was both intricate and menacing. ILM also developed a two-foot motion-control model for a Borg sphere, a brand-new auxiliary vessel that emerged from the cube. “We vacuformed about 15 different patterns that conformed to this spherical curve and covered those with a lot of molded and cast pieces. Then we added tons of acid-etched brass over it, just like we had on the cube,” Goodson outlined to Cinefex’s Kevin H. Martin.
As for Rogue One’s villainous fleet, reproducing the original trilogy’s Death Star and Imperial Star Destroyers centered upon translating physical models into digital assets. Although ILM no longer possessed A New Hope’s three-foot Death Star shooting model, John Knoll recreated the station’s surface paneling by gathering archival images, and as he spelled out to writer Joe Fordham in Cinefex, “I pieced all the images together. I unwrapped them into texture space and projected them onto a sphere with a trench. By doing that with enough pictures, I got pretty complete coverage of the original model, and that became a template upon which to redraw very high-resolution texture maps. Every panel, every vertical striped line, I matched from a photograph. It was as accurate as it was possible to be as a reproduction of the original model.”
Knoll’s investigative eye continued to pay dividends when analyzing the three-foot and eight-foot Star Destroyer motion-control models, which had been built for A New Hope andStar Wars: The Empire Strikes Back (1980), respectively. “Our general mantra was, ‘Match your memory of it more than the reality,’ because sometimes you go look at the actual prop in the archive building or you look back at the actual shot from the movie, and you go, ‘Oh, I remember it being a little better than that,’” Knoll conveyed to TheASC.com. This philosophy motivated ILM to combine elements from those two physical models into a single digital design. “Generally, we copied the three-footer for details like the superstructure on the top of the bridge, but then we copied the internal lighting plan from the eight-footer,” Knoll explained. “And then the upper surface of the three-footer was relatively undetailed because there were no shots that saw it closely, so we took a lot of the high-detail upper surface from the eight-footer. So it’s this amalgam of the two models, but the goal was to try to make it look like you remember it from A New Hope.”
A final frame from Rogue One: A Star Wars Story (Credit: ILM & Lucasfilm).
Forming Up the Fleets
In addition to the U.S.S. Enterprise-E, the Battle of Sector 001 debuted numerous vessels representing four new Starfleet ship classes – the Akira, Steamrunner, Saber, and Norway – all designed by ILM visual effects art director Alex Jaeger. “Since we figured a lot of the background action in the space battle would be done with computer graphics ships that needed to be built from scratch anyway, I realized that there was no reason not to do some new designs,” John Knoll told American Cinematographer writer Ron Magid. Used in previous Star Trek projects, older physical models for the Oberth and Nebula classes were mixed into the fleet for good measure, though the vast majority of the armada originated as computer graphics.
Over at Scarif, ILM portrayed the Rebel Alliance forces with computer graphics models of fresh designs (the MC75 cruiser Profundity and U-wings), live-action versions ofStar WarsRebels’ VCX-100 light freighter Ghost and Hammerhead corvettes, and Star Wars staples (Nebulon-B frigates, X-wings, Y-wings, and more). These ships face off against two Imperial Star Destroyers and squadrons of TIE fighters, and – upon their late arrival to the battle – Darth Vader’s Star Destroyer and the Death Star. The Tantive IV, a CR90 corvette more popularly referred to as a blockade runner, made its own special cameo at the tail end of the fight. As Princess Leia Organa’s (Carrie Fisher and Ingvild Deila) personal ship, the Tantive IV received the Death Star plans and fled the scene, destined to be captured by Vader’s Star Destroyer at the beginning of A New Hope. And, while we’re on the subject of intricate starship maneuvers and space-based choreography…
Although the First Contact team could plan visual effects shots with animated storyboards, ILM supplied Gareth Edwards with a next-level virtual viewfinder that allowed the director to select his shots by immersing himself among Rogue One’s ships in real time. “What we wanted to do is give Gareth the opportunity to shoot his space battles and other all-digital scenes the same way he shoots his live-action. Then he could go in with this sort of virtual viewfinder and view the space battle going on, and figure out what the best angle was to shoot those ships from,” senior animation supervisor Hal Hickel described in the Rogue One: Digital Storytelling featurette. Hickel divulged that the sequence involving the dish array docking with the Death Star was an example of the “spontaneous discovery of great angles,” as the scene was never storyboarded or previsualized.
Visual effects supervisor John Knoll with director Gareth Edwards during production of Rogue One: A Star Wars Story (Credit: ILM & Lucasfilm).
Tough Little Ships
The Federation and Rebel Alliance each deployed “tough little ships” (an endearing description Commander William T. Riker [Jonathan Frakes] bestowed upon the U.S.S. Defiant in First Contact) in their respective conflicts, namely the U.S.S. Defiant from Deep Space Nine and the Tantive IV from A New Hope. VisionArt had already built a CG Defiant for the Deep Space Nine series, but ILM upgraded the model with images gathered from the ship’s three-foot physical model. A similar tactic was taken to bring the Tantive IV into the digital realm for Rogue One. “This was the Blockade Runner. This was the most accurate 1:1 reproduction we could possibly have made,” model supervisor Russell Paul declared to Cinefex’s Joe Fordham. “We did an extensive photo reference shoot and photogrammetry re-creation of the miniature. From there, we built it out as accurately as possible.” Speaking of sturdy ships, if you look very closely, you can spot a model of the Millennium Falcon flashing across the background as the U.S.S. Defiant makes an attack run on the Borg cube at the Battle of Sector 001!
Exploration and Hope
The in-universe ramifications that materialize from the Battles of Sector 001 and Scarif are monumental. The destruction of the Borg cube compels the Borg Queen to travel back in time in an attempt to vanquish Earth before the Federation can even be formed, but Captain Picard and the Enterprise-E foil the plot and end up helping their 21st century ancestors make “first contact” with another species, the logic-revering Vulcans. The post-Scarif benefits take longer to play out for the Rebel Alliance, but the theft of the Death Star plans eventually leads to the superweapon’s destruction. The Galactic Civil War is far from over, but Scarif is a significant step in the Alliance’s effort to overthrow the Empire.
The visual effects ILM provided for First Contact and Rogue One contributed significantly to the critical and commercial acclaim both pictures enjoyed, a victory reflecting the relentless dedication, tireless work ethic, and innovative spirit embodied by visual effects supervisor John Knoll and ILM’s entire staff. While being interviewed for The Making of Star Trek: First Contact, actor Patrick Stewart praised ILM’s invaluable influence, emphasizing, “ILM was with us, on this movie, almost every day on set. There is so much that they are involved in.” And, regardless of your personal preferences – phasers or lasers, photon torpedoes or proton torpedoes, warp speed or hyperspace – perhaps Industrial Light & Magic’s ability to infuse excitement into both franchises demonstrates that Star Trek and Star Wars encompass themes that are not competitive, but compatible. After all, what goes together better than exploration and hope?
–
Jay Stobie (he/him) is a writer, author, and consultant who has contributed articles to ILM.com, Skysound.com, Star Wars Insider, StarWars.com, Star Trek Explorer, Star Trek Magazine, and StarTrek.com. Jay loves sci-fi, fantasy, and film, and you can learn more about him by visiting JayStobie.com or finding him on Twitter, Instagram, and other social media platforms at @StobiesGalaxy.
On this day in 1975, Industrial Light & Magic was officially signed into existence by George Lucas.
By Lucas O. Seastrom
ILM’s original crew for Star Wars: A New Hope (1977) poses in the front lot of their original studio (Credit: ILM & Lucasfilm).
50 years ago today on May 28, 1975, George Lucas signed a legal certificate issuing his formal shares of stock ownership in a new company: Industrial Light & Magic. It’s likely the founder affixed his signature without pomp or ceremony. There was too much to do. ILM, as it would come to be known for short, had less than two years to build a visual effects studio from scratch and create nearly 400 shots in a new space fantasy film called Star Wars.
By that time in late May, Lucas had hired John Dykstra to supervise the film’s visual effects. The director had an audacious vision for creating dynamic images of spaceships dogfighting with each other. Lucas wanted the camera to move with the ships, as if the camera operators were up there to capture the action by hand. The idea broke many of the traditional rules in visual effects that typically required locked off cameras to allow for separate elements to be carefully blended together.
Visual effects supervisor John Dykstra poses on the stage next to a TIE fighter miniature (Credit: ILM & Lucasfilm).
John Dykstra was practically the only effects artist in Hollywood willing to buy into Lucas’s plans on the existing terms. He’d gained experience with the type of equipment that would be needed to realize the elaborate shots of custom-built miniatures. Dykstra was also a free thinker with a sense of adventure. There were only a handful of effects companies still operating, and none at a major studio. Most balked at the proposal, decrying its limited budget, tight schedule, and seemingly unattainable goals. So Dykstra was tasked with establishing a new operation.
Lucas was a Northern Californian and planned to base the editorial side of post-production near his San Francisco Bay Area home. He wanted to do the same for visual effects. Dykstra argued otherwise, deciding to keep the new facility in Southern California where he had access to a network of talent and close proximity to third party film processing labs. So it was at some point in late May that Dykstra located and then leased a warehouse in Van Nuys, one of a number of towns that sprawled across the San Fernando Valley, a ways north of Hollywood proper, and conveniently removed from the overbearing presence of the established studios.
Located in an industrial park on Valjean Avenue, just a block from the south end of the Van Nuys Airport, ILM rented a building for $2,300 a month from owner Bill Hanna. It was two stories, made largely of stacked cinder blocks, with a large asphalt lot in front. Inside were a handful of unfurnished offices and open warehouse space with high ceilings ideal for hanging lights. Early on, Dykstra would drive his motorcycle through the building, leaving skid marks on the floor. It was often oppressively hot, even more so once the tungsten film lights were switched on, and Dykstra initially planned to construct a pool onsite, but later compromised with a cold tub that could hold multiple people.
The exterior of ILM’s original studio in Van Nuys, CA. An explosion on the surface of the Death Star is photograped in the foreground (Credit: ILM & Lucasfilm).
“It just popped into my head,” Lucas would recall about the name “Industrial Light & Magic.” “We were sitting in an industrial park and using light to create magic. That’s what they were going to do.”
Initially, Dykstra worked out of Lucasfilm’s offices in a bungalow on the Universal Studios lot, a few minutes drive from Van Nuys. Soon he’d moved to Valjean, working off the floor before furniture was acquired. He was busy recruiting. By early June, modelmakers Grant McCune and Bill and Jamie Shourt were hired, as were production manager Bob Shepherd, technician Jerry Greenwood, first cameraman Richard Edlund, electronics designer Al Miller, and machinists Richard Alexander and Don Trumbull.
As former Lucasfilm executive editor J.W. Rinzler would note in The Making of Star Wars, “They all knew one another and had worked together before.” They’d worked on feature films with Douglas Trumbull (son of Don), or on commercials and other projects with Robert Abel and Associates. A later group would come from another commercial house, Cascade Pictures. Others came straight from universities where they’d studied everything from animation to industrial design. They brought with them aspects of the culture and methodology from these other places, together making something new and unique.
Optical composite photography supervisor Robert Blalack’s Praxis Printer is loaded into the new ILM space (Credit: ILM & Lucasfilm).A view of one of ILM’s shooting stages in the rear of the original Van Nuys studio (Credit: ILM & Lucasfilm).
Before anything else could happen, the Valjean warehouse needed to be converted into production space and workshops. Over six weeks into the summer, they first taped out sections and then constructed the designated areas themselves. On the first floor would be the optical and rotoscope departments, a model shop, machine shop, wood shop, two shooting stages in the rear, and production offices in the front. Upstairs would be home to the animation department, editorial, a screening room, and the art department.
By July, optical composite photography supervisor Robert Blalack and animation and rotoscope supervisor Adam Beckett had been hired, as had a sound recordist and designer who would use ILM’s space as a sometime home base, Ben Burtt. By early August, artist Joe Johnston was setting up the art department (concept artists Colin Cantwell and Ralph McQuarrie had started much earlier, but each worked from home). Within a few months, a dozen people were on board, many of them attracted to join the project out of admiration for George Lucas, whose American Graffiti (1973) had made waves upon its release two years before.
The second floor art department, with storyboard and concept artist Joe Johnston working at a desk in the background as modelmaker Paul Huston looks on (Credit: ILM & Lucasfilm).Film control coordinator Mary Lind in the upstairs editorial department (Credit: ILM & Lucasfilm).
The spaces were ready by mid-summer, but ILM’s work had only just begun. It would take them nearly a year to successfully design and construct an entire visual effects facility and workflow, including miniatures, motion-control camera systems, optical printers, animation cameras, and blue screens. “There’s a significant difference between coming up with a good idea and executing it,” Dykstra would say. ILM’s initial budget was roughly $1.2 million. Although time was of the essence to build the various equipment, distributor 20th Century Fox was slow to provide any initial funds ahead of the main shoot, which would commence in the spring of 1976. So for much of its first year, ILM operated with George Lucas’s personal finances, thanks to the momentous commercial success of American Graffiti.
Former ILM general manager Thomas G. Smith would explain in his 1986 book, The Art of Special Effects, how “Outside, it looked like all the other industrial-style buildings in the valley. Inside, it was staffed with very young technicians, some barely out of college, few over 30, some even under 20 years old…. The doors at ILM were open 24 hours a day; technicians and artists worked without regard to time clocks or job classifications. They were children of the ’60s, and many rebelled against authority figures and traditional work rules. There were no dress codes and no specified work hours; designers built models, and modelmakers ran cameras. But there was a strong esprit de corps and feeling of purpose in the building…. The involvement was with the cause rather than with the money; somehow the group felt they were a part of something really important.”
John Dykstra inspects miniatures of X-wings, TIE fighters, and Y-wings (Credit: ILM & Lucasfilm).The first floor model shop in ILM’s original Van Nuys, CA studio (Credit: ILM & Lucasfilm).
What this group was about to accomplish in less than two years was anything but certain that late spring of 1975. If anything, it was “a long shot,” as Dykstra himself would admit. “It was very, very hard to say specifically what was and what wasn’t going to work before we built it,” he told Cinefantastique in 1977. “So we just had to take a shot at it and all I could do was bluff it and say, ‘Oh yeah, everything’s gonna be fine!’”
As would become the defining element of ILM’s success and endurance, it was the people who made all the difference. “It would be very hard to do Star Wars just by setting up an independent facility unless you had the personnel to do it,” Dykstra said. “The people who designed the equipment and constructed it made it all happen. Not only was it independent of studios but the people who were doing it are the best people in the industry right now.”
What began quietly with a handful of people in a hot, mostly empty warehouse would ultimately do the impossible, not just in the sense of its accomplishments on screen or the resulting accolades, but in its ability to grow, adapt, and continue innovating time and again. That story continues today at the company’s studios around the world. Though ILM has long since outgrown its original warehouse, it still attracts the same intrepid, curious people who bring their passion for image-making and problem-solving to multiple art forms.
Watch ILM’s new celebratory reel in honor of the company’s 50th anniversary:
—
Lucas O. Seastrom is the editor of ILM.com and a contributing writer and historian for Lucasfilm.
The second, and final, part of an extensive look behind the scenes of the visual effects production for Lucasfilm’s pirate-themed Star Wars adventure series.
Still searching for At Attin’s coordinates, Jod (Jude Law) and the kids land the Onyx Cinder on the Observatory Moon, seeking help from an alien, owl-like astronomer named Kh’ymm (voiced by Alia Shawkat). The group treks from the ship to the observatory, a striking sequence that includes visuals of the characters silhouetted against a night sky dominated by a nearby planet.
The scenes were all captured in camera on the StageCraft volume, with the actors walking across a practically built dirt mound and the background displayed on the LED screens. “That was another one of our more successful volume shoots,” ILM visual effects supervisor Eddie Pasquarello says. “Perfect use of that, in my opinion.”
The volume also helped create the illusion of the observatory center rotating within the outer walls.
“That one was the most technically challenging,” says ILM virtual production supervisor Chris Balog. “We had to figure out multiple ways of tracking the camera to make sure that the wall was moving in conjunction with it. For some shots they had a circular dolly moving around the set. So we had to make sure that the wall was moving correctly too.”
The volume was used in 1,565 shots in all, Balog says, and 900 of those shots were in-camera finals.
Like Neel (Robert Timothy Smith), Kh’ymm was also realized using a combination of digital and practical techniques, depending on the scene. In some shots, a practical puppet created by Legacy Effects captured her performance entirely in camera. In other scenes, ILM collaborator Important Looking Pirates created a full computer graphics head composited on top of the puppeteered body or utilized a fully digital replica carefully animated to closely match the movements of the puppet.
The episode concludes with the arrival of a pair of familiar New Republic ships summoned by Kh’ymm. “Of course, we see our first X-wings,” Pasquarello smiles. “That was right in our wheelhouse and fun for everyone to do.”
(Credit: ILM & Lucasfilm)
Can’t Say I Remember No At Attin
The Onyx Cinder arrives at a world that initially looks a lot like At Attin but is actually the conflict-battered sister planet At Achrann, a place where children are trained as soldiers in a war between the Troik and Hattan clans. The kids hike through the decayed remains of a neighborhood and city that once looked like their own. Live-action scenes were shot with minimal sets against blue screen backgrounds and completed with extensive environments created by ILM partner DNEG, including dilapidated buildings and streets, a fully-digital armored assault tank, and a small herd of horned eopie creatures.
The heroes are challenged by a Troik warlord named General Strix (Mathieu Kassovitz) to prove their strength in battle. In exchange, Strix’s daughter Hayna (Hala Finley) takes them to an abandoned tower that may have the coordinates they need to get home. Inside the tower – another set that utilized the StageCraft volume – SM-33 (voiced by Nick Frost) reveals that his previous captain ordered him to destroy the coordinates to At Attin. Fern attempts to override his memory, triggering a hostile response and transformation sequence that required significant digital work by ILM’s Sydney studio.
“Whenever SM-33 goes into attack mode, he’s more CG versus the puppeteered, less-docile version of him,” Pasquarello explains. “When he has those armored plates on, or whenever he grows, that’s all CG.”
The abandoned tower set utilized a mix of 3D elements and backgrounds in the volume along with practical columns, floor, and set dressing.
“I thought it had a really amazing photographic feel to it,” says Balog. “Some of the biggest challenges are blending the volume with the real set. And that’s why the virtual art department is such a key factor, because they have to work hand-in-hand with the set department and the 3D content to make sure the textures on everything look the same.”
“ILM had a really great content team led by [visual effects associate supervisor] Dan Lobl, creating content that is believable and looks real,” Balog says. “We’re not successful unless they’re successful.”
The setting also provides subtle foreshadowing to events that unfold inside the At Attin Supervisor’s Tower in episode eight,” says Pasquarello. “The environment was unique and custom,” he explains. “There’s a deliberate tilt up to the ceiling, and you can see some cables hanging. Those are the remnants of their Supervisor, who’s been totally gutted and ripped out. I think it’ll be fun for people to watch the series again, and they’ll understand.”
(Credit: ILM & Lucasfilm)
Lanupa’s Luxury and Peril
Next stop is a mountain on the planet Lanupa, the site of an old pirate lair that SM-33 believes contains At Attin’s coordinates. It’s also the site of a lavish hotel and spa occupied by high-end patrons, including a Hutt who swallows a Troglof mud bath attendant and a massive, tentacled creature called Cthallops, both achieved digitally with the help of Important Looking Pirates.
Jod is captured by the pirate horde and sentenced to death. He’s allowed a few remaining minutes for a final appeal, measured by an hourglass filled with churning blue plasma. “It wasn’t a fully fleshed-out idea on set. We knew we needed an hourglass, and we would be doing it, but it was just kind of a fun adventure to figure out,” Pasquarello says. “We were trying to do some fun ideas with how the plasma would show the passage of time.”
Successfully navigating a series of booby traps, the children, Jod, and SM-33 enter the subterranean treasure lair of pirate captain Tak Rennod, another set that relied heavily on the StageCraft volume.
“They built the big skull throne that the pirate king sat on,” says Balog. “They had all the treasure in the room, four big columns, and the stairs and the rock when they walked in. Everything else in the cave was created with the volume.”
After finally discovering At Attin’s secret, as well as its location, Jod betrays the children, who escape the lair by sliding down a series of tunnels to the base of the mountain. As Wim (Ravi Cabot-Conyers), Neel, Fern (Ryan Kiera Armstrong), and KB (Kyriana Kratter) figure out how to get back to the Onyx Cinder, they encounter a cast of curious trash crabs.
“They’re not droids,” explains Pasquarello. “They’re literally crabs with garbage on their backs. And that was a lot of work to make that understandable. They’re not synthetic. It’s one of those sequences that is very rich in detail, and there’s a lot going on.”
While the baby crabs are digital, a massive mama crab was created as a detailed stop-motion puppet by Tippett Studio, the production company founded by original Star Wars animator and creature designer Phil Tippett. The beast’s jagged, rusty, junk-laden look prompted the Tippett crew to nickname it “Tet’niss.”
(Credit: ILM & Lucasfilm)
“We generally did the rough blocking of the shots at ILM first,” production visual effects supervisor John Knoll explains. “We figured out what the shots wanted to be, the pace, and how big the creature was going to be. Once we got all those layouts approved, it went to Tippett’s, including all the camera info so they could figure out where the camera was positioned relative to the set and the puppet.”
A low-resolution, untextured 3D model of the mama crab also helped animators work out the creature’s speed and movement in advance of shooting on the stop-motion stage.
“Since stop-motion is very labor intensive, you don’t want to have to go back and reshoot things,” Knoll says. “So we got approval on their preliminary animation, and then they would go in and do the detailed stop-motion. And that was a particularly complicated character because there are so many moving parts on it. Obviously, there are the eight legs, but then there are all kinds of little pieces on it that bounce and move when it starts to walk. I’m impressed that they were able to keep that all straight in their heads.”
The mama crab puppet weighed in at about 15 pounds, requiring support from a mechanical harness that was digitally erased in post-production.
(Credit: ILM & Lucasfilm)
Onyx Cinder Metamorphosis
The kids reach the Onyx Cinder just as an enormous scrapper barge closes in, threatening to pulverize the ship and ingest the remains into its fiery maw. “There’s sort of a tug-of-war between the ship and this garbage muncher,” Knoll explains. When the ship is snagged by one of the muncher’s claw-like arms, Fern decides their only hope for an escape is by triggering the emergency hull demolition sequencer.
A series of rapid explosions ripple down the hull, causing the Onyx Cinder to shed its worn outer shell. A smaller, silver-colored version of the ship is freed and rises out of the debris. “Our code was the ‘ironclad’ and the ‘sleek ship,’” Pasquarello says of the two Onyx Cinder variants. “We went around a lot with the shedding of the hull. We didn’t want it to all blow off and just be conveniently revealed. It had to come off like a snake’s skin.
“And the effects are just dialed up to 11,” continues Pasquarello, who hopes that fans notice a key storytelling detail of the ship’s metamorphosis. “One cool thing that I don’t think everybody knows is that when you transition between the ships, we don’t share all the same engines, but the engines that we do share between the ships change from a warm color to blue.
“One of our challenges was that the sleek Onyx Cinder is a cleaner-burning ship,” Pasquarello says. “The whole conceit was that the engines were that orange color because they were dirty and running bad oil. We kept debating: ‘When would it turn blue?’ The sequence is a very elegant transition shot where you see it sputtering away all of that oil and dirt to the cleaner burning blue that we got.”
Knoll says the transformation was one of the more “complicated” scenes to pull off. “There are a lot of simulation layers that are in there, and the sleek ship doesn’t actually fit inside the armored hull, so there was some sleight of hand that had to happen to make that appear to work,” he explains.
The end result is one of Pasquarello’s favorite sequences. “Every time I watch it, I still get chills,” he says. “It just speaks to the detail that the creators had about this show. They thought of everything. [Jon] Watts was very clear with us that this is why this is happening. And we just had to figure out how to execute that.”
(Credit: ILM & Lucasfilm)
The Return to AtAttin
At Attin’s coordinates in hand, Wim, Fern, KB, and Neel arrive at their home planet aboard the transformed Onyx Cinder. A horde of pirates led by Captain Brutus (portrayed by Fred Tatasciore and performance artist Stephen Oyoung) are not far behind. But the pirates are stopped by the planet’s protective, nebula-like barrier. “Going through the barrier for us was a really big endeavor,” says Pasquarello. “It’s something that started early because it’s so effects-driven and heavy and large scale, and there’s a lot of story to be told in there.”
An array of satellites protect At Attin, blasting deadly arcs of lightning toward unauthorized ships. SM-33 reveals the Onyx Cinder is an At Attin vessel, which allows it to pass safely. The design and function of the satellites – crafted by ILM’s digital modeling department – evolved over time, says Pasquarello. “At one point, the satellites were actually emitting atmosphere. There were versions where you could literally see atmosphere coming out of them to create that cloudy environment,” he explains.
Pirate ships pursue the Onyx Cinder through a toxic swirl of greenish-blue gasses but are destroyed by the satellites. “There’s a lot of heavy, heavy sims [simulations] and work that went into that sequence, and then the landing on At Attin,” Pasquarello says, giving credit to ILM’s compositing and effects teams.
One element featured in the return to At Attin came along late in the production process. With shot delivery deadlines approaching faster than a ship in hyperspace, John Knoll got an email from Jon Watts. “He said, ‘We’ve done animatronic creatures, we’ve done rubber monsters, we’ve done stop-motion creatures. We did miniature and motion control. The only thing we haven’t really done from the old days is a traditionally-painted matte painting. Is it too late to do one?’” Knoll recalls.
With only two months to make it happen, Knoll reached out to former ILM artist Jett Green at her home in Hawaii and asked if she’d like to put her brushes to work creating a traditional oil matte painting of At Attin. Using paint instead of pixels to compose a matte image is something ILM hadn’t done in about 30 years, according to Knoll.
“I love being part of this history,” Green tells ILM.com. “John and I had this conversation about it being a planet. He had the references already, and he told me what he needed. I even built the Masonite panel for it, and it just felt really good.” Knoll now has the roughly six-by-two-foot painting displayed in his ILM office.
At Attin matte painting created by Jett Green (Credit: ILM & Lucasfilm)
Another ILM veteran, modelmaker Bill George, is also credited on Skeleton Crew. George first worked for ILM building models forStar Trek II: The Wrath of Kahn (1982). For fun, he once built a mashup of two similar ship designs: the concept for Han Solo’s original “pirate ship” from Star Wars: A New Hope (1977), and the Eagle from the sci-fi series Space 1999 (1975-1977). He called it the Millennium Eagle.
“Somebody at Lucasfilm saw it,” George says. “I got a request saying, ‘Hey, can you bring that model in? We want to scan it.’”
The computer graphics version of George’s Millennium Eagle model now appears among the ships docked at Port Borgo.
It’s not the first time one of George’s homemade models ended up in a galaxy far, far away. During production of Star Wars:Return of the Jedi (1983) ILM was in desperate need of a new Y-wing model. George offered to bring in the one he’d built years earlier. It was so good, it ended up being used in the film.
Posing as an emissary from the New Republic, Jod gains access to At Attin’s bountiful treasure: 1,139 subterranean, credit-filled vaults. The vault is an entirely digital environment that DNEG populated with security droids, industrial robotic arms, and a seemingly endless supply of golden computer graphics credits that line the walls and spill into Jod’s rapacious hands.
Jod, Fern, and her mother, Fara (Kerry Condon), ascend the Supervisor’s Tower. The Supervisor is revealed to be a large, domed droid with a red eye. Only a small part of the Supervisor droid was constructed physically, with the StageCraft volume completing the illusion.
“Virtual production is the future of visual effects,” says Chris Balog, a 20-year ILM veteran with a background as a digital compositing artist. “It’s where the next evolution is going. And if you can do it successfully, it’s an amazing tool.”
Jod destroys the Supervisor with a lightsaber, triggering a citywide power outage and disabling the barrier satellites, clearing the way for the massive pirate frigate to reach the planet’s surface.
The enormous frigate survives the barrier and floats ominously over the city. “The great effects work done with the frigate coming through the clouds was Travis Harkleroad, our effects supervisor,” Pasquarello says. “Those explosions all come from him and his people.”
The all-computer graphics frigate’s arrival is meant to evoke the alien-arrival feeling of films like Close Encounters of the Third Kind (1977) and Independence Day (1996). “There was no practical frigate,” Pasquarello says. “It’s a gorgeous ship. It’s a very complex-looking ship, and there’s a lower and upper deck that was built inside, and ships and skiffs that come out of that.”
Wim, Neel, and KB devise a two-part plan to rescue Fern and call Kh’ymm for help. Jumping on speeder bikes and pursued by skiffs loaded with angry pirates, the kids – along with Wim’s dad, Wendel (Tunde Adebimpe), make their way across the city.
For close-up shots, the actors were shot on a blue screen stage, with the more dangerous action – like a perilous jump across a canyon – requiring the use of digital doubles. “The speeder bikes on this show were a real challenge in the sense that we can’t put kids into a lot of heavy stunt work,” says Pasquarello. “So there was a lot of work done to help the dynamics and the physics of that chase.”
The action continues through an all-computer graphics forest, through the city, to the school. Pasquarello praises ILM’s animation, layout, simulation, and environments teams for the extensive 3D build. “They’re going through an entirely CG environment, created by the environments team that you just don’t question,” he says. “Not one thing that they fly over or go through is real.”
Summoned by Kh’ymm, New Republic forces arrive at At Attin, attacking the pirate frigate and saving the day. The squadron of X-wings is backed up by B-wings, another fan-favorite fighter that first appeared in Star Wars: Return of the Jedi (1983) and later in Star Wars: Rebels (2014-2018).
“The B-wings were a favorite of mine as a kid, so I did my best to try to get them featured in some big, heroic moments,” says ILM animation supervisor Shawn Kelly. “Initially, we had them dropping bombs on the pirate ship, but [Lucasfilm chief creative officer] Dave Filoni had the great suggestion to try the ‘composite laser’ weapon. Honestly, I had no idea what that was at first. As soon as the meeting was over, I looked it up and realized it’s the ridiculously cool quadruple-beam attack seen in Rebels. I got so excited by the idea that I stayed up late and designed a new shot that could really show off that attack. I felt like I was 10 years old again, playing with my B-wing toy in the backyard!”
Balog would composite the B-wing shot himself, working in collaboration with the FX team to evoke the feeling of the laser as seen in Rebels, but with a more realistic style appropriate for live-action.
The battle-wounded pirate frigate makes a spectacular crash landing, a completely computer graphics sequence that Pasquarello says was carefully designed to depict minimal casualties. “The conceit is that everyone’s been rounded up to a specific space, so we know that everybody evacuated,” he explains. “You notice it doesn’t really tear into buildings as the frigate crashes; it’s just pulling up the street and abandoned cars. It crashes gently into the waterway.”
(Credit: ILM & Lucasfilm)
Galactic Global Effort
Bringing Skeleton Crew to life with its creative mix of old and new took a tremendous amount of effort from artists around the globe. “I worked with a team of 50 animators that were in San Francisco, Vancouver, Singapore, Sydney, and Mumbai,” says Pasquarello. “A big team. We’re one big happy family; we’re all working together to bring these characters to life.”
Knoll and veteran ILM modelmaker John Goodson say they feel lucky to still be bringing old-school ILM effects expertise to new productions. “You know, there’s only a few of us that still know how to do this stuff,” says Knoll. “And part of this for me was, I want to bring some younger people who are exposed to what we’re doing, who are trained up to use the gear so that when I’m not available to do this stuff there are people who know how to do it.”
“We both came here because we wanted to shoot spaceship models,” Goodson adds. “And we’re still getting this opportunity. It’s a phenomenal experience to be able to do this, to take advantage of some of the newer technologies, and revisit this stuff from our past, which is the reason we got in the business to begin with.”
For Shawn Kelly, a 28-year ILM veteran, working on Skeleton Crew was a career highlight. “Our review sessions on this project were by far the most enjoyable, fun, collaborative,” he says. “Watts and Ford are awesome. They have tons of great ideas. They’re really collaborative and open to ideas. It felt like a family just trying to make the best thing we can make all together.”
(Credit: ILM & Lucasfilm)
–
Clayton Sandell is a Star Wars author and enthusiast, TV storyteller, and a longtime fan of the creative people who keep Industrial Light & Magic and Skywalker Sound on the leading edge of visual effects and sound design. Follow him on Instagram (@claytonsandell) Bluesky (@claytonsandell.com) or X (@Clayton_Sandell).
The first part of an extensive look behind-the-scenes of the visual effects process for Lucasfilm’s pirate-themed Star Wars adventure series.
By Clayton Sandell
(Credit: ILM & Lucasfilm)
The sprawling, live-action seriesStar Wars: Skeleton Crew (2024-25) is like a map leading to a visual effects treasure chest. Open it, and you’ll find a trove of 3,200 visual effects shots that seamlessly blend the latest digital artistry along with traditional techniques that both innovate and honor the unique legacy of Industrial Light & Magic.
In creating a new adventure story set in our favorite galaxy far, far away, Skeleton Crew creators and executive producers Jon Watts and Christopher Ford set a delightfully retro tone for the series, which directly informed ILM’s approach to the visual effects.
“Very early on, it was apparent that a big part of the intended charm of the show was that it was going to have this sort of Amblin, ’80s movie sort of vibe to it,” Skeleton Crewproduction visual effects supervisor John Knoll tells ILM.com. “That extends to more than just how you tell the stories. It also extends to choices like embracing animatronics, monsters, and building miniatures and stop-motion creatures.”
Pulling it off would involve hundreds of talented artists at ILM studios around the globe, including San Francisco, Sydney, Mumbai, and Vancouver, along with a few outside visual effects partners.
Over eight episodes, Skeleton Crew follows the adventures of Wim (Ravi Cabot-Conyers), Neel (Robert Timothy Smith), Fern (Ryan Kiera Armstrong), and KB (Kyriana Kratter)—four kids living a peaceful, if mundane, life on their home world of At Attin. After discovering a mysterious buried space cruiser, the four friends unintentionally launch themselves into hyperspace and must find their way home by navigating a dangerous galaxy of allies, enemies, pirates, and monsters.
Early in preproduction on Skeleton Crew, Knoll says the ILM team had to determine the best way to approach the show’s varied visual effects needs. “It just read like an expensive show because of all of the different planets we go to, all the different types of creatures, and the different environments,” explains Knoll, who also serves as ILM’s executive creative director and senior visual effects supervisor. “Trying to figure out how to make that affordable was one of the first things that faced the visual effects team.”
Following a methodology first established duringThe Mandalorian (2019-2023), Knoll says Skeleton Crew production was divided roughly into thirds. “About one-third of it was shot in our StageCraft LED volume, one-third was shot on soundstages with conventional sets, and then one-third was shot on a backlot,” Knoll reports.
Galactic Planet-hopping
Skeleton Crew unfolds across multiple worlds that are brand new to Star Wars, beginning with At Attin. The planet’s suburban-like residential neighborhoods utilized a minimal exterior set located near the California State University Dominguez Hills campus in Carson, California. “There was an undeveloped lot that was just adjacent to the campus that was available. So we shot on that,” Knoll says. The practical parts of the set consisted of only the street, a sidewalk, parts of a few houses, and a small patch of grass surrounded by a large blue screen background, says ILM visual effects supervisor Eddie Pasquarello.
“We added all the trees, houses, skies, and trams,” Pasquarello reveals. Even the street was narrowed. “Some things are not seen, and those are the ones that are the most impressive in my opinion, because you’re not saying, ‘Oh, that’s visual effects.’ We’re hoping people watch the actors and enjoy the story versus worrying about the environment.”
Wim and Neel board a tram for the ride to school, a sequence that introduces the more urban areas of At Attin. Artists digitally extended the school’s exterior—shot on another minimal set—and helped create an expansive cityscape designed to suggest At Attin’s backstory.
“[Jon] Watts wanted it to feel like a place that was built some time ago, but it’s been mostly kept up pretty well. And it’s a place where everyone more or less follows the rules,” says ILM animation supervisor Shawn Kelly.
On the ride to school, Wim stares out the tram’s back window as the vehicle drops into an underground tunnel. After the scene was shot, artists were asked to enhance the movement of both the tram and the camera, requiring complex digital layering work to achieve the right perspective. “We had to split apart all the kids inside the bus to get the proper parallax,” Pasquarello explains. “There’s a ton of artists that helped in layout, and comp and environment—all across the board—that made the shot work.”
Pasquarello says a number of ILM teams also worked throughout the production to develop the right look for At Attin’s city architecture. “This was a really Herculean effort,” he notes. “This is a huge environment build from the team. But it also takes the disciplines of animation and lighting.”
In one shot where a malfunctioning hoverbike leaves Fern and KB stranded on the side of the road, Jon Watts asked ILM to enhance the background with a custom building. “He sent us a photo of a mall,” Pasquarello says. “He said, ‘I kind of want it to look like the mall that I remember as a kid.’ And that’s what that is inspired by. We basically took that photo and ‘Star Wars-ified’ it.”
Neel Nation
One of the earliest discussions among the Skeleton Crew creative team was how to bring Wim’s best friend Neel to the screen. “Neel was a fun and interesting challenge,” Kelly tells ILM.com, noting that the blue elephant-like character is a three-way creative partnership combining Smith’s voice and performance, the work of performance artist Kacie Borrowman, and extensive digital creativity.
“The production was feeling like Neel probably needed to be computer graphics throughout,” Knoll says, explaining that the hours spent applying makeup or prosthetics to Smith would have cut into the child performer’s limited shooting window. “Just seeing how often Neel was going to be on screen—he’s on every other page of every script—he was potentially going to be the most expensive part of the entire show,” recounts Knoll, who set a goal of reducing the all-digital Neel shots by half. “I thought, ‘there’s got to be some practical version of Neel that we can do, at least for over-the-shoulder and wide shots.’”
For that mission, ILM turned to Legacy Effects, a frequent collaborator on Star Wars projects includingAhsoka (2023 – present) andObi-Wan Kenobi (2022). “Neel’s head was built by Legacy as a fully animatronic puppet and was meant to do a lot of the heavy lifting of the performance,” says Pasquarello.
Credit: (ILM & Lucasfilm)
Neel’s many facial expressions developed from an innovative fusion between the Legacy puppet and considerable digital augmentation. “As they started filming the show, everyone fell in love with how the practical puppet face works,” Kelly recalls. “It’s very charming.”
Digital animation took over in scenes where the story called for subtle emotional expressions that were beyond the capability of the puppet, Kelly says, noting that roughly half of Neel’s shots are either digitally augmented or completely digital. “We came up with a bunch of facial expressions,” he explains. “There’s ‘worried.’ We’ve got ‘scared.’ We’ve got ‘sad’ Neel and ‘happy’ Neel, the Neel that we love. Sometimes we just really need to scrunch up his face and we could scrunch it up with or without his ears, things like that.”
Even in shots where the practical puppet head was used on-set, artists digitally erased a small mesh screen on Neel’s trunk that had allowed the performers inside to see and breathe more easily. ILM lead creature modeler Jonathan Sabella also helped digitally sculpt the computer graphics version of Neel to make sure it was identical to the puppet. “That might just be adjusting neck wrinkles or the trunk, and he can shape it back and make it just right or push the emotion even a little further than our out-of-the-box controls could do. Jonathan was a really key part of bringing this together,” says Kelly.
During shooting, facial capture technology created by ILM Technoprops was used to record Smith’s performance. “In the end, we didn’t use the facial capture directly,” Kelly says, explaining that Neel’s expressions were instead crafted by animators in order to more closely match the style of the puppet.
“We could have gone with a bigger performance,” Pasquarello adds, “but a lot of it was really leaning in and matching the aesthetic that was established. If we were to do something beyond that, it felt wrong because we were losing that kind of simple on-set practical aesthetic, which is a very Star Wars aesthetic. It’s always best to have this mix of different techniques happening at once. It creates the best illusion for the audience. It’s hard to pin down what’s going on if some of it’s real and some of it’s not.”
Rise of the OnyxCinder
At the bottom of a forest ravine, the kids discover the entrance to a long-buried, hidden starship called the Onyx Cinder. Wim unwittingly activates the dormant vessel, causing it to lurch skyward with the four kids still on board. As massive layers of soil, rocks and trees cascade off the rising ship, the kids try unsuccessfully to escape. “This was a sequence that went on for a while for us,” says Pasquarello. “Just moving all that earth and lifting that ship and having it turn over was a big challenge.”
Live action plates of the four young actors standing on a small set were completed with an entirely digital environment. “The hatch and the four kids. That’s all we had to work with,” Pasquarello remembers. “They were just standing on a small practical piece of the ship, and then everything else was added around them.”
Digital doubles were also created for all the characters and used throughout the sequence, especially useful for shots that might have been perilous for the young actors. “Sometimes when they’re hanging out of the open porthole, they’re animated,” Kelly says. “The animated Wim is waving to his dad.”
Various simulations—from tree leaves, to swirling embers, dust, and engine vortices kicking up dirt—help complete the sequence. “I think this really shows off the world-class effects team and environment team. I’m just always blown away by this sequence,” says Kelly, noting that many of the forest scenes were created with the help of artists in ILM’s Vancouver studio.
Once in space, the kids discover the ship’s first mate, a droid named SM-33 (voiced by Nick Frost). The character was realized using a Bunraku-style puppet (operated by performance artist Rob Ramsdell) and fully-digital versions, depending on the scene.
The Onyx Cinder first came to life as a 3D computer model built by Rene Garcia and Jay Machado and textured by Kim Vongbunyong. Veteran ILM modelmaker John Goodson then crafted a practical version that included rotating sections and flickering LED lights in the engines. “It’s very old school. It’s all handmade. There are a handful of model kit parts on it for detail. But even a lot of those are handmade,” Goodson says. “It’s styrene and acrylic with an aluminum armature inside of it.” Modelmaker Dan Patrascu also helped build the Onyx Cinder chassis and mounted motors inside the model.
“It gets designed in the art department,” Knoll says. “Then you validate the design, so everybody’s happy with it. John builds his version of it. And then we true up our computer graphics model to match what John did. Something I really liked about the model John built was that the paint finish was beautiful on it. And so that was very extensively photographed and then we re-textured the CG model, based on what John had done.”
The practical model was then mounted on a motion-control rig at ILM’s San Francisco studio, reminiscent of the original Dykstraflex system first pioneered during production of Star Wars:A New Hope (1977).
“[Executive producer] Jon Favreau was pretty enthusiastic about wanting to do this back for season one of The Mandalorian, and I was one of the few people still left at the company that used to do motion-control,” says Knoll. “And we figured, ‘We can make this work.’ Probably the biggest obstacle was budget. The reason that we don’t do this as often as we used to is that it’s more expensive than computer graphics. And the best way that I could figure out how to make this affordable for the show was if this was being done as a garage operation.”
Credit: (ILM & Lucasfilm)
Knoll repurposed the motion-control rig he built in his garage for The Mandalorian, adding the capability to drive more motors on the Onyx Cinder. “The system that I built for season one and two of Mando could drive eight motors,” Knoll recalls. “That gave me track, pan, tilt, and focus, and yaw-pitch-roll on the model. That was sufficient for everything we needed to do with the Razor Crest. But all the engines pivot on the Onyx Cinder, so there are four motorized axes built into the ship. Eight axes isn’t enough to drive all of that. So I expanded the electronics to drive 16 channels.”
Camera moves were first plotted out in Autodesk Maya, approved by the filmmakers, then translated to the motion-control system with a goal of matching a long-established Star Wars aesthetic. “Our approach for the shots that were going to be a miniature is, first—we animate it in the computer, and we figure out, ‘what’s the best way to tell this story?’” says Shawn Kelly. “What’s the coolest camera move that still feels like an original trilogy camera move that tells the story and has the mood that we want, and the ship has the motion that we need, in the path that we need?”
The motion-control system was operated by Lindsay Oikawa Pflum and utilized Canon DSLR camera technology. Each shot required a dozen or so passes to capture varieties in exposure and lighting to give compositing teams more options when layering the final image. And in another throwback to ILM’s early days, converters allowed the use of older Nikon lenses that were used to film models for Star Wars:Return of the Jedi (1983). The final result is a flawless collaboration between the real-world model and digital model, all paying homage to ILM’s legacy.
First Stop: Starport Borgo
The Onyx Cinder docks at a nefarious pirate hideaway, a wretched hive called Starport Borgo where the kids hope to find directions back to At Attin. Built into an Outer Rim asteroid overlooking a sea-blue nebula, Borgo is filled with a host of untrustworthy pirates, creatures, and scoundrels. “It’s just a really beautiful, new place for Star Wars,” says Pasquarello. “Everything outside is computer graphics. When we’re inside in Port Borgo, it’s practical. There’s a lot of storytelling in a very small amount of space.”
Port Borgo scenes relied heavily on ILM’s StageCraft LED volume – located at the MBS Media Campus in Southern California. The environment came to life using a combination of practical sets and virtual backgrounds displayed on the volume screens. The virtual production team relied on two real-time rendering engines, depending on the scene: Unreal Engine from Epic Games and ILM’s proprietary software, Helios.
Skeleton Crew also took advantage of two powerful new StageCraft volume advancements: virtual depth of field and real-time virtual lighting. “Previously, when you used depth of field, the camera didn’t actually make the content go out of focus correctly when the depth of field changed as it just defocused the wall global,” says ILM virtual production supervisor Chris Balog. “Now we’ve added virtual depth of field. So when you change focus, the content defocuses in depth. So virtually now if the camera is focusing on something close to the wall, the 3D content in virtual space close to the stage will be sharper like the set in front of it, and everything in 3D space past that will defocus correctly in depth based on the lens’ focal length.”
A side-by-side comparison demonstrating the practical elements in the foreground (red) and volume elements in the background.(Credit: ILM & Lucasfilm)
The new depth of field capability came with the challenge of how to accurately represent the “bokeh” effect – the quality and appearance of blurred light sources in out-of-focus areas of a shot.
“It gives it more realism because it actually defocuses the way it should. Before, it would just get really soft,” Balog explains. “And now, we are able to do this in a way where it would photographically bokeh like real light sources.”
Real-time virtual lighting gave the Skeleton Crew cinematographers greater flexibility and speed when adjusting practical lights on set, making it easier to match their digital counterparts. “It used to be a much more labor-intensive process, because originally we were baking all the lighting into the original content,” Balog says. “Now, the DPs can get on set that day and say, ‘You know what? I just want to move that light a little bit.’ So we just move the virtual light to work in conjunction with it.”
Creating the content for the volume walls happened near the beginning of a production.
“There’s a team of generalists, or gen artists, who are talented in a lot of different aspects of computer graphics,” Shawn Kelly says. “And while they are working on the environments, me and a few other people are working on populating those environments.”
Wim, Fern, KB, and Neel disembark the Onyx Cinder and hitch a ride on a bubble-like dinghy piloted by a furry Teek ferryman. Dockside, the Teek jumps on Fern’s shoulder to demand payment—a sequence that demonstrates an invisible combination of digital and practical methods.
“He’s mostly a practical puppet up on her shoulder, but his arm is animated. His arm is computer graphics so we can do more delicate kinds of gestures with his fingers and hands,” explains Kelly, “but we still try to animate it in a way that feels like a puppet.”
“We have a great paint team here,” adds Pasquarello. “It was not a big deal to remove that arm and replace it.”
Once the Teek gets his money, he jumps down to leave—a shot that features a flawless “Texas Switch” between the practical and fully digital version of the character. “At the beginning, he’s a puppet. And once he goes behind Fern’s back, he’s animated,” Kelly reveals. The shot concludes with the ferryman scurrying away, mimicking the speedy movements of the original Teek that first appeared in Lucasfilm’s TV movie, Ewoks: The Battle for Endor (1985).
“He’s this little, very fast-moving kind of funny guy,” says Kelly. “It was really endearing and fun, especially when I was a kid. So we wanted to put a little bit of that fast movement into him. And this is a little example of how we kept that flavor.”
Credit: (ILM & Lucasfilm)
Motion Capture Cameos
Motion capture performers help populate the expansive setting with hundreds of pirates. “A place like Port Borgo needs to be a bustling port of pirates doing stuff,” says Kelly. “So we spent months at the beginning getting mocap performances and animating on top of those, and also key-framing guys selling stuff at stalls, or shopping at stalls. You’ll see guys in the background unloading a ship, and there’s a chain of guys throwing boxes to each other, stuff like that.”
The children pass by a seedy nightclub where four-armed aliens are dancing in reddish silhouette through frosted windows. It was Kelly’s job to direct the scene’s motion capture performers, including two unexpected names: Daniel Kwan and Daniel Scheinert, collectively known as The Daniels.
At the time, the directors were helming the fourth episode of Skeleton Crew and would soon win an Academy Award for Best Picture for their film Everything Everywhere All at Once (2022). “The Daniels wanted to perform the dance,” Kelly laughs, recalling how it became his job to direct two of his cinematic heroes on how to be better exotic dancers. “I’d say, ‘I think they want it to be sexier.’ They’d just burst out laughing, and do it again,” Kelly says. “They were really fun and funny.”
Credit: (ILM & Lucasfilm)
Escape from Port Borgo
Reluctantly teaming up with the mysterious Jod Na Nawood (Jude Law), the children escape from the pirate brig and navigate their way back to the Onyx Cinder. As the ship pulls away. it’s snagged by a refueling line connecting it to a floating buoy, snapping it back like a balloon on a string. Jod tries desperately to maneuver away, dragging several pirate vessels with it.
“They’re creating havoc,” Pasquarello says. “The whole idea of the pile up and pulling those ships together was a really fun sequence, because even Jon Favreau chimed in. Everyone had some ideas about how to make that really successful.”
The colliding ships are all-digital creations, with the action handled by a team of artists who are now part of ILM’s Sydney studio. “All of these ships are computer graphics, and the environment itself as well,” Pasquarello says. “These didn’t exist as models from a practical standpoint.”
As the pirates take aim at the Onyx Cinder with a tower cannon, Jod sends the ship into hyperspace. The fuel line snaps violently, whipping back and crashing into the crowded port. “You can see our animated pirates getting knocked down and running away,” Kelly says. Effects passes helped complete the shot with a variety of explosions, fire, and sparks.
The pileup sequence also gives eagle-eyed viewers a chance to catch a special Easter egg—a Starspeeder 1000 transport, well known to fans of the Star Tours attraction at the Disney Parks.
This story was updated with additional information on May 2, 2025.
–
Clayton Sandell is a Star Wars author and enthusiast, TV storyteller, and a longtime fan of the creative people who keep Industrial Light & Magic and Skywalker Sound on the leading edge of visual effects and sound design. Follow him on Instagram (@claytonsandell) Bluesky (@claytonsandell.com) or X (@Clayton_Sandell).
The new experience for the Meta Quest headset will be introduced to fans at Star Wars Celebration Japan.
Industrial Light & Magic and StarWars.com have revealed the newest immersive experience coming to the galaxy far, far away…
Star Wars: Beyond Victory – A Mixed Reality Playset is currently in development for Meta Quest headsets and takes players into the fast-paced, high stakes life of a podracer. Sporting various modes of play, the experience will be introduced to fans at Star Wars Celebration Japan from April 18-20 at the Makuhari Messe Convention Center near Tokyo.
“We’re beyond excited to share an early look at this new experience with the incredible Star Wars community at Star Wars Celebration this year,” says director Jose Perez III. “Our goal at ILM has always been to find new and exciting ways for players to experience Star Wars stories. Focusing on mixed reality has opened several fascinating doors from an immersion standpoint and allows us to literally bring a galaxy far, far away right into the comfort of players’ homes in a way that’s unlike anything we’ve done before.”
Fans attending Star Wars Celebration will find the ILM/Meta activation at Hall 4, Booth #20-5. Along with an introduction to Beyond Victory, they can pick up an exclusive giveaway Marvel comic of the same name. The prequel story to the mixed reality playset is written by Ethan Sacks with cover art (pictured below) by Phil Noto and interior illustrations by Will Sliney, Steven Cummings, and Shogo Aoki.
To learn more about Star Wars: Beyond Victory – A Mixed Reality Playset, visit StarWars.com, and for the latest about ILM’s work in immersive entertainment, visit ILM.com/Immersive.
–
Join creator Dave Filoni, Production Visual Effects Supervisor Richard Bluff, Animation Supervisor Paul Kavanagh, and Visual Effects Supervisor Enrico Damm for a roundtable discussion on the visual effects of Lucasfilm’s hit Disney+ series ‘Ahsoka’.
Six-Part Docuseries Debuts Exclusively on Disney+ July 27
Disney+ released the trailer and key art for Lucasfilm and Imagine Documentaries’ “Light & Magic,” an immersive series that chronicles the untold history of world-renDisney+ released the trailer and key art for Lucasfilm and Imagine Documentaries’ “Light & Magic,” an immersive series that chronicles the untold history of world-renowned Industrial Light & Magic (ILM), the special visual effects, animation and virtual production division of Lucasfilm.
Granted unparalleled access, Academy Award®-nominated filmmaker Lawrence Kasdan takes viewers on an adventure behind the curtain of Industrial Light & Magic. Learn about the pioneers of modern filmmaking as we go on a journey to bring George Lucas’ vision to life. These filmmakers would then go on to inspire the entire industry of visual effects.
The series is directed by Lawrence Kasdan, and the executive producers are Ron Howard, Brian Grazer, Justin Wilkes, Lawrence Kasdan, Kathleen Kennedy and Michelle Rejwan.
All six episodes of “Light & Magic” premiere on July 27, exclusively on Disney+.
Disney+ is the dedicated streaming home for movies and shows from Disney, Pixar, Marvel, Star Wars, and National Geographic, along with The Simpsons and much more. In select international markets, it also includes the new general entertainment content brand, Star. The flagship direct-to-consumer streaming service from The Walt Disney Company, Disney+ is part of the Disney Media & Entertainment Distribution segment. The service offers commercial-free streaming alongside an ever-growing collection of exclusive originals, including feature-length films, documentaries, live-action and animated series, and short-form content. With unprecedented access to Disney’s long history of incredible film and television entertainment, Disney+ is also the exclusive streaming home for the newest releases from The Walt Disney Studios. Disney+ is available as a standalone streaming service or as part of The Disney Bundle that gives subscribers access to Disney+, Hulu, and ESPN+. For more, visit disneyplus.com, or find the Disney+ app on most mobile and connected TV devices.
Greig Fraser on the set of Rogue One: A Star Wars Story. All Rights Reserved.
The cinematographer for Denis Villeneuve’s Dune, and Matt Reeve’s The Batman, joins Industrial Light & Magic’s Publicity Group to discuss his work on Rogue One: A Star Wars Story. Greig shares how the early Kenner action figures inspired his love of Star Wars, and the influences he found in 1970s cinema, the works of Andrei Tarkovsky, and the film The French Connection.
What was your introduction to Star Wars? If I think back about how I was first introduced to Star Wars, I think it had to be through the toys. I genuinely think it was the toys that got me going there. I was two years old when Star Wars came out, and five when The Empire Strikes Back premiered. You couldn’t really call me a “film fan” at that point, but the franchise definitely existed in my universe. I read some of the comics later on, but the thing I loved the most back then were the toys. A few years after, I think ‘82, Star Wars came to Betamax and VHS, and then the year after that, in 1983, I finally saw Return of the Jedi in theaters. It was mind-blowing, because the visual effects that ILM did for it were so revolutionary and groundbreaking. Then over the course of the next ten or fifteen years, I think I watched A New Hope, The Empire Strikes Back, and Return of the Jedi literally hundreds of times.
A selection of Star Wars Kenner action figures available in the early 1980s.
How did the experience of watching the original trilogy influence your work on Rogue One? The funny thing is, when it comes to Star Wars, there is a very particular visual language with the way the films are made. From the way they climb aboard the Millennium Falcon, to the wide shots of the Millennium Falcon going past the camera. There is a visual language that exists that, unless you’re studying it, you don’t really notice it. That occurred to me when we started Rogue One, when Gareth basically told me, “we’re not remaking Star Wars. We’ll make this movie the way we would want to make this movie.” But the thing is, what was great about that, is that we could channel Star Wars. Normally you try to hide your influences; you don’t wear them on your sleeve when you make a movie. You try to become a little more nuanced, a little more “clever” about sort of fooling people into what your influences are. “No, I didn’t actually watch Steven Spielberg films to make this ‘Spielbergian’ movie.” Those sorts of things. But what was great about Rogue One is that we were making a film that actually connected directly into Star Wars: Episode IV – A New Hope, by design. So if we wanted to reference anything from Episode IV, Episode V, or Episode VI, we could. We were actively encouraging ourselves to do it. For me that was a huge revelation, because normally, on any other film, you wouldn’t do that. For example, when we went back and watched Obi-Wan’s sequences aboard the Death Star, we would study how Sir Alec Guinness would move throughout the corridors, and it was very influential in the way that we did some of our movement through the Imperial security complex on Scarif. We took for granted that it was such a big place, and that the Imperials would be minding their own business and doing their own thing, and that you could have these Rebel spies, and have them actively infiltrate this heavily-fortified complex.
Obi-Wan Kenobi uses a Jedi trick to distract a pair of TK Stormtroopers aboard the DS-1 Orbital Battle Station.
Was there a lot of conversations around trying to match the aesthetic of A New Hope? There was. Growing up, you got used to watching Star Wars on Betamax and VHS, on a home television format. For research for this film, I was able to watch a 4K scan of one of the earlier films, and the conversation turned to, “is that our North Star? Do we make it look exactly like that? Do we shoot it on film, with those same lenses?” Sometimes your memory of something can be slightly different from reality, so what we did for Rogue One, is we tried to match it to the aesthetic of our “mind’s eye”, and what we remember from Star Wars growing up. For us, thinking about that look – it wasn’t super sharp, but it had depth and clarity. It was soft at times, but not defunct. That is why we chose the format that we did, the ARRI ALEXA 65, paired with these old lenses. For Gareth and I, it felt like it was showing us the film that we remembered as kids.
Director Krennic is confronted by Darth Vader at Fortress Vader on Mustafar.
Did you find other advantages to shooting digital? Was there ever a conversation of shooting it on film? There were a number of factors. The look we were trying to achieve was one factor, but the other thing that we had to balance towards was the fact that Gareth Edwards is a very hands-on filmmaker. He loves to operate the camera. Watch his film Monsters, which, coincidentally, was the whole reason I wanted to meet Gareth in the first place. When I was called up to do the interview for Rogue One—and of course, I was so excited for the opportunity—I thought, “even if I don’t get this job, I will get to meet the guy that made Monsters. I’ll get to shake his hand, and I’ll get to tell him about the mad respect I have for him and his film.” So when he explained to me that he wanted to make Rogue One with the same spirit that he used to make Monsters, I got really excited. That decision was also part of the reason we chose the ALEXA 65. It had all the film qualities of a much bigger camera, but it was in this bitesize package that you could throw around, and put in cockpits, without having to destroy too many things to get the shot you needed. It was a series of factors, but it all worked in our favor.
A shot from Gareth Edwards’ film, MONSTERS. Photo courtesy of Magnet.
Gareth has a unique style of shooting, where he’ll go from one take to the next without slating. How did your style integrate with that? I found it very exciting. In some ways, even though Gareth was my director, he was also my camera operator. I loved helping him build a world where he could achieve anything that he wanted to achieve; be that handheld shots, or very specific tracking shots. That’s what I loved about Rogue One, and how Gareth wanted to make it. There were considerations, of course, but there were moments of freedom – both in freedom of movement, and freedom of camera. It kept everyone on their toes. He would pick up these small moments, maybe something an actor was doing, and he would get the camera in there and capture it.
Gareth Edwards shoots a scene of Jyn Erso (Felicity Jones) on the set of Rogue One: A Star Wars Story.
Greig, your photography has such a distinct style. What influences did you pull from in designing the palette of Rogue One? I’m a big fan of world cinema, and I’m a big fan of ‘70s cinema. I love Andrei Tarkovsky. I think the way that he makes movies is so beautiful, and so strong. But I also love the way that Kathryn Bigelow shoots her films. I love The French Connection, and the way that it was shot. For Rogue One, we mined the depths of our interests, and the types of films that we loved to watch. Lawrence of Arabia was another influence. These massive, David Lean-style battles. These big frames, and tracking shots, and static shots. Then you combine that with modern-day filmmaking, which, if you look at the evolution of cameras, has changed drastically. Back in the 1950s and ‘60s, the cameras were much larger than they are today, and harder to move around. Therefore, films looked a certain way. When you get into the 1970s, when George Lucas was shooting Star Wars, there was not a lot of handheld in that film either. The cameras were not really malleable, and, stylistically, that wasn’t really what he was after anyway. What was good for us though is that we were able to combine our interests and influences. Gareth and I clearly love Star Wars, but that is not the only thing we’re influenced by. French cinema, documentaries, all of that played a part for us.
An image of Baz Malbus (Jiang Wen). Photo courtesy of Greig Fraser. All Rights Reserved.
Tell me about the early conversations around virtual production and LED walls on Rogue One, and how that got us to today with ILM’s StageCraft? This is where having amazing partners, like Industrial Light & Magic and John Knoll, was very integral. What we were pitching was not a common thing. Emmanuel “Chivo” Lubezki had played around with something similar on the film Gravity, with putting actors in an LED box, but we were talking about putting people into ships and big environments. It all stemmed from a lighting problem, and the problem goes like this: “you’ve got somebody in an X-wing above a planet. We’ll use Earth as our stand-in for Scarif. You’ve got a sun source, you’ve got ambient light bounce from Earth, and then you have black space. When you’re in the atmosphere, you have all of this beautiful light coming from above, and below, and from your sun source. That type of scenario is really easy to light. But what happens when you’ve got no ambience above, some ambience below, and then a sun source? Now, imagine those lighting conditions, and pretend you’re in the cockpit of that X-wing, and you do a barrel roll. As you spin around, it’ll transition from light to shadow on your face and around the cockpit. To try and do that in a studio environment, with the lighting we have, is very difficult. You have to put diffusion on all sides to make it nice and soft, so when you sequence the lights over the top, you get the illusion of camera and lighting movement. But what happens when you push light through the diffusion? It bounces back from the other side. With that said, I needed a black side and a light side, but then, of course, that wouldn’t have worked for the barrel rolls, because the light would have needed to move. The one thing we had at the time that could account for all of this were LED screens. When the light turns off on an LED screen, it’s pitch black. It’s the perfect lighting tool for that type of thing. That then progressed into the next question, “if we’re going to use that tool, for that one instance, can it work for other scenarios? Like flying across Jedha, or soaring through the atmosphere of Scarif?” That’s where this tool, this LED volume, became immensely helpful. People like John Knoll, and the people at ILM, are extremely integral to getting the quality right for something like this. Good VFX can live or die by bad lighting. That’s why ILM’s StageCraft is such a powerful tool for DP’s. Because DP’s know, if you can get the lighting right, you’re halfway there to getting a good final image.
The partial hull of a T-65B X-wing starfighter used for shooting on the set of Rogue One: A Star Wars Story.
That must have been exciting to figure out? It was such a great project, because it really upheld the vision that George Lucas had for the future of filmmaking, the “stage of the future”. George theorized that, years down the road, there might come a time when a filmmaker could walk onto a stage, and they could project whatever they wanted up onto the walls, or that those walls could have color-changeable light. They wouldn’t have to light for it, they’d only need to flick a switch. That was the hopeful future that George was thinking about, and now, years later, ILM made that a reality with StageCraft. Filmmakers now have the ability to put any high fidelity, real-time image up on the LED volume. Rogue One was the proof-of-concept for lighting, and that evolved into what ILM, John Favreau, and the Lucasfilm team are doing on The Mandalorian, along with so many other exciting projects.
An early LED volume used on the set of Rogue One: A Star Wars Story.
George referenced a lot of things for his aerial combat, including old WWII gun camera footage. How did you approach the ships flying in Rogue One? While we were shooting, it became obvious where the camera could be, and where it couldn’t be. In Star Wars, there were never any mid-shots of people sitting in cockpits. You don’t have Han Solo in a mid-shot, shooting from outside of the cockpit. You never had a camera floating in space for a shot like that. The camera was always fixed inside the cockpit, or super-wide. There was no in-between. It would never go from a super-wide, into a mid-shot, into a closeup. The only example of that might be the final shot of the Millennium Falcon, just before Lando departs the Medical Frigate, at the end of The Empire Strikes Back. With that said though, we tried to maintain those parameters for Rogue One, and we didn’t want the audiences to have to think about it. I haven’t spoken to George Lucas about it personally, and maybe if he would have had infinite resources he might have shot it differently, but we wanted our film to match A New Hope, and we loved the look. It built our visual understanding of what a Star Wars film should be.
Jon Vander’s “Gold Squadron” forms up as they prepare for their assault on the Shield Gate during the Battle of Scarif.
There’s something intimate about it. When I think about old WWII air combat movies, they did the same thing. Exactly. And they were forced to shoot like that. You either had a camera in the cockpit, or a camera on another plane. You couldn’t get a plane in close enough to get a reaction from a pilot, or you’d have planes crashing into each other. It was either super-wide, or close. It was purely pragmatic.
Red Twelve (Richard Glover) participates in the Battle of Scarif.
You did have a unique shot that was used a few times that I loved, and that was the one of the camera fixed on the X-wings and Y-wings, directly behind the astromech droid. Gareth was clever, because even though we had these rules on how we would shoot the ships, we would work off moments from the earlier films to devise new things. There’s that shot of R2-D2 getting blown up in A New Hope by Vader in the Death Star’s meridian trench, and this was kind of an evolution of that shot, while still keeping one foot planted in that A New Hope aesthetic.
A T-65C-A2 X-wing starfighter drops out of lightspeed at the Battle of Scarif.
How did it feel with The Force Awakens shooting alongside your film, and to a degree, The Last Jedi too, when you were shooting pickups? It was fun. We were all sharing buildings and in each other’s worlds. I’m such a big fan of Star Wars, and I could have walked on set and spoiled everything for myself, but I chose not to. I just wanted to enjoy them as a fan. I did have one thing spoiled for me… someone walked up and told me the scene regarding Han Solo, and my first reaction was, “how dare you do that to me! I wanted to see that in theaters!” [laughs]. We shared some crew from time to time, but we generally had blinders on for Rogue One. While they were making their films in the Skywalker Saga, decades in the future, we were leading right into A New Hope, so ours was almost the equivalent of a period film, in our language. I found that to be very exciting.
Greig Fraser on the set of Rogue One: A Star Wars Story.
What’s your favorite shot, moment, or sequence in the film? One of my favorites is that wide tracking shot of Jyn Erso (Felicity Jones) making her way through the Massassi outpost on Yavin 4 after she’s “rescued” from the Wobani Labor Camp. I also love the final sequence with Vader aboard the ‘Tantive IV’. When Gareth rang me to tell me we were going to do that, I was ecstatic. It’s such a wonderful sequence. We had the time to prepare it properly. We had the time to rehearse all the action, and to do the lighting tests. We also spent a lot of time figuring out how best to light Vader. As a kid in a grown man’s body, that blew me away. Vader, this dark “shape”, terrified us as kids. It was a dream come true to add to his iconography. I felt very honored and very blessed. Another moment I loved was seeing the full-sized X-wing props in person for the first time. I was transported back to being a kid again, playing with my toy X-wings, but then, of course, my filmmaker brain would kick on, and let me tell you, moving full-sized X-wings around on a set is pretty difficult [laughs].
Vader ignites his lightsaber in an attempt to capture the stolen plans to the Death Star aboard Admiral Raddus’ star cruiser.
I love the sequence you shot in Iceland of Orson Krennic and the Death Troopers making the long trek up to the Erso homestead from the shuttle. His cape flapping in the wind, it was incredible. I love that shot too. An interesting thing about that sequence is how we found that location. In that part of Iceland, there’s all of this black sand, so they plant this weed to prevent it from blowing onto the roads and destroying the cars. It’s basically useless outside of keeping the sand from blowing about. We found that location on Google Earth while we were driving around, location scouting. I thought it looked so unusual and interesting. As soon as we dropped the moisture vaporators in, those weeds started looking like crops that the Erso’s were farming, and it instantly became Star Wars.
Director Krennic and his personal attachment of Death Troopers storm the Erso homestead on Lah’mu.
Hal Hickel climbs aboard a T-65C-A2 X-wing starfighter on the set of Rogue One: A Star Wars Story.
Hal Hickelspeaks with ILM.com to discuss the process of bringing to life a reprogrammed KX-series security droid, along with his work on the pivotal space battle featured in Rogue One: A Star Wars Story.
Tell me how K-2SO came to be? It was a whole journey. When we started the project, even before Alan Tudyk was cast, Gareth was very keen to explore the idea of a droid with an expressive face. Strictly speaking, that would generally be outside of the style book of Star Wars. Droids in Star Wars typically are industrial, with very simplistic designs. Even ones that are anthropomorphic, like Threepio, don’t have moving face-parts. Even their eyes don’t move. That’s just Star Wars. But we thought, “hey, this is interesting. Let’s look into this.” We did some tests and things. Part of the problem though is that if you’re going to go down the road of an expressive metal droid face, you’re dealing with hard-surface pieces, not rubber skin. You really have to get quite detailed before you can get into something that can express emotion. You have to have, at minimum, eyebrows that can make expressions. A mouth that can do the same. There’s more than that, but those are the basic things. You also can’t just go in a little bit, you have to go quite a ways down the road. With that said, some of those movements can start to feel overly complex, and not very Star Wars.
Jyn Erso (Felicity Jones), and K-2SO (Alan Tudyk), during a scene together in Rogue One: A Star Wars Story.
When was Alan Tudyk brought in? He came on during that time period when we were figuring out K-2’s facial movements. I took an audio clip of Alan from his web series, Con Man, and did a quick animation with just the minimum of some eye blinks and eye rotations. It looked good, and it became a talking point, so I traveled out to the UK where shooting was being prepped. Alan was there, and he was getting fitted with the K-2SO stilts by the Creature Shop. We had a production discussion about the animation, and we felt that the blinks pushed it a little too far into “cartoon animation” territory, where you had expressive elements that don’t have an otherwise mechanically practical reason for being there. You could argue that there would be little shudders to protect the eyes from dust, but the idea of them blinking from an expressive standpoint pushed it into a different realm. What we did love though was that the eyes could rotate. While it didn’t communicate emotion, it did communicate a cognitive function. The character is thinking and their eyes are kind of darting around in a quiet moment, and you can see their wheels turning. So we kept that. Again, it went from, “let’s make him really expressive”, and then sort of going the other way with it and saying, “well, let’s move him back towards a Star Wars aesthetic.” We did really want to have a face part though that the protocol droids didn’t have. There was a droid, EV-9D9, who was Jabba the Hutt’s chief of cyborg operations at his palace. She also had an appearance in The Mandalorian Season One and Season Two as a bartender at Chalmun’s Spaceport Cantina in Mos Eisley on Tatooine. She had a little flap for a lower jaw that would move up and down. We tried that on K-2. He had a little block that was part of his design, and we tried animating that. It would basically click open when he was talking, and then click closed again when he was done. But again, it didn’t make him expressive, and it didn’t add anything to the performance. We knew it was K-2 speaking, we’d recognize his voice, so we did away with that.
Cassian Andor (Diego Luna), Jyn Erso (Felicity Jones), and Alan Tudyk in his K-2SO mocap costume.
We ended up bringing Alan to Industrial Light & Magic, and we spent several hours with him on our motion capture stage. It was the first time he got to wear and walk around in the stilts. It was also where we did a real-time retarget to a simplified version of the asset. Alan could see himself on the screens, and it was a bit like an actor trying on a costume, or looking at themselves in a mirror and figuring out how to carry themselves. He was able to spend a lot of time figuring out how robotic to act versus how natural. It was super useful because he could stow that experience away. He wouldn’t be able to see that on set, or on location, but what he could do is build that exercise into the performance; what the character is for him, just by doing it for a few hours on our mocap stage. Two weeks later we were shooting in Jordan for his first scene, and he was able to tap directly into that.
Alan Tudyk, standing on stilts in his K-2SO mocap costume, chats with Cassian Andor (Diego Luna).
I also understand that you had two shots of K-2SO in the film that were rendered in real-time, is that correct? That’s correct, we did. We shot two scenes of K-2 from behind, because at the time, we had yet to find a solution for his luminous eyes, and the refractions, and those sorts of things, but with a little more time we could have sorted that out. Those two shots though were rendered in real-time. There was no demand from the film that we do that, but instead we did it because it was technology that we really wanted to push forward. With the convergence of games and offline traditional visual effects, we knew we wanted to keep pushing into that space, so we worked really hard to do that in a few shots.
Alan Tudyk sits in the practical cockpit of the UT-60D U-wing, ‘LMTR-20’, at Eadu during Operation Fracture.The empty plate photography of the U-wing cockpit with the background comped in.The final shot with K-2SO included, and atmospheric effects comped in.
Tell me more about your work on the Battle of Scarif? That was a great experience because I got a rare opportunity to contribute to the story. Working in visual effects, we are involved in projects from beginning to end, but we are mostly thought of from a post-production standpoint. John Knoll is an outlier on Rogue One because he conceived the story, but generally, we aren’t involved in the story aspect. Some yes, (it depends on the project), but quite often, no. What happened though is that John and I started to have these story meetings with Kiri Hart, Pablo Hidalgo, and Dave Filoni, to figure out what would be happening in this battle. “What are the stakes? Who’s doing what? What is Admiral Raddus up to? How is he communicating with the Rebels planet-side?” That was super fun for me, because as I said, not every project affords me with the ability to contribute at the story-level. Out of that, John had a concern about the specifics of the battle that were outlined in the opening crawl of Star Wars: Episode IV – A New Hope. It says “Rebel spaceships, striking from a hidden base, have won their first victory against the evil Galactic Empire.” We started to ask, “What was that victory? Is it just getting the plans, or was it a large-scale military victory as well?” We felt that we needed to make good by that line.
The Alliance High Command, led by Chancellor Mon Mothma (Genevieve O’Reilly), discuss the threat of the Empire.The Alliance Fleet drops out of lightspeed above Scarif.Baze Malbus (Jiang Wen) fires his HH-12 rocket launcher at an approaching All Terrain Armored Cargo Transport on Scarif.General Antoc Merrick and Blue Squadron come to the aid of Rogue One at the Empire’s security complex on Scarif.
So how did you do it? Well, we felt there needed to be a moment in that battle where the Rebel Alliance lands a significant blow against Commander Cassio Tagge’s starfleet. There’s that great moment from the Death Star conference room scene in A New Hope, where Admiral Motti reminds Tagge that the Alliance is “Dangerous to your starfleet, Commander. Not to this battle station.” We wanted to honor that too. John came up with this great idea of colliding a pair of Star Destroyers into the Shield Gate and knocking the planetary defense shield out. So if you think about it, the Rebels took down two of the fleet’s prized Star Destroyers, destroyed their shield generator and space station, forced Tarkin to obliterate his own security complex on Scarif, and they also managed to steal “Stardust”, the technician readouts to the Death Star. We felt that that was a satisfying victory for the Alliance.
General Cassio Tagge (Don Henderson) warns Admiral Conan Antonio Motti during Star Wars: Episode IV – A New Hope.
How did you realize the sequence of the Star Destroyers, ‘Persecutor’ and ‘Intimidator’, colliding? I handed that off to a great Animator by the name of Euising Lee. He’s a terrific artist, and he’s especially gifted in his ability to realize spaceship action, and also camera work. He was able to take the idea and just run with it. He made a mini feature out of it; just a huge meal of all these shots. We showed it to Gareth, and kind of boiled it down into the shots that we wanted and made a shorter version of it. But he really took John’s idea and pushed it forward visually into a really terrific series of shots. That was a really fun process. The whole space battle was tough, because, as John previously mentioned, there were a lot of moving parts. “When are we with the action on Scarif? When are we with Raddus? When are we with the fleet in battle?” It was tough because you can’t kick out little iterations of shots. It’s laborious to reanimate an entire chunk of space battle to see how it plays. So we tried to repurpose old pre-vis that sort of fit the bill, and then we’d quickly do temporary versions of shots to fill holes and give editorial something to plug in to figure out when we were going to be and where, and more importantly, what the goals were. The whole thing with Admiral Raddus waiting for the transmission from the squad on Scarif seems obvious, but there were versions of the space battle that didn’t play out like that, where instead he was directing the fleet and just trying not to get blown up. A lot of this gelled out of story meetings, and the work that Gareth Edwards was doing, and Tony Gilroy too. The battle took awhile to come together, but the center piece – the great moment where it all goes silent when the ships are falling, and they puncture the Shield Gate. It turned out perfectly.
‘Persecutor’, an Imperial I-class Star Destroyer is pushed into ‘Intimidator’ by a Sphyrna-class Hammerhead corvette.
How did it feel to finally see that sequence? The thing is, when working, sometimes late in post we might get to hear music that’s being developed, but more often than not we just hear the scratch sound design, and we don’t hear the music until it’s in cinemas. Let me tell you, sitting in the theater at the premier, and that moment in the scene when it goes quiet, and Michael Giacchino’s score swells, and the Star Destroyers are plunging down into the Shield Gate, I just thought, “my god! What a moment.”
Hal Hickel holds a prop of the data-tape containing “Stardust”, the codename for the technical readouts to the DS-1.