How Unreal Engine is Used Outside the Gaming Industry

The Unreal Engine has long been a symbol not only of game development, but also found wide application in various industries. Epic Games offers numerous opportunities for using its technology in the film industry, automotive manufacturing, and other fields. In this article, the editorial team of "Gamedev" Skillbox Media examines examples of Unreal Engine use outside the gaming industry, demonstrating its versatility and power.

Animation

Unreal Engine is ideal for creating CG animation thanks to its flexible toolset. The editor features a powerful Sequencer tool, which allows you to develop video sequences directly in the engine. In addition, mocap support, the proprietary Niagara particle system, and other tools for creating special effects make the animation process more efficient and diverse. The visual component of animation depends solely on the author's imagination and skill: both photorealistic 3D graphics and various stylized versions are available, opening up wide creative possibilities. Using Unreal Engine in CG animation production ensures high quality and variety of visual solutions.

Frame: short film Slay

In 2021, Mold3D studio presented the short film Slay. This educational project is designed for both beginners and professionals and is created using mocap. Slay demonstrates the capabilities of CG animation in Unreal Engine, highlighting the advances in computer graphics and animation. The short film serves as an excellent example of how modern technologies can be used to create high-quality content.

The team worked on Slay during the pandemic, and the remote format did not affect the quality of the animation. The studio efficiently coordinated the stuntmen's motion capture via Zoom, while simultaneously viewing the results in the editor. This allowed for making necessary adjustments during live filming. Facial animation of the characters was recorded using the Live Link Face mobile app for iOS, which ensured high accuracy and realism of movements.

You can participate in different aspects of production simultaneously. For example, you can start working on the visual component earlier than the standard pipeline suggests, while simultaneously working on character animation. This allows you to maintain variability in the choice of composition, timing, and lighting. You can change the angle and concept without having to completely redo the project, which significantly speeds up the process and improves its quality, explains Edward Quintero, CEO of Mold3D Studio.

Film industry

Virtual Production, a technology that allows you to combine real objects with computer graphics, is increasingly being used in the production of blockbusters. The use of Unreal Engine significantly improved this process by rendering scenes in real time, creating the conditions for more realistic visualization. Key aspects of this technology include support for LED panels that reproduce virtual locations and tracking systems that ensure precise interaction between real and digital elements. This opens up new horizons for filmmakers, allowing them to create immersive and believable visual effects.

Still from the set of the series "The Mandalorian" Photo: Epic Games

An innovative approach to The virtual production approach was developed during work on The Mandalorian. To make the filming process more interactive, showrunner, writer, and co-producer Jon Favreau brought in specialists from Epic Games. This move marked a significant milestone in the evolution of filmmaking technology, enabling the creation of more immersive and captivating visual effects that significantly enhance the quality of the final product. Collaboration with Epic Games opened new horizons for virtual production, which has become a significant trend in modern cinema.

The scenes were filmed on a set surrounded by large LED panels. During filming, the Unreal Engine editor was used, running on four synchronized computers, providing a live broadcast of the virtual background on the LED panels. Three operators simultaneously controlled the virtual stage, lighting, and effects, achieving a high degree of interactivity. The filming crew was able to make changes on the fly using iPads, coordinating the process with the director and cinematographer. This approach to filming significantly increases work efficiency and the quality of the final product, making it relevant in modern filmmaking.

The benefits of combined filming extend far beyond creating spectacular shots. The team was able to iterate on takes in real time, eliminating the need for on-location filming. Using Virtual Production technologies, more than half of the series' first season was filmed. This approach not only optimizes the filming process but also significantly reduces costs, making it attractive to modern producers and directors.

Virtual Production is an effective solution for actors, allowing them to move freely around the set. Even if the set is designed only for interactive lighting, the actors find themselves in a unique environment where they can see everything happening around them. Being close to the LED panels activates their peripheral vision, allowing actors to be aware of the horizon and feel how the light falls, even with minimal lighting. The powerful interactive lighting emanating from these LED panels opens up new horizons in the film industry. This is a truly significant breakthrough that changes the approach to filming and improves the quality of interaction between actors and the environment.

This aspect can be misleading for viewers. On set, studio representatives came to me and expressed surprise at the set, saying: “I didn’t expect you to have so much decor.” I replied: “Actually, it’s just a table.” "Thanks to parallax, the scene looked like it was being filmed live when viewed from a different angle," Jon Favreau shared. Several years have passed since the release of the first season of The Mandalorian, and today, advanced Virtual Production technology is actively used not only by Lucasfilm, but also by studios such as Industrial Light & Magic, WetaFX, Method Studios, and Framestore. This technology is also widely used in the creation of music videos, promotional videos, and television programs, which testifies to its versatility and demand in various areas of the film industry. Virtual Production allows for the creation of high-quality visual effects and improves the filming process, making it an indispensable tool for modern creative projects.

TV Shows

Large foreign TV channels, in addition to Virtual Production, are actively using Mixed Reality technology. For example, the American channel The Weather Channel transformed its weather forecasts several years ago, adding realistic visualizations of hurricanes, floods, forest fires, and other natural disasters to the announcers' speeches. It is difficult to convey the scale of natural phenomena in words, and such video footage helps viewers better understand the real picture of what is happening. The use of Mixed Reality allows TV channels to create more exciting and informative content, which increases audience engagement and makes broadcasts more attractive.

Everything you do happens in real time, which allows you to constantly change events and watch them unfold on the screen. Working with this technology is a pleasure. It's impressive that everything looks realistic enough, which makes it possible to effectively convey information to people, - said Nick Winemiller, creative director of The Weather Channel, explaining his choice in favor of Unreal Engine.

Concert programs

Unreal Engine offers support for nDisplay, a rendering system capable of broadcasting content in any resolution to multiple monitors or projection screens. This feature allows you to play content from different networked devices or Unreal Engine editors running on a single workstation. nDisplay is ideal for organizing spectacular concert programs, providing high-quality images and synchronization between screens, making it an indispensable tool for creating immersive spaces and large-scale visual performances.

In 2016, 2n Design and WetaFX created an innovative interactive show commissioned by Donald Glover, known by his stage name Childish Gambino. As part of this project, the artist's performance was complemented by dynamic visualization projected onto the ceiling of the concert hall. To achieve high-quality content broadcasting, five powerful NVIDIA Quadro P6000-based computers and twelve projectors were used. The result was adapted to the dome format using a fisheye effect, which made it possible to create a unique spectacle. This show became a striking example of the synergy of music and visual technology, attracting the attention of both fans and professionals in the field of audiovisual arts.

Donald's stage performance is a unique combination of lighting, smoke, lasers, a band, and the energy of the crowd. It's a breathtaking spectacle when all the elements come together. I'm still amazed that we were able to realize this concept. Modern tools like Unreal Engine open up endless possibilities for creating such spectacular shows, - said Keith Miller, VFX Supervisor at Weta Digital.

Architecture

The engine is actively used in architectural projects due to its ability to support the import of 3D models, technical drawings, and building information models (BIM). This technology also enables the processing of large volumes of data, which is crucial when creating 3D visualizations for large cities. Using the engine increases the accuracy and efficiency of design and improves collaboration between various stakeholders. The Japanese company CAD Center has created 3D maps of Osaka and Tokyo using Unreal Engine and Twinmotion technologies. These projects are in demand among organizations involved in urban planning and infrastructure development. 3D maps allow for more effective visualization of urban planning solutions and the analysis of urban ecosystems, which contributes to the creation of a comfortable urban environment.

The residential environment was created using 3ds Max. Maps and aerial photographs were used as references for the landscape and the basic shapes of large objects. Landmarks were modeled manually, while the remaining structures used uniform textures, which reduced the load on the scene. Twinmotion software helped optimize visualization by adding realistic models of people and vehicles, which significantly improved the overall perception of the project.

The American company HOK actively uses Unreal Engine and Twinmotion to create architectural visualizations and virtual tours. One notable project is a 3D tour of the Centre Block of the Canadian Parliament. Using these technologies, HOK creates high-quality and interactive representations of architectural objects, significantly improving the perception of the design and functionality of buildings. Virtual reality opens new horizons for the presentation of architectural solutions and draws attention to cultural and historical monuments, such as the Parliament of Canada.

Screenshot: 3D tour CENTRUS / HOK

We use scanned We capture data from both the exterior and interior of the building and process it using RealityCapture. This process allows us to create point clouds and high-poly models. We then optimize the data in Houdini, which enables us to create multiple levels of detail for use in Unreal Engine and Twinmotion. As a result, we can develop high-quality visualizations for both internal use and for our clients, significantly improving the design and presentation of architectural solutions.

Our design team conducted a series of accessibility tests. We invited a diverse audience to the presentation so they could explore the environment in a VR headset and evaluate what functions properly and what needs improvement. Katie Lagacé, HOK's technology design specialist, shared details of the project development process.

The architectural capabilities of Unreal Engine are actively used in the real estate industry. The headquarters of the development company Strategic Property Partners houses an impressive model of the prestigious Water Street district, located in Tampa, USA. This project demonstrates how modern technologies can improve the visualization and presentation of architectural concepts, attracting the attention of investors and buyers. Using Unreal Engine allows you to create detailed and interactive models, which contributes to a deeper understanding of future real estate objects.

Photo: Imerza

The tablet allows visitors to mark key details of the installation, such as Districts, transportation routes, infrastructure, and planned buildings. Projections on the walls surrounding the model display 3D visualizations of selected objects in real time, allowing for a deeper dive into the presented information and a better understanding of the project. The use of modern technologies makes interaction with the installation more interactive and informative.

The installation's software was developed by Imerza and includes applications for interactive kiosks, tablets, wall panels, as well as content management systems, data aggregators, and projections. Most of these applications were created using the Unreal Engine, ensuring high-quality graphics and interactivity. The installation's design was developed by DCBolt Productions, adding aesthetic value and functionality to the entire project. Innovative solutions and a modern approach to development make this software an ideal choice for organizing interactive spaces.

WST SPP HIGHLIGHT V1 by DCBolt Productions is a video that showcases the key moments and achievements of the WST SPP project. This work of art allows viewers to immerse themselves in the unique atmosphere of the project, introducing its main aspects and visual effects. The video is created with high quality and attention to detail, which makes it attractive to a wide audience. The WST SPP HIGHLIGHT V1 is essential reading for anyone interested in current trends in video production and art. Real-time rendering capabilities are only available in certain environments. Unreal Engine handles all content, while technologies like nDisplay and NVIDIA Quadro RTX enable the synchronization of multiple computers. This enables the ability to render 12 separate cameras to 12 projectors in real time, significantly improving visual quality and user interaction. Dorian Wee, co-founder and CTO of Imerza, emphasizes the importance of such technologies for creating immersive experiences. Automotive Manufacturing Audi, Chevrolet, BMW, and Volkswagen, among other well-known automotive brands, are actively implementing Unreal Engine in their strategies. This powerful platform is used not only in marketing, including creating promotional videos and virtual simulations for potential customers, but also in the vehicle design process. BMW deserves special attention for its use of Unreal Engine technology throughout all stages of production, significantly improving the efficiency and quality of development. Using such innovative solutions helps brands create more engaging and realistic automotive images, which ultimately increases consumer interest. BMW has been collaborating with Unreal Engine for seven years, since the first VR devices hit the market. The IT department's idea was to use VR headsets early in production so that engineers could explore the functionality of future vehicles and estimate costs. Implementing this concept required developing a specialized application, but existing rendering software did not support VR. This prompted the specialists to explore game engines, and Unreal Engine was chosen. The initial project was so successful that soon all BMW divisions were using UE to develop various systems, from planning in factories to creating applications for car customization at dealerships. This collaboration not only increased process efficiency but also improved the quality of the final product, demonstrating the company's innovative approach to production.

As a software developer, I have no difficulty communicating with business partners. When it comes to integrating remote work software, many don't even realize that the application is based on a game engine. Using Unreal Engine offers unique opportunities for creating high-quality solutions that meet a wide range of requirements. This is especially emphasized by Johannes Knippel, a VR/AR application developer at BMW Group. Using this engine significantly improves functionality and user experience, making it an ideal choice for developing modern applications.

Simulations

Unreal Engine is widely used in industrial sectors, especially in the field of design, training, and educational initiatives, including solutions based on augmented reality. This platform enables the creation of high-quality visualizations and interactive training materials, making it an ideal tool for companies looking to improve the efficiency of their processes and enhance the quality of training. Using Unreal Engine in training and design helps not only in product development but also in increasing user engagement.

One of the notable projects in the field of augmented reality is the collaboration between Unreal Engine and Microsoft HoloLens 2. At the Microsoft Build 2019 conference, John Knoll, creative director of Industrial Light & Magic, and Andrew Chaikin, author of the book "Man on the Moon," presented a reconstruction of the historic Apollo 11 mission. This presentation clearly demonstrates the differences in interaction between virtual and mixed reality, highlighting the potential of the technologies to create immersive experiences.

In virtual reality, users establish their "safe zone" and move exclusively within this area. In contrast, in mixed reality there is no clear boundary. In fact, the way you move through space significantly affects the quality and completeness of the experience. Jason Bestimt, lead programmer of the Apollo 11 project, emphasizes the importance of these aspects. Maximum immersion in virtual and mixed realities is possible only with the proper organization of space and taking into account the peculiarities of movement.

There are many professions in which even a minor mistake can lead to serious consequences. Simulators are used to increase the confidence of novice specialists in the workplace. Precision OS has been developing VR programs for surgical training for four years. The studio was founded by orthopedic surgeon Danny Goel and two gaming industry experts, Colin O'Connor and Roberto Oliveira. These innovative solutions help medical professionals hone their skills in a safe virtual environment, which significantly reduces the risks in real practice.

Photo: Precision OS

Future surgeons often undergo training on artificial models and anatomical preparations. However, according to expert Goel, these methods cannot fully reproduce real surgical conditions. Precision OS simulators are designed to accurately reproduce the surgical process, allowing students and specialists to hone their skills in conditions close to reality. The use of such simulators contributes to the quality of medical education and reduces risks during real surgeries.

Although it is not always possible to visualize all muscles during surgery, an experienced surgeon has a good understanding of the anatomical structure. During surgery, I observe the surgical anatomy, but also mentally visualize its illustrative aspect. Some nerves, vessels, and muscles are hidden, and I constantly visualize their location to avoid unnecessary incisions or accidental injuries. This approach minimizes risk and ensures patient safety, which is especially important in surgery.

Anatomy is a three-dimensional concept, which, nevertheless, is studied in a two-dimensional format. The question of how to access study materials if it is not possible to work with the deceased body becomes relevant. This is especially important for our work at Precision OS, where we focus on creating highly realistic 3D anatomy models. A deep understanding of anatomy is fundamental to surgery across a wide range of specialties. Danny Goel emphasizes that knowledge of anatomy is critical for successful surgical procedures and the development of simulators that help surgeons hone their skills. It's important to note that Unreal Engine isn't the only engine suitable for developing non-game projects. In previous articles, we've mentioned that Unity, CryEngine, and UNIGINE are also effective in this area. The goal of using game engines outside of gaming isn't always to create a stunning effect for potential clients. These technologies contribute to streamlining production processes, accelerating training, improving service, and enhancing overall quality of life. Game engine development opens up new possibilities in various industries, including architecture, medicine and education, allowing the creation of interactive and visually appealing solutions.