DLSS 5 features a real-time neural modeling framework that enables developers to create immersive visual experiences that are only possible with photoreal materials and lighting. Through this technology, they can now deliver a new level of realism to their games.
After 25 years since the company introduced the programmable shader, Jensen Huang, the founder and CEO of NVIDIA, said that the company is once again redefining computer graphics. He noted that DLSS 5 is the culmination of the company’s efforts to deliver a new level of visual realism.
@image from nvidia.com
The goal of this project is to bridge the gap between the cinematic and non-commmedial dimensions.
Since the inception of GeForce, the company has been dedicated to providing the best possible gaming experience. With the help of its advanced GPUs, developers can create realistic worlds that obey the laws of nature.
From 2001 to 2018, when the first programmable shaders were introduced, through to the latest generation of real-time ray tracing and path tracing, NVIDIA has delivered a massive amount of innovation to address this challenge.
While the rendering capabilities of 16-millisecond game frames can be used to create realistic worlds, they are still a fraction of what is required to create photoreal Hollywood effects.
In 2018, the company introduced the DLSS, an AI technology that can boost performance by upscaling resolution and producing new frames. It was integrated into more than 750 games and has become a standard for the industry. This year, the company introduced the 4.5 version of the technology, which uses AI to draw 23 outof every 24 pixels in the screen. Despite the rapid development of video AI models, they are still unable to produce photoreal pixels with the precision and predictability that they need. For games, it is important that they are delivered in real time and are tightly grounded in the artistic intent of the developer.
The DLSS 5 technology takes into account a game’s motion and color vectors and then uses an AI model to create a scene that is rich in 3D materials and light. It runs at up to 4K resolution and is capable of delivering smooth gameplay.
Through its deep understanding of the various elements of a scene, the DLSS 5 model can perform a comprehensive analysis of the visual structure and context of a given frame. It then uses its advanced learning to generate images that are both visually precise and structurally accurate. This includes the complex interactions between light and materials on hair and the subsurface scattering of skin.
Developers can now control the intensity, masking, and color grading of their projects using DLSS 5. This allows them to maintain the unique aesthetics of their games. The integration of this framework is seamless, using the same techniques used by the previous generation of DLSS and NVIDIA technologies.
Support for game developers is provided by the availability of resources and technical assistance.
With the release of DLSS 5, the next generation of gaming technology from NVIDIA, Bethesda Game Studios and Todd Howard are excited to continue pushing the envelope in terms of visual innovation. DLSS 5 will allow them to deliver exceptional visual effects and smooth gameplay without the limitations of real-time rendering, and we’re looking forward to seeing it in Starfield and other upcoming titles.
At CAPCOM, we aim to create immersive and compelling experiences that are built with the utmost care and attention to detail. With the release of DLSS 5, we’re excited to continue pushing the envelope in terms of visual innovation.
According to Charlie Guillemot, the co-CEO of Vantage Studios, DLSS 5 will allow them and other developers to deliver immersive experiences that players have always wanted. With its ability to render multiple materials and characters, it will allow them to create worlds that are truly special.