NVIDIA Unveils Project G-Assist AI, DLSS 3.5, and More at Computex 2024
Reporting from Taipei, Taiwan: RTX AI PCs are delivering big innovations in gaming, content creation, and more at Computex 2024. NVIDIA GeForce announcements are here, including new AI advancements, new SFF-Ready guidelines for enthusiast GPUs and cases, and new RTX upgrades for Star WarsTM Outlaws and Marvel Rivals. NVIDIA is announcing the launch of a new NVIDIA app beta update on June 4th, and a new GeForce Reward, which will net gamers 3 months of free PC Game Pass access. For all of NVIDIA’s other Computex 2024 news, visit the NVIDIA Blog.
Project G-Assist
Project G-Assist is an RTX-powered AI assistant technology demo that provides context-aware help for PC games and apps. PC games offer vast universes to explore and intricate mechanics to challenge even the most dedicated gamer. Project G-Assist aims to put game and system knowledge at players’ fingertips.
Project G-Assist takes voice or text inputs from the player, along with a snapshot of what is in the game window. The snapshot is fed into AI vision models that provide context awareness and app-specific understanding for the Large Language Model (LLM), which is connected to a database of game knowledge such as a wiki. The output of the LLM is an insightful and personalized response—either text, or speech from the AI —based on what is happening in-game.
NVIDIA partnered with Studio Wildcard to demo the technology with ARK: Survival Ascended. Project G-Assist can help answer questions about creatures, quests, items, lore, difficult-to-tackle bosses and more. As Project G-Assist is context-aware, it personalizes responses to the user’s playthrough.
Additionally, Project G-Assist can evaluate the player’s system’s configuration and performance, and instantly tune it for an optimal experience. Gamers can apply the NVIDIA app’s optimized game settings, based on extensive testing on thousands of hardware configurations, They can enable Performance Tuning to apply a safe GPU overclock, switch on NVIDIA Reflex to reduce system latency for more responsive gaming, and do so much more.
NVIDIA envisions AI assistants transforming how it engages with its favourite games and apps. Project G-Assist provides instant context-aware assistance with a complex creative workflow in a photo or video app. It also involves an AI coach analyzing the gamer’s multiplayer replays, teaching them strategies to move up the ranks in competitive matches. Project G-Assist will not play a game for the player as suggested in NVIDIA’s prop hetic 2017 April Fool’s video, but it can help gamers get more out of their favourite games, and find help for a troublesome boss.
NVIDIA ACE Digital Humans Coming to RTX AI PCs
NVIDIA announced the general availability of NVIDIA ACE generative AI microservices in the cloud to accelerate the next wave of digital humans. Developers in customer service, gaming and healthcare are the first to adopt ACE technologies to simplify creating, animating and operating lifelike digital humans. In addition, NVIDIA ACE technology is now coming to RTX AI PCs and workstations with ACE PC NIM microservices. ACE NIMs will deliver high-quality inference running locally on RTX GPUs for natural language understanding, speech, and facial animation.
At Computex, the gaming debut of NVIDIA ACE NIM on the PC will be featured in the latest Covert Protocol tech demo, developed in collaboration with Inworld AI. It now showcases NVIDIA Audio2Face and NVIDIA Riva automatic speech recognition running locally on RTX devices.
New RTX Game Announcements & Trailers
NVIDIA DLSS 3.5 with Ray Reconstruction maximizes frame rates on GeForce RTX GPUs and renders more immersive and realistic ray-traced effects and lighting in games using AI. At Computex 2024, NVIDIA has announced that DLSS 3.5 with Ray Reconstruction will be available in Star Wars Outlaws, launching on August 30th.
Additionally, Marvel Rivals will launch with NVIDIA’S AI-powered, performance-boosting DLSS 3 technology, and a new trailer is coming up, showing it in action in the new, upcoming game.
Introducing SFF-Ready Enthusiast GeForce Cards & Compatible Cases
Small Form Factor (SFF) PCs pack powerful components into stylish cases that can be displayed on gamers’ desks, carried to LAN parties, tucked away in tight spaces, and slotted into media centres. Once a niche format supported by only a few boutique builders, SFF is now part of many top case manufacturers’ line-ups.
Component compatibility remains a challenge, however, requiring prospective buyers to dive into specification sheets and ask other enthusiasts whether there’s available space and clearance for parts, cables and assembly. GeForce RTX graphics cards come in all shapes and sizes, and though partners’ pages list product dimensions, clearances for power cables and connectors generally aren’t referenced, necessitating guesswork and further research to ensure the graphics card is SFF-suitable.
NVIDIA is working in partnership with the graphics card and case manufacturers to make the component choice simpler by introducing a new SFF-Ready guideline for GeForce RTX enthusiast graphics cards and cases. This new guideline will instantly tell whether a graphics card fits in an SFF case. “As enthusiastic supporters of the small form factor community, we are proud to partner with NVIDIA to deliver powerful performance in compact, space-saving designs. NVIDIA’s SFF-Ready Enthusiast GeForce graphics cards and cases allow PC enthusiasts to experience the full potential of SFF technology,” says Kent Chien, Corporate Vice President, General Manager of Multimedia BU, ASUS.
Manufacturer product pages and listings on global retailers will soon be updated with text labeling graphics cards that meet the guideline as “SFF-Ready Enthusiast GeForce Cards”, and cases as being “Compatible with SFF-Ready Enthusiast GeForce Cards”, instantly identifying parts that fit together and allowing gamers to buy and build with confidence.
NVIDIA App Beta Update Available Now
The NVIDIA app is an essential companion for gamers and creators with NVIDIA GPUs in their PCs and laptops. The initial beta release in February was the first step in NVIDIA’s journey to modernize and unify the NVIDIA Control Panel, GeForce Experience and RTX Experience, and on June 4th at 3 am PT NVIDIA is launching a new update with new features.
Available for download via the in-app updater, and from the website, the new NVIDIA app beta update adds 120 FPS AV1 video capture, introduces one-click GPU performance tuning, enhances the NVIDIA app overlay, and further refines the user experience. The NVIDIA app simplifies the process of keeping the gamer’s or content creator’s PC updated with the latest NVIDIA Game Ready and Studio drivers and enables quick discovery and installation of NVIDIA applications like GeForce NOW, NVIDIA Broadcast and NVIDIA Omniverse.
Featuring a unified GPU control centre, the NVIDIA app allows fine-tuning of game and driver settings from a single place, while introducing a redesigned in-game overlay for convenient access to powerful gameplay recording tools, performance monitoring overlays, automatic SDR to HDR conversion in games, and game-enhancing filters, including innovative new AI-powered filters for GeForce RTX users.
Get PC Game Pass Free For 3 Months
If players haven’t tried PC Game Pass, now’s the perfect time! NVIDIA has partnered with Xbox to give GeForce gamers 3 months of access to PC Game Pass for free, starting on June 4th. PC Game Pass has high-quality, day-one games available to download and play, including numerous titles enhanced with NVIDIA DLSS, NVIDIA Reflex, and ray-traced effects. Take to the track in Forza Horizon 5 or Forza Motorsport, which include ray tracing and DLSS, giving GeForce RTX gamers the definitive race-day experience. With RTX, players can get crafty and build their world in the fully ray-traced Minecraft. There are a whole host of games to choose from.
If they are away from home, or players feel that their PC isn’t up to the task of rendering high fidelity games at high frame rates, they can play over 130 PC Game Pass titles on GeForce NOW. They can stream the ever-growing list of supported PC Game Pass titles from a GeForce RTX PC gaming rig in the cloud, and also play the games they already own from the Microsoft Store, Battle.net, Steam, Epic Games Store, Ubisoft Connect, and GOG.com. Gamers can play on iPhone, iPad, Android devices, web browsers, select LG and Samsung smart TVs, Macs, Chromebooks, and many other commonly owned gadgets, with controllers and PC accessories, and on suitable devices players can even broadcast gameplay to a TV for a big-screen experience.
And with a GeForce NOW Ultimate subscription, all RTX games streamed from the cloud can be experienced with the same technologies present when gaming on GeForce RTX 40 Series PC or laptop, including DLSS 3, Reflex and ray tracing, at up to 4K 120 FPS or up to 240 FPS. Users can play with GeForce NOW anytime, anywhere they have a fast Internet connection.
NVIDIA RTX Remix To Open Source Creator Toolkit
NVIDIA RTX Remix empowers modders to remaster classic DirectX 8 and DirectX 9 games with full ray tracing, DLSS 3.5, highly detailed assets, and physically accurate materials. Built on NVIDIA Omniverse, RTX Remix consists of a Runtime that renders games with path tracing and DLSS 3.5 and a toolkit app that facilitates the modding of game assets and materials.
Since the RTX Remix Toolkit launched earlier this year, 20,000 modders have experimented with using it to mod classic games, resulting in over 100 RTX remasters in development on the RTX Remix Showcase Discord. Last year, NVIDIA made RTX Remix Runtime open source, allowing modders to expand game compatibility and advance rendering capabilities. This month, NVIDIA will make the RTX Remix Toolkit open source, allowing modders to streamline how assets are replaced and scenes are relit, increase supported file formats for RTX Remix’s asset ingestor, and bolster RTX Remix’s AI Texture Tools with new models.
In addition, NVIDIA is making the capabilities of RTX Remix Toolkit accessible via a REST application programming interface, allowing modders to livelink RTX Remix to digital content creation tools such as Blender, modding tools such as Hammer and generative AI apps such as ComfyUI. NVIDIA is also providing an SDK for RTX Remix Runtime to allow modders to deploy RTX Remix’s renderer into other applications and games beyond DirectX 8 and 9 classics.
With more of the RTX Remix platform being made open source, modders across the globe can build even more stunning RTX remasters. For further details about the update launching later this month, head here.
AI For Content Creation
NVIDIA is also integrating RTX AI acceleration into apps for creators, modders and video enthusiasts. Last year, NVIDIA introduced RTX acceleration using TensorRT for one of the most popular Stable Diffusion user interfaces, Automatic1111. Starting this week, RTX will also accelerate the highly popular ComfyUI, delivering up to a 60% improvement in performance over the currently shipping version, and 7x faster performance compared to the MacBook Pro M3 Max.
NVIDIA RTX Video, the popular AI-powered super-resolution feature supported in the Google Chrome, Microsoft Edge and Mozilla Firefox browsers, is now available as an SDK to all developers, helping them natively integrate AI for upscaling, sharpening, compression artefact reduction and high-dynamic range (HDR) conversion.
Coming soon to video editing software Blackmagic Design’s DaVinci Resolve and Wondershare Filmora, RTX Video will enable video editors to upscale lower-quality video files to 4K, as well as convert standard dynamic range source files into HDR. Additionally, the free media player VLC media will soon add RTX Video HDR to its existing super-resolution capability.
Introducing RTX AI Toolkit For Custom AI Models On PCs
The AI ecosystem has built a large body of high-quality, open-source models for app developers to leverage, but most are trained for general purposes and built to run in a data centre. To help developers build application-specific AI that runs on PCs, NVIDIA is introducing RTX AI Toolkit — an end-to-end workflow for model customization, optimization and deployment of AI models on RTX AI PCs. RTX AI Toolkit will be available this month for broader developer access.
Developers can customize a pre-trained model with open-source QLoRa tools. Then, they can use the NVIDIA TensorRT model optimizer to quantize models to consume up to 3x less RAM. NVIDIA TensorRT Cloud then optimizes the model for peak performance across the RTX GPU lineups. The result is up to 4x faster performance compared to the pre-trained model.
The NVIDIA AI Inference Manager (AIM) software development kit (SDK), now available in early access, simplifies the complexity of AI integration for PC application developers by orchestrating AI inference seamlessly across PCs and the cloud. It also pre-configures the PC with the necessary AI models, engines and dependencies in the format of a NIM and supports all major inference backends — including TensorRT, DirectML, Llama.cpp and PyTorch-CUDA across different processors, including GPUs, NPUs and CPUs.
Software partners such as Topaz, and Blackmagic Design are integrating components of the RTX AI Toolkit within their popular creative apps, to accelerate AI performance in RTX PCs. Components of the RTX AI Toolkit, such as TensorRT-LLM, are integrated in popular developer frameworks and applications for generative AI, including Automatic1111, ComfyUI, Jan.AI, Langchain, LlamaIndex, Oobabooga and Sanctum.AI.
