Category: Misc

NVIDIA is enabling these organizations to easily develop accelerated applications and implement cybersecurity frameworks in order to deliver breakthrough networking, security, and storage performance with a comprehensive, open development platform.

As organizations embrace cloud and edge computing models, they are looking for more efficient, modern computing architectures that create a secure, accelerated, virtual private cloud (SA-VPC), able to support multi-tenancy and deliver applications at data center scale with all the necessary levels of performance and cyber protection. NVIDIA is enabling these organizations to easily develop accelerated applications and implement cybersecurity frameworks in order to deliver breakthrough networking, security, and storage performance with a comprehensive, open development platform.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

 

On-Demand Session

Program Data Center Infrastructure Acceleration with the Release of DOCA and the Latest DPU Software
Speakers: Ariel Kit, Director of Product Marketing for Networking, NVIDIA  and Ami Badani, Vice President of Marketing NVIDIA

DPU experts Ami Badani and Ariel Kit discuss how NVIDIA DOCA is enabling new infrastructure acceleration and management features in BlueField all while simplifying programming and application integration.

Morpheus: AI Inferencing for Cybersecurity Pipelines
Speaker: Bartley Richardson, NVIDIA

What does NVIDIA Morpheus mean for the future of the data center and cloud security? Take a deep-dive into the newly announced AI cybersecurity framework with engineer manager, Bartley Richardson by watching this on demand GTC 21 session.

SDK

NVIDIA DOCA
Develop applications with breakthrough networking, security, and storage performance using NVIDIA DOCA — the newly released complete, open software platform.

NVIDIA Morpheus
Detect Cybersecurity threats in an Instant with NVIDIA Morpheus, a new AI framework for creating zero-trust data center security.

Click here to view all of the Data Center Networking sessions and demos on NVIDIA On-Demand.

This year at GTC we announced the release of NVIDIA Maxine, a GPU-accelerated SDK for building innovative virtual collaboration and content creation applications such as video conferencing and live streaming.

AI has been instrumental in providing exciting features and improving quality and operational efficiency for conferencing, media delivery and content creation. 

This year at GTC we announced the release of NVIDIA Maxine, a GPU-accelerated SDK for building innovative virtual collaboration and content creation applications such as video conferencing and live streaming. 

Check out some of the most popular sessions, demos, and videos from GTC showcasing Maxine’s latest advancements:

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

SDK

NVIDIA Maxine Now Available
With Maxine’s AI SDKs—Video Effects, Audio Effects, and Augmented Reality (AR)—developers can now create real-time, video-based experiences easily deployed to PCs, data centers, and the cloud. Maxine can also leverage NVIDIA Jarvis to access conversational AI capabilities such as transcription, translation, and virtual assistants.

On-Demand

How NVIDIA’s Maxine Changed the Way We Communicate
Hear from Avaya’s Mike Kuch, Sr. Director of Solutions Marketing, and Paul Relf, Sr. Director of Product Management about Avaya Spaces built on CPaaS. Avaya is making capabilities associated with meetings available in contact centers. With AI noise elimination, agents and customers can hear each other in noisy environments. We’re combining components to realize the art of the possible for unique experiences by Avaya with NVIDIA AI.

Real-time AI for Video-Conferencing with Maxine
Learn from Andrew Rabinovich, Co-Founder and CTO, Julian Green, Co-Founder and CEO, and Tarrence van As, Co-Founder and Principal Engineer, from Headroom about applying the latest AI research on real-time video and audio streams for a more-human video-conferencing application. Explore employing generative models for super-resolution, giving order-of-magnitude reduced bandwidth. See new solutions for saliency segmentation delivering contextual virtual backgrounds of stuff that matters. 

Demo

Building AI-Powered Virtual Collaboration and Content Creation Solutions with NVIDIA Maxine
With new state-of the-art AI features for video, audio, and augmented reality—including AI face codec, eye contact, super resolution, noise removal, and more—NVIDIA Maxine is reinventing virtual collaboration on PCs, in the data center, and in the cloud. 

Reinvent Video Conferencing, Content Creation & Streaming with AI Using NVIDIA Maxine
Developers from video conferencing, content creation and streaming providers such as Notch, Headroom, Be.Live, and Touchcast are using the Maxine SDK to create real-time video-based experiences easily deployed to PCs, data centers or in the cloud.

Engineers, product developers and designers worldwide attended GTC to learn how the latest NVIDIA technologies are accelerating real-time, interactive rendering and simulation workflows.

Engineers, product developers and designers worldwide attended GTC to learn how the latest NVIDIA technologies are accelerating real-time, interactive rendering and simulation workflows.

We showcased the latest NVIDIA-powered AI and real-time ray tracing tools that have made creativity faster and easier for artists and designers. We also discussed with industry luminaries about their vision for the future of AI and real-time ray tracing, and how Autodesk and Adobe have integrated the technology into their most popular applications. All of these GTC sessions are now available through NVIDIA On-Demand.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform.

On-Demand Sessions

A Shared Vision for the Future of AI: Fireside Chat with NVIDIA founder and CEO Jensen Huang, and Adobe CTO Abhay Parasnis
Learn from the CTO of Adobe, Abhay Parasnis, and NVIDIA founder and CEO Jensen Huang about the powerful impact AI has on the world’s most inspiring creators and where it will take us next.

Digital Human for Digital Twins
Speakers: NVIDIA, wrnch, Reallusion

Watch this talk about the importance of simulating human action and movement in a digital environment, and how advancements in AI are paving the way for digital-twin humans.

The Future of GPU Ray Tracing
Speakers: Adobe/Solid Angle, OTOY, Blur Studio, Epic Games, Pixar, Redshift Rendering Technologies, Isotropix, Chaos Group

This panel discussion features leaders of GPU accelerated ray tracing sharing their thoughts around the technology and impact to creative professionals and workflows.

New SDK Releases

NVIDIA OptiX 7.3 Available Now
Download the latest version of OptiX that offers improved ray tracing performance while reducing GPU resources.

Accelerate Special Effects with NanoVDB
NanoVDB adds real time rendering GPU support for OpenVDB. Download the latest version now, which includes memory savings while generating complex special effects.

All the professional graphics and simulation sessions at GTC are now available for free on NVIDIA On-Demand.

Hands-on learning is key for anyone new to AI and robotics. Priced for everyone, the Jetson Nano Developer Kit is the best way to get started learning how to create AI projects.

The NVIDIA Jetson Nano Developer Kit is a small AI computer for makers, learners, and developers. Jetson Nano is also the perfect tool to start learning about AI and robotics in real-world settings, with ready-to-try projects and the support of an active and passionate developer community. Begin developing your first AI projects today.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here.

On-Demand Sessions

Jetson 101: Learning Edge AI Fundamentals

Speaker: Dustin Franklin, Developer Evangelist for Jetson, NVIDIA

Discover how to get started creating your own AI-powered projects on Jetson Nano with deep learning and computer vision. 

Optimizing for Edge AI on Jetson

Speaker: John Welsh, Developer Technology Engineer of Autonomous Machines

Learn about workflows for optimizing deep learning models for inference at the edge with NVIDIA Jetson.

Demos

Getting started with Jetson Nano 2GB Developer Kit

Jetson Community Projects

Explore and learn from Jetson projects created by us and our community. These have been created for Jetson developer kits. Scroll down to see projects with code, videos and more.

Accelerated data science can dramatically boost the performance of end-to-end analytics workflows, speeding up value generation while reducing cost. Learn how companies like Spotify and Walmart use NVIDIA-accelerated data science.

Data analytics workflows have traditionally been slow and cumbersome, relying on CPU compute for data preparation, training, and deployment. Accelerated data science can dramatically boost the performance of end-to-end analytics workflows, speeding up value generation while reducing cost. Learn how companies like Spotify and Walmart use NVIDIA-accelerated data science.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

On-Demand Sessions

GPU-Accelerated Model Evaluation: How we took our offline evaluation process from hours to minutes with RAPIDS
Speakers: Joseph Cauteruccio, Machine Learning Engineer, Spotify; Marc Romeyn, Machine Learning Engineer, Spotify;

Learn how Spotify utilized cuDF and Dask-CUDF to build an interactive model evaluation system that drastically reduced the time it took to evaluate our recommender systems in an offline setting. As a result, model evaluations that previously took hours to complete as CPU workloads now run in minutes, allowing us to increase our overall iteration speed and thus build better models.

Accelerated ETL, Training and Inference of Recommender Systems on the GPU with Merlin, HugeCTR, NVTabular, and Triton
Speaker: Even Oldridge, Senior Manager, Recommender Systems Framework Team, NVIDIA

In this talk, we’ll share the Merlin framework, consisting of NVTabular for ETL, HugeCTR for training, and Triton for inference serving. Merlin accelerates recommender systems on GPU, speeding up common ETL tasks, training of models, and inference serving by ~10x over commonly used methods. Beyond providing better performance, these libraries are also designed to be easy to use and integrate with existing recommendation pipelines.

How Walmart improves computationally intensive business processes with NVIDIA GPU Computing
Speakers: Richard Ulrich, Senior Director, Walmart; John  Bowman, Director, Data Science, Walmart

Over the last several years, Walmart has been developing and implementing a wide range of applications that require GPU computing to be computationally feasible at Walmart scale.   We will present CPU vs. GPU performance comparisons on a number of real-world problems from different areas of the business and we highlight, not just the performance gains from GPU computing, but also what capabilities GPU computing has enabled that would simply not be possible on CPU-only architectures. 

How Cloudera Data Platform uses a single pane of glass to deploy GPU accelerated applications s across hybrid and multi-clouds
Speakers: Karthikeyan Rajendran, Product Manager, NVIDIA; Scott McClellan, General Manager of Data Science, NVIDIA

Learn how Cloudera Data Platform uses a single pane of glass to deploy GPU-accelerated applications across hybrid and multi-clouds.

GPU-Accelerated, High-Performance Machine Learning Pipeline
Speaker: Lei Zhang, Senior Machine Learning Engineer, Adobe

The Adobe team is currently working with NVIDIA to build an unprecedented GPU-based, high-performance machine learning pipeline.

Click here to view all of the other Data Science sessions and demos on NVIDIA On-Demand.

NVIDIA Omniverse is an open platform built for virtual collaboration and real-time physically accurate simulation. Explore the latest resources to learn and get started with Omniverse today.

At GTC 2021 we shared a glimpse of the immense power the NVIDIA Omniverse platform can bring to the world of architecture, manufacturing, product design, robotics, gaming development, and media and entertainment. This new open, cloud-native platform makes virtual collaboration easy for creators, researchers, and engineers on photorealistic rendering projects. For a deeper understanding of the platform and its capabilities, we curated a collection of the latest resources to help you get started on Omniverse.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

On-Demand Sessions

Introduction to RTX Technology and the Omniverse Platform
Speaker: Vincent Brisebois, NVIDIA 

We introduce NVIDIA RTX technology at a very high level (Shaders, RT Cores and Tensor Cores), then introduce the Omniverse platform. We focus on the Omniverse technology stack and give a high-level overview of its components and how developers can leverage them. Our target audience is technical artists or developers who have little-to-no exposure to the platform or creatives, who are currently trying the open beta and looking for a deeper overview of the platform and components.

Panel: Plumbing the Metaverse with USD
Speakers: Dean Takahashi, VentureBeat; F. Sebastian Grassia, Pixar; Guido Quaroni, Adobe; Ivar Dahlberg, Embark Studios; Lori Hufford, Bentley Systems; Martha Tsigkari, Foster+Partners; Mattias Wikenmalm, Volvo; Perry Nightingale, WPP; Susanna Holt, Autodesk Forge 

Learn more about the Pixar USD file format and discover its benefits to digital creators in all verticals. The session will provide a brief overview of USD, followed by a panel of distinguished industry luminaries to discuss their experience and adoption of the format and its benefits.

Introduction to USD
Speaker: Dirk Van Gelder, NVIDIA

This session introduces Universal Scene Description (USD), open-source software from Pixar Animation Studios that’s used as the core representation of the 3D world within NVIDIA’s Omniverse platform. We’ll show what USD is and how assets are constructed with it. We’ll show why this standard and open representation enables interchange with 3D applications to more easily construct virtual worlds. We’ll include hands-on demo examples that illustrate USD scene construction in Python that you can try with a web browser at home, and show how to interact with USD files within Omniverse.

Making a Connector for Omniverse
Speaker: Brian Harrison, NVIDIA

Learn how to connect with the Omniverse platform and be able to send data to it, establish a live sync session, as well as a USD 101 overview to get you started. This is primarily targeted at developers who want to learn how to create a plugin for an application and push data to Omniverse. However, the topic also applies to those seeking to write command line or scripted converters, as well as connecting Omniverse and a data management system. We’ll start with an overview of USD structuring and some of the basics in geometry and materials. A tour of the Sample SDK, which is available on the Omniverse Launcher, will be discussed in detail. From there, we’ll look at how we implemented a Connector for an application, like SketchUp, to discuss design considerations and material mapping and handling.

For more on-demand content, check out the collection of developer sessions from GTC 2021 to learn how industry experts and our very own Omniverse engineers use and build on top of the platform.

Hands-on Demo

Marbles RTX Playable Sample Now Available in NVIDIA Omniverse
Download and discover the iconic RTX demo, and explore real-time physics, dynamic lights and rich, physically based materials in the virtual collaboration platform.

For additional resources, check out the Omniverse Forums, Discord, Twitch, and YouTube channels.

NVIDIA RTX enables developers to create breathtaking, interactive worlds with performance that exceeds gamers expectations. Integrating RTX has never been easier – gain access through popular game engines such as Unreal Engine or through standalone SDKs made available at GTC.

Developers, engineers, artists and leaders from game studios across the world gathered virtually at this year’s virtual GTC to learn how the latest NVIDIA technologies are revolutionizing game development. 

NVIDIA RTX enables developers to create breathtaking, interactive worlds with performance that exceeds gamers expectations. Integrating RTX has never been easier – gain access through popular game engines such as Unreal Engine or through standalone SDKs.  

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

 

On-Demand

The State of RTX in Unreal Engine 4

Speaker: Richard Cowgill, NVIDIA

In this session, NVIDIA’s Richard Cowgill goes over where RTX is today in Unreal Engine 4, all the advancements in the past year, and a quick look at what’s coming up.

Collaborative Game Development using Omniverse

This session is a deep dive on how to leverage Omniverse, using new asset collaboration tools USD and MDL for game development. You’ll learn how to leverage Nucleus for collaboration, AI for asset tagging, and USD and MDL for ground truth content creation and lighting using ray tracing.

Demos

RTX Technology Showcase

Experience the latest NVIDIA RTX technologies available in Unreal Engine 4. Toggle ray tracing on and off between reflections, shadows and translucency to see the impact these features have on  NVIDIA’s Attic demo and what they could bring to your project. You’ll also learn how RTX Global Illumination adds dynamic range to the scene with multi-bounce indirect lighting. Maximize these ray-tracing settings with DLSS, which will boost the frame-rate of the Attic scene while maintaining a high resolution. With an RTX GPU, you can try this demo as a standalone build here.

RTXDI

RTXDI offers realistic lighting of dynamic scenes that require computing shadows from millions of area lights. Until now, this hasn’t been possible in video games in real-time. Traditionally, game developers have baked most lighting and supported a small number of “hero” lights that are computed at runtime. With RTXDI, lighting artists can render scenes with millions of dynamic area lights in real-time without complex computational overheads or disruptive changes to the artist’s workflow. In this scene, you can see neon billboards, brake lights, apartment windows, store displays, and wet roads—all acting as independent light sources. All this can now be captured in real-time with RTXDI. Learn more here.

NVIDIA Reflex

System Latency is the measure of PC responsiveness – a critical metric for gamers that is difficult to optimize for. In this demo, we will show you how NVIDIA Reflex optimizes system latency and helps developers give players a response experience.

In this talk available on NVIDIA On-Demand, Seth Schneider (NVIDIA) and Ryan Greene (Blizzard) will provide a crash course on system latency covering: the basics of system latency, NVIDIA Reflex, and the Overwatch team’s approach to system latency optimization. If you are interested in a deep dive into system level performance, you’ve come to the right place.

Get the latest resources and news about the NVIDIA technologies that are accelerating the latest innovations in HPC from industry leaders and developers.

Get the latest resources and news about the NVIDIA technologies that are accelerating the latest innovations in HPC from industry leaders and developers. Explore sessions and demos across a variety of HPC topics, ranging from weather forecasting and energy exploration to computational chemistry and molecular dynamics.

The developer resources listed below are exclusively available to NVIDIA Developer Program members. Join today for free in order to get access to the tools and training necessary to build on NVIDIA’s technology platform here. 

 

On-Demand Sessions

How GPU Computing Works
Speaker: Stephen Jones, CUDA Architect, NVIDIA

Get an introduction to GPU computing by the lead architect of CUDA. We’ll walk through the internals of how the GPU works and why CUDA is the way that it is, and connect the dots between physical hardware and parallel computing.

A Deep Dive into the Latest HPC Software
Speaker: Tim Costa, NVIDIA

Take a deep dive into the latest developments in NVIDIA software for HPC applications, including a comprehensive look at what’s new in programming models, compilers, libraries, and tools. We’ll cover topics of interest to HPC developers, targeting traditional HPC modeling and simulation, HPC+AI, scientific visualization, and high-performance data analytics.

Introducing Developer Tools for Arm and NVIDIA Systems
Speaker: David Owens, Product Director, Infrastructure Software, Arm

Explore the role of key tools and toolchains on Arm servers, from Arm, NVIDIA, and elsewhere — and show how each tool fits in the end-to-end journey to production science and simulation.

 

SDK

Accelerate Quantum Information Science with NVIDIA cuQuantum SDK
NVIDIA cuQuantum is an SDK of optimized libraries and tools for accelerating quantum computing workflows. Learn more about how NVIDIA cuQuantum speeds up quantum circuit simulations by orders of magnitude. 

 

Blog

NVIDIA Arm HPC Developer Kit for HPC, AI, and Scientific Computing Applications
The NVIDIA Arm HPC Developer Kit is an integrated hardware and software platform for creating, evaluating, and benchmarking HPC, AI, and scientific computing applications on a GPU- and CPU-accelerated computing system.

NVIDIA Nsight Visual Studio Code Edition: New Addition to the Nsight Developer Tools Suite
Read about Nsight Visual Studio Code Edition, an application for platforms that bring CUDA development for GPUs into Microsoft Visual Studio Code, including building and debugging GPU kernels and native CPU code.

 

Click here to view all of the HPC sessions and demos on NVIDIA On-Demand.

 

Today, NVIDIA released world class speech recognition capability for enterprises to generate highly accurate transcriptions and NeMo 1.0 which includes new state-of-the-art speech and language models for democratizing and accelerating conversational AI research.

Today, NVIDIA released world class speech recognition capability for enterprises to generate highly accurate transcriptions and NeMo 1.0 which includes new state-of-the-art speech and language models for democratizing and accelerating conversational AI research.

World Class Speech Recognition

Jarvis world class speech recognition is an out-of-the-box speech service that can be easily deployed in any cloud or datacenter. Enterprises can use Transfer Learning Toolkit (TLT) to customize speech service across a variety of industries and use cases.  With TLT, developers can accelerate development of custom speech and language models by 10x.  

The speech recognition model is highly accurate and trained on domain-agnostic vocabulary from telecommunications, finance, healthcare, education, and also various proprietary and open-source datasets. Additionally, it was trained on noisy data, multiple sampling rates including 8khz for call centers, variety of accents, and dialogue all of which contribute to the model’s accuracy. 

With Jarvis speech service, you can generate a transcription in under 10 milliseconds. It is evaluated on multiple proprietary datasets with over ninety percent accuracy and can be adapted to a wide variety of use cases and domains. It can be used in several apps such as transcribing audio in call centers, video conferencing and in virtual assistants.

T-Mobile, one of the largest telecommunication operators in the United States, used Jarvis to offer exceptional customer service.

“With NVIDIA Jarvis services, fine-tuned using T-Mobile data, we’re building products to help us resolve customer issues in real time,” said Matthew Davis, vice president of product and technology at T-Mobile. 

“After evaluating several automatic speech recognition solutions, T-Mobile has found Jarvis to deliver a quality model at extremely low latency, enabling experiences our customers love.”

You can download Jarvis speech service from the NGC Catalog to start building your own transcription application today. 

NeMo 1.0

NVIDIA NeMo is an open-source toolkit for researchers developing state-of-the-art (SOTA) conversational AI models. It includes collections for Automatic Speech Recognition (ASR), Natural Language Processing (NLP) and Text-to-Speech (TTS) which enables researchers to quickly experiment with new SOTA neural networks in order to create new models or build on top of existing ones.

 NeMo is tightly coupled with PyTorch, PyTorch Lightning and Hydra frameworks. These integrations enable researchers to develop and use NeMo models and modules in conjunction with PyTorch and PyTorch Lightning modules. Also, with the Hydra framework and NeMo, researchers can easily customize complex conversational AI models.

Highlights of this version include:

• Added speech recognition support for multiple languages and also new CitriNet and Conformer-CTC ASR models
• Bidirectional Neural Machine Translation models support in five languages from English to Spanish, Russian, Mandarin, German and French
• New speech synthesis models such as Fastpitch, Talknet, Fastspeech2, and also end-to-end models like Fastpitch + HiFiGAN and Fastspeech2 + HiFiGAN
• Features for automatically performing inverse text normalization and denormalization, and also for creating datasets based on CTC-Segmentation and exploring speech datasets

Also, most NeMo models can be exported to NVIDIA Jarvis for production deployment and high-performance inference. 

Learn more about what is included in NeMo 1.0 from the NVIDIA Developer Blog. NeMo is open-sourced and is available for download and use from the NGC Catalog and GitHub.

The 15 accepted papers and posters from NVIDIA range from simulating dynamic driving environments, to powering neural architecture search for medical imaging.

Researchers, developers, and engineers worldwide are gathering virtually this year for the annual Conference on Computer Vision and Pattern Recognition (CVPR) from June 19^th to June 25^th. Throughout the week, NVIDIA Research will present their recent computer vision-related projects via presentations and interactive Q&As. 

The nearly 30 accepted papers from NVIDIA range from simulating dynamic driving environments, to powering neural architecture search for medical imaging.

Here are a few featured papers:

DriveGAN: Towards a Controllable High-Quality Neural Simulation
Authors: Seung Wook Kim (University of Toronto, NVIDIA)*; Jonah Philion (University of Toronto, NVIDIA); Antonio Torralba (MIT); Sanja Fidler (University of Toronto, NVIDIA)

DriveGAN is a fully differentiable simulator, it further allows for re-simulation of a given video sequence, offering an agent to drive through a recorded scene again, possibly taking different actions. 

The talk will be live on Tuesday, June 22, 2021 at 10:00pm EST

DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation
Authors: Yufan He (Johns Hopkins University)*; Dong Yang (NVIDIA); Holger R Roth (NVIDIA); Can Zhao (NVIDIA); Daguang Xu (NVIDIA)

From the abstract: In this work, we focus on three important aspects of NAS in 3D medical image segmentation: flexible multi-path network topology, high search efficiency, and budgeted GPU memory usage. Our method achieves the state-of-the-art performance and the top ranking on the MSD challenge leaderboard.

The talk will be live on Tuesday, June 22, 2021 at 10:00 pm EST

To view the complete list of NVIDIA Research accepted papers, workshop and tutorials, demos, and to explore job opportunities at NVIDIA, visit the NVIDIA at CVPR 2021 website.