DataBloom

The tech world this week gets its first look under the hood of the NVIDIA BlueField data processing unit. The chip invented the category of the DPU last year, and it’s already being embraced by cloud services, supercomputers and many OEMs and software partners. Idan Burstein, a principal architect leading our Israel-based BlueField design team, Read article >

The post Inside the DPU: Talk Describes an Engine Powering Data Center Networks appeared first on The Official NVIDIA Blog.

This GFN Thursday brings in the highly anticipated magnum opus from SEGA and Amplitude Studios, HUMANKIND, as well as exciting rewards to redeem for members playing Eternal Return. There’s also updates on the newest Fortnite Season 7 game mode, “Impostors,” streaming on GeForce NOW. Plus, there are nine games in total coming to the cloud Read article >

The post Make History This GFN Thursday: ‘HUMANKIND’ Arrives on GeForce NOW appeared first on The Official NVIDIA Blog.

NVIDIA researchers are presenting five papers on our groundbreaking research in speech recognition and synthesis at INTERSPEECH 2021.

Researchers from around the world working on speech applications are gathering this month for INTERSPEECH, a conference focused on the latest research and technologies in speech processing. NVIDIA researchers will present five papers on groundbreaking research in speech recognition and speech synthesis.

Conversational AI research is fueling innovations in speech processing that help computers communicate more like humans and add value to organizations.

Accepted papers from NVIDIA at this year’s INTERSPEECH features the newest speech technology advancements, from free fully formatted speech datasets to new model architectures that deliver state-of-the-art performance.

Here are a couple featured projects:

TalkNet 2: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis with Explicit Pitch and Duration Prediction 
Authors: Stanislav Beliaev, Boris Ginsburg
From the abstract: This model has only 13.2M parameters, almost 2x less than the present state-of-the-art text-to-speech models. The non-autoregressive architecture allows for fast training and inference. The small model size and fast inference make the TalkNet an attractive candidate for embedded speech synthesis.

This talk will be live on Thursday, September 2, 2021 at 4:45 pm CET, 7:45 am PST

Compressing 1D Time-Channel Separable Convolutions Using Sparse Random Ternary Matrices
Authors: Gonçalo Mordido, Matthijs Van Keirsbilck, Alexander Keller
From the abstract: For command recognition on Google Speech Commands v1, we improve the state-of-the-art accuracy from 97.21% to 97.41% at the same network size. For speech recognition on Librispeech, we half the number of weights to be trained while only sacrificing about 1% of the floating-point baseline’s word error rate.

This talk will be live on Friday, September 3, 2021 at 4 pm CET, 7 am PST

View the full schedule of NVIDIA activities >>>

NVIDIA today reported record revenue for the second quarter ended August 1, 2021, of $6.51 billion, up 68 percent from a year earlier and up 15 percent from the previous quarter, with record revenue from the company’s Gaming, Data Center and Professional Visualization platforms.

submitted by /u/disdainty
[visit reddit] [comments]

submitted by /u/WorryNo7966
[visit reddit] [comments]

Introduction Efficient pipeline design is crucial for data scientists. When composing complex end-to-end workflows, you may choose from a wide variety of building blocks, each of them specialized for a dedicated task. Unfortunately, repeatedly converting between data formats is an error-prone and performance-degrading endeavor. Let’s change that! In this post series, we discuss different aspects … Continued

Introduction

Efficient pipeline design is crucial for data scientists. When composing complex end-to-end workflows, you may choose from a wide variety of building blocks, each of them specialized for a dedicated task. Unfortunately, repeatedly converting between data formats is an error-prone and performance-degrading endeavor. Let’s change that!

In this post series, we discuss different aspects of efficient framework interoperability:

• In the first post, discussing pros and cons of distinct memory layouts as well as memory pools for asynchronous memory allocation to enable zero-copy functionality.
• In this post, we highlight bottlenecks occurring during data loading/transfers and how to mitigate them using Remote Direct Memory Access (RDMA) technology.
• In the third post, we dive into the implementation of an end-to-end pipeline demonstrating the discussed techniques for optimal data transfer across data science frameworks.

To learn more on framework interoperability, check out our presentation at NVIDIA’s GTC 2021 Conference.

Data loading and data transfer bottlenecks

Data loading bottleneck

Thus far, we have worked on the assumption that the data is already loaded in memory and that a single GPU is used. This section highlights a few bottlenecks that might occur when loading your dataset from storage to device memory or when transferring data between two GPUs using either a single node or multiple nodes setting. We then discuss how to overcome them.

In a traditional workflow (Figure 2), when a dataset is loaded from storage to GPU memory, the data will be copied from the disk to the GPU memory using the CPU and the PCIe bus. Loading the data requires at least two copies of the data. The first one happens when transferring the data from the storage to the host memory (CPU RAM). The second copy of the data occurs when transferring the data from the host memory to the device memory (GPU VRAM).

Alternatively, using a GPU-based workflow that leverages NVIDIA Magnum IO GPUDirect Storage technology (see Figure 3), the data can directly flow from the storage to the GPU memory using the PCIe bus, without making use of neither the CPU nor the host memory. Since the data is copied only once, the overall execution time decreases. Not involving the CPU and the host memory for this task also makes those resources available for other CPU-based jobs in your pipeline.

Intra-node data transfer bottleneck

Some workloads require data exchange between two or more GPUs located in the same node (server). In a scenario where NVIDIA GPUDirect Peer to Peer technology is unavailable, the data from the source GPU will be copied first to host-pinned shared memory through the CPU and the PCIe bus. Then, the data will be copied from the host-pinned shared memory to the target GPU through the CPU and the PCIe bus. Note that the data is copied twice before reaching its destination, not to mention the CPU and host memory are involved in this process. Figure 4 depicts the data movement described before.

When GPUDirect Peer to Peer technology is available, copying data from a source GPU to another GPU in the same node does not require the temporary staging of the data into the host memory anymore. If both GPUs are attached to the same PCIe bus, GPUDirect P2P allows for accessing their corresponding memory without involving the CPU. The former halves the number of copy operations needed to perform the same task. Figure 5 depicts the behavior just described.

Inter-node data transfer bottleneck

In a multi-node environment where NVIDIA GPUDirect Remote Direct Memory Access technology is unavailable, transferring data between two GPUs in different nodes requires five copy operations:

• The first copy occurs when transferring the data from the source GPU to a buffer of host-pinned memory in the source node.
• Then, that data is copied to the NIC’s driver buffer of the source node.
• In a third step, the data is transferred through the network to NIC’s driver buffer of the target node.
• A fourth copy happens when copying the data from the target’s node NIC’s driver buffer to a buffer of host-pinned memory in the target node.
• The last step requires copying the data to the target GPU using the PCIe bus.

That makes a total of five copy operations. What a journey, isn’t it? Figure 6 depicts the process described before.

With GPUDirect RDMA enabled, the number of data copies gets reduced to just one. No more intermediate data copies in shared pinned memory. We can directly copy the data from the source GPU to the target GPU in a single run. That saves us four unnecessary copy operations, compared to a traditional setting. Figure 7 depicts this scenario.

Conclusion

In our second post, you have learned how to exploit NVIDIA GPUDirect functionality to further accelerate the data loading and data distribution stages of your pipeline.

In the third part of our trilogy, we will dive into the implementation details of a medical data science pipeline for the outlier detection of heartbeats in a continuously measured electrocardiogram (ECG) stream.

This back-to-school season, many universities are powering on brand new AI supercomputers. Researchers and students working in fields from basic science to liberal arts can’t wait to log on. “They would like to use it right now,” said James Wilgenbusch, director of research computing at the University of Minnesota, speaking of Agate, an accelerated supercomputer Read article >

The post Big Computer on Campus: Universities Graduate to AI Super Systems appeared first on The Official NVIDIA Blog.

NVIDIA Omniverse is key to bringing advanced architectural design concepts combining AI, simulation and collaborative workflows to the next generation of students.

NVIDIA announced at SIGGRAPH several additions to its Deep Learning Institute (DLI) curriculum, including an introductory course to Pixar’s Universal Scene Description (USD) and a teaching kit for educators, looking to incorporate hands-on technical training into graphics, architectural design, and digital media production coursework. 

The teaching kit will be based on NVIDIA Omniverse, an open platform for virtual collaboration and real-time simulation for quick and easy creation of photorealistic, physically accurate designs.

NVIDIA is collaborating with Professor Don Greenberg from Cornell University

NVIDIA Omniverse is key to bringing advanced architectural design concepts—which combine AI, simulation, and collaborative workflows—to the next generation of students. 

Professor Don Greenberg will be joining NVIDIA to codevelop Omniverse-based lecture materials, hands-on exercises, and strategies for early-stage design, which can be integrated into class curricula. Greenberg is Cornell University’s Jacob Gould Schurman Professor of Computer Graphics in the College of Architecture, Art, and Planning’s Department of Architecture and Director of the Cornell Program of Computer Graphics.

Greenberg’s expertise is extensive, having authored hundreds of articles, and educated thousands of computer graphics students, architects, and structural engineers. A Coon’s awards winner in 1987, two of his students (Rob Cook and Michael Cohen) have also won the award. Among Greenberg’s students, six have won the SIGGRAPH Achievement Award, and 16 have won Academy Awards for Scientific and Technical Achievements.

“Omniverse, combined with the computational power of new NVIDIA graphics boards, holds the incredible potential to improve early design strategies. This is the time in the design cycle when the most important design decisions are made. By combining the sketched ideas with rapid feedback from parametric studies, such as energy performance, structural Integrity, life cycle costing, or the overall appearance or view options from the nonexistent simulated building in context, better and more comprehensive solutions can be obtained from sketch to reality,” said Greenberg. “I am really excited to start this collaboration with NVIDIA and make these next generation design tools available to other schools and the profession.”

New DLI Graphics and Omniverse Teaching Kit

Designed for educators, the new Graphics & Omniverse Teaching Kit is being developed in consultation with top digital media, film, game development, animation, and visual effects schools as part of the NVIDIA Studio Education Partner Program. 

Comprehensive and modular, the kit will include lecture materials, quiz problem sets, hands-on exercises, NVIDIA GPU Cloud resources, and more. It is ideal for college and university educators looking to bring graphics and NVIDIA Omniverse into their classrooms, enabling the next generation of creatives. Students will have the opportunity to receive certificates of competency to support career growth. 

The kit will also incorporate teaching materials from The Graphics Codex, an in-depth computer rendering resource covering ray tracing, materials, GPU programming, and human perception. The Graphics Codex was written by Morgan McGuire, the Chief Scientist at Roblox and Computer Science professor at the Universe of Waterloo and McGill University. Also included is the new Ray Tracing Gems II ebook, authored by Adam Marrs, which covers Next Generation Real-Time Rendering with DXR, Vulkan, and OptiX. Marrs is a senior graphics engineer in the Game Engines and Core Technology group at NVIDIA, where he works on real-time rendering for games and film.

More content is being added and early access applications for educators are now available.  

New DLI Training for Everyone 

For those wanting to start using Omniverse to create their own masterpieces but not sure where to start, NVIDIA launched a new DLI training course called Getting Started with Universal Scene Description for Collaborative 3D Workflows.

This self-paced, introductory training course familiarizes users with Universal Scene Description (USD), a framework created by Pixar for the interchange of 3D computer graphics data. USD focuses on collaboration, nondestructive editing, and multiple views and opinions on graphics data. 

The course covers the history and purpose of USD, an overview of scene composition using Python, and includes a series of hands-on exercises consisting of training videos and live scripted examples. Developers will master important concepts such as layer composition, references, and variants. 

This course can be taken anytime, anywhere, with just a computer and an Internet connection—enroll here. 

Also released at SIGGRAPH is Masterclass by the Masters – Using Omniverse for Artistic 3D Workflows, a new video series focused on how Omniverse can be customized for artistic and creative workflows. Viewers will experience a collection of vignettes made by experts and creative masters, plus live-edit, multi-app workflows using Omniverse Connectors, as well as scene composition and rendering in Omniverse Create.

DLI’s top-rated Fundamentals of Deep Learning will be available at a special offer to all SIGGRAPH attendees throughout August and September. Use the code DLI_SIGGRAPH21 to receive 25% off this workshop. This instructor-led course takes participants through the workings of deep learning with hands-on exercises in computer vision and natural language processing. Those who complete the course will earn a certificate demonstrating their subject matter competency and supporting career growth. 

These courses are just a fraction of what is offered through NVIDIA DLI. Since 2017, DLI has trained more than 300,000 developers through an extensive catalog of training offerings. 

For other NVIDIA announcements and events at this year’s SIGGRAPH, including even more training opportunities, visit the SIGGRAPH page.