NVIDIA Technical Blog

Recent

See all
Feb 25, 2025

Featured Spatial Computing and XR Sessions at NVIDIA GTC 2025

Explore the future of extended reality, and learn how spatial computing is changing the future of immersive development and industry workflows.
1 MIN READ
A picture of a computer chip.
Feb 25, 2025

Configurable Graph-Based Task Solving with the Marco Multi-AI Agent Framework for Chip Design

Chip and hardware design presents numerous challenges stemming from its complexity and advancing technologies. These challenges result in longer turn-around...
8 MIN READ
Decorative image.
Feb 25, 2025

Defining LLM Red Teaming

There is an activity where people provide inputs to generative AI technologies, such as large language models (LLMs), to see if the outputs can be made to...
10 MIN READ
Decorative image.
Feb 25, 2025

Agentic Autonomy Levels and Security

Agentic workflows are the next evolution in AI-powered tools. They enable developers to chain multiple AI models together to perform complex activities, enable...
14 MIN READ
Feb 25, 2025

NVIDIA cuDSS Advances Solver Technologies for Engineering and Scientific Computing

NVIDIA cuDSS is a first-generation sparse direct solver library designed to accelerate engineering and scientific computing. cuDSS is increasingly adopted in...
12 MIN READ
NVIDIA DLI Teaching Kit logo on a black background.
Feb 25, 2025

NVIDIA Deep Learning Institute Releases New Generative AI Teaching Kit

Generative AI, powered by advanced machine learning models and deep neural networks, is revolutionizing industries by generating novel content and driving...
7 MIN READ
A person looking over an AV equipment bank.
Feb 24, 2025

NVIDIA Video Codec SDK 13.0 Powered by NVIDIA Blackwell

The release of NVIDIA Video Codec SDK 13.0 marks a significant upgrade, adding support for the latest-generation NVIDIA Blackwell GPUs. This version brings a...
10 MIN READ
Collage of use case thumbnails, including avatars, imaging, and chatbots.
Feb 24, 2025

NVIDIA AI Enterprise Adds Support for NVIDIA H200 NVL

NVIDIA AI Enterprise is the cloud-native software platform for the development and deployment of production-grade AI solutions. The latest release of the NVIDIA...
4 MIN READ
Decorative image.
Feb 24, 2025

Enabling Stereoscopic and 3D Views Using MV-HEVC in NVIDIA Video Codec SDK 13.0

NVIDIA announces the implementation of Multi-View High Efficiency Video Coding (MV-HEVC) encoder in the latest NVIDIA Video Codec SDK release, version 13.0....
4 MIN READ
Feb 24, 2025

Featured Telecom Sessions at NVIDIA GTC 2025

Discover how telcos use AI to transform networks, customer experiences, and open business opportunities.
1 MIN READ
Feb 20, 2025

Transforming Product Design Workflows in Manufacturing with Generative AI

Traditional design and engineering workflows in the manufacturing industry have long been characterized by a sequential, iterative approach that is often...
7 MIN READ
Two people sitting at their desks with icons for speech translation in the background.
Feb 20, 2025

Deploying NVIDIA Riva Multilingual ASR with Whisper and Canary Architectures While Selectively Deactivating NMT

NVIDIA has consistently developed automatic speech recognition (ASR) models that set the benchmark in the industry. Earlier versions of NVIDIA Riva, a...
12 MIN READ

Inference Performance

See all
Feb 14, 2025

Optimizing Qwen2.5-Coder Throughput with NVIDIA TensorRT-LLM Lookahead Decoding

Large language models (LLMs) that specialize in coding have been steadily adopted into developer workflows. From pair programming to self-improving AI agents,...
7 MIN READ
Jan 24, 2025

Optimize AI Inference Performance with NVIDIA Full-Stack Solutions

The explosion of AI-driven applications has placed unprecedented demands on both developers, who must balance delivering cutting-edge performance with managing...
9 MIN READ
Dec 18, 2024

NVIDIA TensorRT-LLM Now Supports Recurrent Drafting for Optimizing LLM Inference

Recurrent drafting (referred as ReDrafter) is a novel speculative decoding technique developed and open-sourced by Apple for large language model (LLM)...
6 MIN READ
Dec 17, 2024

Boost Llama 3.3 70B Inference Throughput 3x with NVIDIA TensorRT-LLM Speculative Decoding

Meta's Llama collection of open large language models (LLMs) continues to grow with the recent addition of Llama 3.3 70B, a text-only...
8 MIN READ
Dec 05, 2024

Spotlight: Perplexity AI Serves 400 Million Search Queries a Month Using NVIDIA Inference Stack

The demand for AI-enabled services continues to grow rapidly, placing increasing pressure on IT and infrastructure teams. These teams are tasked with...
7 MIN READ
Image of the TensorRT-LLM icon next to multiple other icons of computer activities.
Dec 02, 2024

TensorRT-LLM Speculative Decoding Boosts Inference Throughput by up to 3.6x

NVIDIA TensorRT-LLM support for speculative decoding now provides over 3x the speedup in total token throughput. TensorRT-LLM is an open-source library that...
9 MIN READ
Image of an HGX H200
Nov 21, 2024

NVIDIA TensorRT-LLM Multiblock Attention Boosts Throughput by More Than 3x for Long Sequence Lengths on NVIDIA HGX H200

Generative AI models are advancing rapidly. Every generation of models comes with a larger number of parameters and longer context windows. The Llama 2 series...
5 MIN READ
Nov 19, 2024

Llama 3.2 Full-Stack Optimizations Unlock High Performance on NVIDIA GPUs

Meta recently released its Llama 3.2 series of vision language models (VLMs), which come in 11B parameter and 90B parameter variants. These models are...
6 MIN READ
Nov 15, 2024

Streamlining AI Inference Performance and Deployment with NVIDIA TensorRT-LLM Chunked Prefill

In this blog post, we take a closer look at chunked prefill, a feature of NVIDIA TensorRT-LLM that increases GPU utilization and simplifies the deployment...
4 MIN READ
NVIDIA H100.
Nov 08, 2024

5x Faster Time to First Token with NVIDIA TensorRT-LLM KV Cache Early Reuse

In our previous blog post, we demonstrated how reusing the key-value (KV) cache by offloading it to CPU memory can accelerate time to first token (TTFT) by up...
5 MIN READ
Image of an HGX H200
Nov 01, 2024

3x Faster AllReduce with NVSwitch and TensorRT-LLM MultiShot

Deploying generative AI workloads in production environments where user numbers can fluctuate from hundreds to hundreds of thousands – and where input...
5 MIN READ
Oct 28, 2024

NVIDIA GH200 Superchip Accelerates Inference by 2x in Multiturn Interactions with Llama Models

Deploying large language models (LLMs) in production environments often requires making hard trade-offs between enhancing user interactivity and increasing...
7 MIN READ

Generative AI

See all
A picture of a computer chip.
Feb 25, 2025

Configurable Graph-Based Task Solving with the Marco Multi-AI Agent Framework for Chip Design

Chip and hardware design presents numerous challenges stemming from its complexity and advancing technologies. These challenges result in longer turn-around...
8 MIN READ
Decorative image.
Feb 25, 2025

Defining LLM Red Teaming

There is an activity where people provide inputs to generative AI technologies, such as large language models (LLMs), to see if the outputs can be made to...
10 MIN READ
Decorative image.
Feb 25, 2025

Agentic Autonomy Levels and Security

Agentic workflows are the next evolution in AI-powered tools. They enable developers to chain multiple AI models together to perform complex activities, enable...
14 MIN READ
NVIDIA DLI Teaching Kit logo on a black background.
Feb 25, 2025

NVIDIA Deep Learning Institute Releases New Generative AI Teaching Kit

Generative AI, powered by advanced machine learning models and deep neural networks, is revolutionizing industries by generating novel content and driving...
7 MIN READ
Collage of use case thumbnails, including avatars, imaging, and chatbots.
Feb 24, 2025

NVIDIA AI Enterprise Adds Support for NVIDIA H200 NVL

NVIDIA AI Enterprise is the cloud-native software platform for the development and deployment of production-grade AI solutions. The latest release of the NVIDIA...
4 MIN READ
Feb 20, 2025

Transforming Product Design Workflows in Manufacturing with Generative AI

Traditional design and engineering workflows in the manufacturing industry have long been characterized by a sequential, iterative approach that is often...
7 MIN READ
Two people sitting at their desks with icons for speech translation in the background.
Feb 20, 2025

Deploying NVIDIA Riva Multilingual ASR with Whisper and Canary Architectures While Selectively Deactivating NMT

NVIDIA has consistently developed automatic speech recognition (ASR) models that set the benchmark in the industry. Earlier versions of NVIDIA Riva, a...
12 MIN READ
Feb 20, 2025

Upcoming Livestream: Using the NVIDIA AI Blueprint for PDF to Podcast 

Join us on February 27 to learn how to transform PDFs into AI podcasts using the NVIDIA AI Blueprint.
1 MIN READ
A character face on a black background.
Feb 20, 2025

Bring NVIDIA ACE AI Characters to Games with the New In-Game Inferencing SDK

NVIDIA ACE is a suite of digital human technologies that bring game characters and digital assistants to life with generative AI. ACE on-device models enable...
11 MIN READ
Feb 19, 2025

Spotlight: Drug Discovery Startup Protai Advances Complex Structure Prediction with AlphaFold, Proteomics, and NVIDIA NIM

Generative AI, especially with breakthroughs like AlphaFold and RosettaFold, is transforming drug discovery and how biotech companies and research laboratories...
10 MIN READ
A horizontal helix.
Feb 19, 2025

Understanding the Language of Life's Biomolecules Across Evolution at a New Scale with Evo 2

AI has evolved from an experimental curiosity to a driving force within biological research. The convergence of deep learning algorithms, massive omics...
9 MIN READ
Feb 14, 2025

Featured Sessions for Students at NVIDIA GTC 2025

Learn from researchers, scientists, and industry leaders across a variety of topics including AI, robotics, and Data Science.
1 MIN READ

Data Science

See all
A diagram of how JSON data is processed.
Feb 20, 2025

JSON Lines Reading with pandas 100x Faster Using NVIDIA cuDF

JSON is a widely adopted format for text-based information working interoperably between systems, most commonly in web applications and large language models...
10 MIN READ
A horizontal helix.
Feb 19, 2025

Understanding the Language of Life's Biomolecules Across Evolution at a New Scale with Evo 2

AI has evolved from an experimental curiosity to a driving force within biological research. The convergence of deep learning algorithms, massive omics...
9 MIN READ
Feb 14, 2025

Featured Sessions for Students at NVIDIA GTC 2025

Learn from researchers, scientists, and industry leaders across a variety of topics including AI, robotics, and Data Science.
1 MIN READ
Feb 13, 2025

Using NetworkX, Jaccard Similarity, and cuGraph to Predict Your Next Favorite Movie

As the amount of data available to everyone in the world increases, the ability for a consumer to make informed decisions becomes increasingly difficult....
9 MIN READ
Decorative image of code with a 9 in highlights in the background.
Feb 10, 2025

NVIDIA Open GPU Datacenter Drivers for RHEL9 Signed by Red Hat

NVIDIA and Red Hat have partnered to bring continued improvements to the precompiled NVIDIA Driver introduced in 2020. Last month, NVIDIA announced that the...
4 MIN READ
Feb 06, 2025

Get Started with GPU Acceleration for Data Science

In data science, operational efficiency is key to handling increasingly complex and large datasets. GPU acceleration has become essential for modern workflows,...
8 MIN READ
Feb 05, 2025

Featured Researcher and Educator Sessions at NVIDIA GTC 2025

Explore the latest advancements in academia, including advanced research, innovative teaching methods, and the future of learning and technology.
1 MIN READ
An image of cancer cells up close.
Feb 04, 2025

AI Foundation Model Enhances Cancer Diagnosis and Tailors Treatment

A new study and AI model from researchers at Stanford University is streamlining cancer diagnostics, treatment planning, and prognosis prediction. Named MUSK...
4 MIN READ
Jan 31, 2025

CUDA Toolkit Now Available for NVIDIA Blackwell 

The latest release of the CUDA Toolkit, version 12.8, continues to push accelerated computing performance in data sciences, AI, scientific computing, and...
9 MIN READ
Decorative image of a computer monitor with icons floating around it.
Jan 30, 2025

Mastering the cudf.pandas Profiler for GPU Acceleration

In the world of Python data science, pandas has long reigned as the go-to library for intuitive data manipulation and analysis. However, as data volumes grow,...
6 MIN READ
A diagram of how JSON data is processed.
Jan 29, 2025

Accelerating JSON Processing on Apache Spark with GPUs

JSON is a popular format for text-based data that allows for interoperability between systems in web applications as well as data management. The format has...
9 MIN READ
Jan 29, 2025

Mastering LLM Techniques: Evaluation

Evaluating large language models (LLMs) and retrieval-augmented generation (RAG) systems is a complex and nuanced process, reflecting the sophisticated and...
12 MIN READ

Robotics

See all
Feb 25, 2025

Featured Spatial Computing and XR Sessions at NVIDIA GTC 2025

Explore the future of extended reality, and learn how spatial computing is changing the future of immersive development and industry workflows.
1 MIN READ
3 tiles showing solar, coral reefs, and a hurricane.
Feb 20, 2025

AI for Climate, Energy, and Ecosystem Resilience at NVIDIA GTC 2025

From mitigating climate change to improving disaster response and environmental monitoring, AI is reshaping how we tackle critical global challenges....
6 MIN READ
Feb 20, 2025

Featured Computer Vision and Video Analytics Sessions at NVIDIA GTC 2025

Explore visually perceptive AI agents, the latest vision AI technologies, hands-on training, and inspiring deployments.
1 MIN READ
Feb 14, 2025

Featured Sessions for Students at NVIDIA GTC 2025

Learn from researchers, scientists, and industry leaders across a variety of topics including AI, robotics, and Data Science.
1 MIN READ
Feb 05, 2025

Featured Researcher and Educator Sessions at NVIDIA GTC 2025

Explore the latest advancements in academia, including advanced research, innovative teaching methods, and the future of learning and technology.
1 MIN READ
Image of an autonomous mobile robot on a factory floor in a digital twin screenshot.
Jan 30, 2025

How to Use OpenUSD

Universal Scene Description (OpenUSD) is an open, extensible framework and ecosystem with APIs for composing, editing, querying, rendering, collaborating, and...
8 MIN READ
Stylized image of JetPack connected to a monitor.
Jan 16, 2025

NVIDIA JetPack 6.2 Brings Super Mode to NVIDIA Jetson Orin Nano and Jetson Orin NX Modules

The introduction of the NVIDIA Jetson Orin Nano Super Developer Kit sparked a new age of generative AI for small edge devices. The new Super Mode delivered an...
12 MIN READ
Jan 09, 2025

Advancing Physical AI with NVIDIA Cosmos World Foundation Model Platform

As robotics and autonomous vehicles advance, accelerating development of physical AI—which enables autonomous machines to perceive, understand, and perform...
14 MIN READ
Jan 09, 2025

Upcoming Livestream: NVIDIA Developer Highlights from CES 2025

Tune in January 16th at 9:00 AM PT for a live recap, followed by a Q&A of the latest developer announcements at CES 2025.
1 MIN READ
NeMo framework icons on a purple background.
Jan 07, 2025

Accelerate Custom Video Foundation Model Pipelines with New NVIDIA NeMo Framework Capabilities

Generative AI has evolved from text-based models to multimodal models, with a recent expansion into video, opening up new potential uses across various...
10 MIN READ
Jan 06, 2025

Just Released: Omniverse Kit SDK 106.5

Kit 106.5 now supports USDz exports, improved new project flow, and preview of new RTX real-time mode.
1 MIN READ
Two views of a robot picker, real and computerized.
Jan 06, 2025

Advancing Robot Learning, Perception, and Manipulation with Latest NVIDIA Isaac Release

At CES 2025, NVIDIA announced key updates to NVIDIA Isaac, a platform of accelerated libraries, application frameworks, and AI models that accelerate the...
9 MIN READ

Simulation / Modeling / Design

See all
Feb 25, 2025

Featured Spatial Computing and XR Sessions at NVIDIA GTC 2025

Explore the future of extended reality, and learn how spatial computing is changing the future of immersive development and industry workflows.
1 MIN READ
Feb 25, 2025

NVIDIA cuDSS Advances Solver Technologies for Engineering and Scientific Computing

NVIDIA cuDSS is a first-generation sparse direct solver library designed to accelerate engineering and scientific computing. cuDSS is increasingly adopted in...
12 MIN READ
3 tiles showing solar, coral reefs, and a hurricane.
Feb 20, 2025

AI for Climate, Energy, and Ecosystem Resilience at NVIDIA GTC 2025

From mitigating climate change to improving disaster response and environmental monitoring, AI is reshaping how we tackle critical global challenges....
6 MIN READ
Feb 20, 2025

Spotlight: University of Tokyo Uses NVIDIA Grace Hopper for Groundbreaking Energy-Efficient Seismic Research

Supercomputers are the engines of groundbreaking discoveries. From predicting extreme weather to advancing disease research and designing safer, more efficient...
6 MIN READ
Feb 14, 2025

Featured Sessions for Students at NVIDIA GTC 2025

Learn from researchers, scientists, and industry leaders across a variety of topics including AI, robotics, and Data Science.
1 MIN READ
Feb 13, 2025

Spotlight: BRLi and Toulouse INP Develop AI-Based Flood Models Using NVIDIA Modulus

Flooding poses a significant threat to 1.5 billion people, making it the most common cause of major natural disasters. Floods cause up to $25 billion in global...
6 MIN READ
Feb 11, 2025

Featured Energy Sessions at NVIDIA GTC 2025

Learn from energy leaders using HPC and AI to boost exploration, production, and fuel delivery, while enhancing power grid reliability and resiliency.
1 MIN READ
Decorative image of code with a 9 in highlights in the background.
Feb 10, 2025

NVIDIA Open GPU Datacenter Drivers for RHEL9 Signed by Red Hat

NVIDIA and Red Hat have partnered to bring continued improvements to the precompiled NVIDIA Driver introduced in 2020. Last month, NVIDIA announced that the...
4 MIN READ
Feb 06, 2025

Render Path-Traced Hair in Real Time with NVIDIA GeForce RTX 50 Series GPUs

Hardware support for ray tracing triangle meshes was introduced as part of NVIDIA RTX in 2018. But ray tracing for hair and fur has remained a compute-intensive...
9 MIN READ
Feb 05, 2025

Featured Researcher and Educator Sessions at NVIDIA GTC 2025

Explore the latest advancements in academia, including advanced research, innovative teaching methods, and the future of learning and technology.
1 MIN READ
Jan 31, 2025

New Scaling Algorithm and Initialization with NVIDIA Collective Communications Library 2.23

The NVIDIA Collective Communications Library (NCCL) implements multi-GPU and multinode communication primitives optimized for NVIDIA GPUs and networking. NCCL...
9 MIN READ
Jan 31, 2025

Dynamic Loading in the CUDA Runtime

Historically, the GPU device code is compiled alongside the application with offline tools such as nvcc. In this case, the GPU device code is managed internally...
8 MIN READ

Computer Vision / Video Analytics

See all
A person looking over an AV equipment bank.
Feb 24, 2025

NVIDIA Video Codec SDK 13.0 Powered by NVIDIA Blackwell

The release of NVIDIA Video Codec SDK 13.0 marks a significant upgrade, adding support for the latest-generation NVIDIA Blackwell GPUs. This version brings a...
10 MIN READ
Decorative image.
Feb 24, 2025

Enabling Stereoscopic and 3D Views Using MV-HEVC in NVIDIA Video Codec SDK 13.0

NVIDIA announces the implementation of Multi-View High Efficiency Video Coding (MV-HEVC) encoder in the latest NVIDIA Video Codec SDK release, version 13.0....
4 MIN READ
3 tiles showing solar, coral reefs, and a hurricane.
Feb 20, 2025

AI for Climate, Energy, and Ecosystem Resilience at NVIDIA GTC 2025

From mitigating climate change to improving disaster response and environmental monitoring, AI is reshaping how we tackle critical global challenges....
6 MIN READ
Feb 20, 2025

Featured Computer Vision and Video Analytics Sessions at NVIDIA GTC 2025

Explore visually perceptive AI agents, the latest vision AI technologies, hands-on training, and inspiring deployments.
1 MIN READ
Feb 13, 2025

Upcoming Webinar: Unlocking Video Analytics With AI Agents

Master prompt engineering, fine-tuning, and customization to build video analytics AI agents.
1 MIN READ
Feb 10, 2025

Just Released: Tripy, a Python Programming Model For TensorRT

Experience high-performance inference, usability, intuitive APIs, easy debugging with eager mode, clear error messages, and more.
1 MIN READ
Feb 05, 2025

Featured Researcher and Educator Sessions at NVIDIA GTC 2025

Explore the latest advancements in academia, including advanced research, innovative teaching methods, and the future of learning and technology.
1 MIN READ
Feb 04, 2025

New AI Model Offers Cellular-Level View of Cancerous Tumors

Researchers studying cancer unveiled a new AI model that provides cellular-level mapping and visualizations of cancer cells, which scientists hope can shed...
3 MIN READ
An image of cancer cells up close.
Feb 04, 2025

AI Foundation Model Enhances Cancer Diagnosis and Tailors Treatment

A new study and AI model from researchers at Stanford University is streamlining cancer diagnostics, treatment planning, and prognosis prediction. Named MUSK...
4 MIN READ
An illustration of DNA molecule structure.
Jan 29, 2025

Advancing Rare Disease Detection with AI-Powered Cellular Profiling

Rare diseases are difficult to diagnose due to limitations in traditional genomic sequencing. Wolfgang Pernice, assistant professor at Columbia University, is...
3 MIN READ
A woman doctor holding up two spinal X-rays.
Jan 22, 2025

Spinal Health Diagnostics Gets Deep Learning Automation

An advanced deep-learning model that automates X-ray analysis for faster and more accurate assessments could transform spinal health diagnostics. Capable of...
4 MIN READ
An illustration of an Undocumented Orphaned Well.
Jan 16, 2025

AI Uncovers Potentially Hazardous, Forgotten Oil and Gas Wells

With as many as 800,000 forgotten oil and gas wells scattered across the US, researchers from Lawrence Berkeley National Laboratory (LBNL), have developed an AI...
5 MIN READ

Content Creation / Rendering

See all
A person looking over an AV equipment bank.
Feb 24, 2025

NVIDIA Video Codec SDK 13.0 Powered by NVIDIA Blackwell

The release of NVIDIA Video Codec SDK 13.0 marks a significant upgrade, adding support for the latest-generation NVIDIA Blackwell GPUs. This version brings a...
10 MIN READ
Decorative image.
Feb 24, 2025

Enabling Stereoscopic and 3D Views Using MV-HEVC in NVIDIA Video Codec SDK 13.0

NVIDIA announces the implementation of Multi-View High Efficiency Video Coding (MV-HEVC) encoder in the latest NVIDIA Video Codec SDK release, version 13.0....
4 MIN READ
Feb 06, 2025

Render Path-Traced Hair in Real Time with NVIDIA GeForce RTX 50 Series GPUs

Hardware support for ray tracing triangle meshes was introduced as part of NVIDIA RTX in 2018. But ray tracing for hair and fur has remained a compute-intensive...
9 MIN READ
An image of a building with ornate columns and greenery at night, with lighting.
Feb 06, 2025

Get Started with Neural Rendering Using NVIDIA RTX Kit

Neural rendering is the next era of computer graphics.  By integrating neural networks into the rendering process, we can take dramatic leaps forward in...
11 MIN READ
Feb 06, 2025

NVIDIA RTX Mega Geometry Now Available with New Vulkan Samples

Geometric detail in computer graphics has increased exponentially in the past 30 years. To render high quality assets with higher instance counts and greater...
5 MIN READ
Jan 30, 2025

Build Apps with Neural Rendering Using NVIDIA Nsight Developer Tools on GeForce RTX 50 Series GPUs

The next generation of NVIDIA graphics hardware has arrived. Powered by NVIDIA Blackwell, GeForce RTX 50 Series GPUs deliver groundbreaking new RTX features...
4 MIN READ
Jan 30, 2025

How to Integrate NVIDIA DLSS 4 into Your Game with NVIDIA Streamline

NVIDIA DLSS 4 is the latest iteration of DLSS introduced with the NVIDIA GeForce RTX 50 Series GPUs. It includes several new features: DLSS Multi Frame...
8 MIN READ
Jan 13, 2025

Just Released: Learn OpenUSD with New Applied Concepts Courses

Take the three self-paced courses at no cost through the NVIDIA Deep Learning Institute (DLI).
1 MIN READ
Jan 09, 2025

Upcoming Livestream: NVIDIA Developer Highlights from CES 2025

Tune in January 16th at 9:00 AM PT for a live recap, followed by a Q&A of the latest developer announcements at CES 2025.
1 MIN READ
Jan 06, 2025

NVIDIA RTX Neural Rendering Introduces Next Era of AI-Powered Graphics Innovation

NVIDIA today unveiled next-generation hardware for gamers, creators, and developers—the GeForce RTX 50 Series desktop and laptop GPUs. Alongside these GPUs,...
12 MIN READ
Dec 20, 2024

Just Released: GPU Zen 3: Advanced Rendering Techniques

Grab your copy of GPU Zen 3 to learn about the latest in real-time rendering.
1 MIN READ
Post-visualization still from Mad Max: Furiosa. A close-up view of a desert chase scene after a disaster. The scene has modified vehicles, including a big tanker truck, a crane-like vehicle, motorbikes, and a pickup truck driving fast across a dusty, reddish-brown road under a dramatic, cloudy sky.
Dec 19, 2024

Accelerating Film Production with Dell AI Factory and NVIDIA

Filmmaking is an intricate and complex process that involves a diverse team of artists, writers, visual effects professionals, technicians, and countless other...
5 MIN READ

Conversational AI

See all
Two people sitting at their desks with icons for speech translation in the background.
Feb 20, 2025

Deploying NVIDIA Riva Multilingual ASR with Whisper and Canary Architectures While Selectively Deactivating NMT

NVIDIA has consistently developed automatic speech recognition (ASR) models that set the benchmark in the industry. Earlier versions of NVIDIA Riva, a...
12 MIN READ
Feb 05, 2025

Improving Translation Quality with Domain-Specific Fine-Tuning and NVIDIA NIM

Translation plays an essential role in enabling companies to expand across borders, with requirements varying significantly in terms of tone, accuracy, and...
8 MIN READ
Jan 09, 2025

Announcing Nemotron-CC: A Trillion-Token English Language Dataset for LLM Pretraining

NVIDIA is excited to announce the release of Nemotron-CC, a 6.3-trillion-token English language Common Crawl dataset for pretraining highly accurate large...
4 MIN READ
Jan 09, 2025

Upcoming Livestream: NVIDIA Developer Highlights from CES 2025

Tune in January 16th at 9:00 AM PT for a live recap, followed by a Q&A of the latest developer announcements at CES 2025.
1 MIN READ
A surgeon using a medical device in an operating room.
Dec 20, 2024

Build a Generative AI Medical Device Training Assistant with NVIDIA NIM Microservices

Innovation in medical devices continues to accelerate, with a record number authorized by the FDA every year. When these new or updated devices are introduced...
5 MIN READ
Dec 16, 2024

Sandboxing Agentic AI Workflows with WebAssembly

Agentic AI workflows often involve the execution of large language model (LLM)-generated code to perform tasks like creating data visualizations. However, this...
7 MIN READ
Dec 11, 2024

Three Building Blocks for Creating AI Virtual Assistants for Customer Service with an NVIDIA AI Blueprint

In today's fast-paced business environment, providing exceptional customer service is no longer just a nice-to-have—it's a necessity. Whether addressing...
10 MIN READ
Nov 22, 2024

Hymba Hybrid-Head Architecture Boosts Small Language Model Performance

Transformers, with their attention-based architecture, have become the dominant choice for language models (LMs) due to their strong performance,...
12 MIN READ
Chatbot avatar in front of a stylized chat screen on a purple background.
Nov 19, 2024

Create a Custom Slackbot LLM Agent with NVIDIA NIM and LangChain

In the dynamic world of modern business, where communication and efficient workflows are crucial for success, AI-powered solutions have become a competitive...
9 MIN READ
GIF shows chat app in use.
Oct 28, 2024

Creating RAG-Based Question-and-Answer LLM Workflows at NVIDIA

The rapid development of solutions using retrieval augmented generation (RAG) for question-and-answer LLM workflows has led to new types of system...
11 MIN READ
Oct 22, 2024

Scaling LLMs with NVIDIA Triton and NVIDIA TensorRT-LLM Using Kubernetes

Large language models (LLMs) have been widely used for chatbots, content generation, summarization, classification, translation, and more. State-of-the-art LLMs...
16 MIN READ
Oct 21, 2024

IBM’s New Granite 3.0 Generative AI Models Are Small, Yet Highly Accurate and Efficient

Today, IBM released the third generation of IBM Granite, a collection of open language models and complementary tools. Prior generations of Granite focused on...
5 MIN READ

Edge Computing

See all
Feb 20, 2025

Featured Computer Vision and Video Analytics Sessions at NVIDIA GTC 2025

Explore visually perceptive AI agents, the latest vision AI technologies, hands-on training, and inspiring deployments.
1 MIN READ
Two views of a robot picker, real and computerized.
Jan 06, 2025

Advancing Robot Learning, Perception, and Manipulation with Latest NVIDIA Isaac Release

At CES 2025, NVIDIA announced key updates to NVIDIA Isaac, a platform of accelerated libraries, application frameworks, and AI models that accelerate the...
9 MIN READ
Images on a conveyor belt identifed with computer vision.
Dec 19, 2024

AI Vision Helps Green Recycling Plants

Each year, the world recycles only around 13% of its two billion-plus tons of municipal waste. By 2050, the world's annual municipal waste will reach 3.88B...
4 MIN READ
Dec 18, 2024

Five Takeaways from NVIDIA 6G Developer Day 2024

NVIDIA 6G Developer Day 2024 brought together members of the 6G research and development community to share insights and learn new ways of engaging with NVIDIA...
10 MIN READ
Dec 17, 2024

NVIDIA Jetson Orin Nano Developer Kit Gets a “Super” Boost

The generative AI landscape is rapidly evolving, with new large language models (LLMs), visual language models (VLMs), and vision language action (VLA) models...
11 MIN READ
Nov 25, 2024

Just Released: NVIDIA DeepStream 7.1

The new release introduces Python support in Service Maker to accelerate real-time multimedia and AI inference applications with a powerful GStreamer...
1 MIN READ
Nov 22, 2024

Hymba Hybrid-Head Architecture Boosts Small Language Model Performance

Transformers, with their attention-based architecture, have become the dominant choice for language models (LMs) due to their strong performance,...
12 MIN READ
Connected icons show the workflow.
Nov 21, 2024

NVIDIA JetPack 6.1 Boosts Performance and Security through Camera Stack Optimizations and Introduction of Firmware TPM

NVIDIA JetPack has continuously evolved to offer cutting-edge software tailored to the growing needs of edge AI and robotic developers. With each release,...
8 MIN READ
Nov 14, 2024

NVIDIA DOCA 2.9 Enhances AI and Cloud Computing Infrastructure with New Performance and Security Features

NVIDIA DOCA enhances the capabilities of NVIDIA networking platforms by providing a comprehensive software framework for developers to leverage hardware...
9 MIN READ
Close-up shot of a wolf howling. Courtesy of Pexels/patrice schoefolt.
Oct 29, 2024

AI-Powered Devices Track Howls to Save Wolves

A new cell-phone-sized device—which can be deployed in vast, remote areas—is using AI to identify and geolocate wildlife to help conservationists track...
5 MIN READ
Oct 24, 2024

Powering the Next Wave of AI Robotics with Three Computers 

NVIDIA has built three computers and accelerated development platforms to enable developers to create physical AI.
1 MIN READ
A GIF of a hurricane forecast.
Oct 21, 2024

AI Accurately Forecasts Extreme Weather Up to 23 Days Ahead

New research from the University of Washington is refining AI weather models using deep learning for more accurate predictions and longer-term forecasts. The...
3 MIN READ

Data Center / Cloud

See all
Collage of use case thumbnails, including avatars, imaging, and chatbots.
Feb 24, 2025

NVIDIA AI Enterprise Adds Support for NVIDIA H200 NVL

NVIDIA AI Enterprise is the cloud-native software platform for the development and deployment of production-grade AI solutions. The latest release of the NVIDIA...
4 MIN READ
Feb 20, 2025

Spotlight: University of Tokyo Uses NVIDIA Grace Hopper for Groundbreaking Energy-Efficient Seismic Research

Supercomputers are the engines of groundbreaking discoveries. From predicting extreme weather to advancing disease research and designing safer, more efficient...
6 MIN READ
Feb 16, 2025

Featured Networking Sessions at NVIDIA GTC 2025

Explore the latest advancements in AI infrastructure, acceleration, and security from March 17-21.
1 MIN READ
Feb 13, 2025

Simplify System Memory Management with the Latest NVIDIA GH200 NVL2 Enterprise RA

NVIDIA Enterprise Reference Architectures (Enterprise RAs) can reduce the time and cost of deploying AI infrastructure solutions. They provide a streamlined...
8 MIN READ
A larger and smaller cartoon llama on a sunny beach, wearing shirts that say 8B and 4B.
Feb 12, 2025

LLM Model Pruning and Knowledge Distillation with NVIDIA NeMo Framework

Model pruning and knowledge distillation are powerful cost-effective strategies for obtaining smaller language models from an initial larger sibling. ...
10 MIN READ
Feb 11, 2025

Featured Energy Sessions at NVIDIA GTC 2025

Learn from energy leaders using HPC and AI to boost exploration, production, and fuel delivery, while enhancing power grid reliability and resiliency.
1 MIN READ
Three icons in a row, including DGX in the middle.
Feb 11, 2025

NVIDIA DGX Cloud Introduces Ready-To-Use Templates to Benchmark AI Platform Performance

In the rapidly evolving landscape of AI systems and workloads, achieving optimal model training performance extends far beyond chip speed. It requires a...
7 MIN READ
Picture of the NVIDIA Grace CPU on a black background.
Feb 10, 2025

NVIDIA Grace CPU Integrates with the Arm Software Ecosystem

The NVIDIA Grace CPU is transforming data center design by offering a new level of power-efficient performance. Built specifically for data center scale, the...
6 MIN READ
Feb 10, 2025

Just Released: Tripy, a Python Programming Model For TensorRT

Experience high-performance inference, usability, intuitive APIs, easy debugging with eager mode, clear error messages, and more.
1 MIN READ
Stack diagram for LLM Megatron Core.
Feb 05, 2025

OpenAI Triton on NVIDIA Blackwell Boosts AI Performance and Programmability

Matrix multiplication and attention mechanisms are the computational backbone of modern AI workloads. While libraries like NVIDIA cuDNN provide highly optimized...
5 MIN READ
Feb 05, 2025

Streamline Collaboration Across Local and Cloud Systems with NVIDIA AI Workbench

NVIDIA AI Workbench is a free development environment manager to develop, customize, and prototype AI applications on your GPUs. AI Workbench provides a...
8 MIN READ
Feb 04, 2025

Accelerating AI Storage by up to 48% with NVIDIA Spectrum-X Networking Platform and Partners

AI factories rely on more than just compute fabrics. While the East-West network connecting the GPUs is critical to AI application performance, the storage...
7 MIN READ