Skip to main content
Ctrl+K
NVIDIA NIM for Large Language Models (LLMs) - Home

NVIDIA NIM for Large Language Models (LLMs)

  • Documentation Home
NVIDIA NIM for Large Language Models (LLMs) - Home

NVIDIA NIM for Large Language Models (LLMs)
  • Documentation Home

Table of Contents

NVIDIA NIM for LLMs

  • Introduction
  • Release Notes
  • Getting Started
  • Deployment Guide
  • Air Gap Deployment
  • Multi-Node Deployment
  • Deploying with Helm
  • Tutorials
  • Configuring a NIM
  • Model Profiles
  • Overview
  • Benchmarking
  • Models
  • Supported Models
  • Examples with system role
  • API Reference
  • Function Calling
  • Using Reward Models
  • Using Reasoning Models
  • Llama Stack API (Experimental)
  • Utilities
  • Fine-tuned model support
  • Observability
  • Structured Generation
  • Custom Guided Decoding Backend (Experimental)
  • Parameter-Efficient Fine-Tuning
  • KV Cache Reuse (a.k.a. prefix caching)
  • Acknowledgements
  • Eula

Index

Symbols | C

Symbols

  • --all
    • command line option
  • --lora
    • command line option
  • --model-store
    • command line option
  • --profile
    • command line option
  • --profiles
    • command line option
  • -m
    • command line option
  • -p
    • command line option, [1]

C

  • command line option
    • --all
    • --lora
    • --model-store
    • --profile
    • --profiles
    • -m
    • -p, [1]
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA Corporation.

Last updated on May 30, 2025.