百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
T

TensorRT-CSharp-API

> 编程语言
开源

TensorRT 为.NET包装.

198 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

TensorRT 为.NET包装.

TensorRT CSharp API v4.0

TensorRT and CUDA bindings for C# and .NET, with managed APIs, project-owned bridge packages, runnable vision samples, and a TensorRtExec desktop workflow.

English | 简体中文

TensorRT CSharp API v4.0

TensorRT CSharp API v4.0 provides a .NET API for TensorRT inference, CUDA runtime compilation, memory, streams, callbacks, and the TensorRtExec desktop workflow. The stable 4.0.0 release is public; development now focuses on package-consuming examples, applications, and complete technical articles.

Introduction

The managed API keeps the public namespace roots stable:

  • JYPPX.TensorRtSharp is the main TensorRT surface and the default home for shared types.
  • JYPPX.CudaSharp is the CUDA surface.
  • Native bridge loading is explicit through jyppxtrtbridge and the versioned bridge package.

CUDA, cuDNN, TensorRT, and NVRTC are user-installed prerequisites. NVIDIA runtime redistribution is retired: this repository publishes managed source/packages and project-owned bridge-only packages, never CUDA/cuDNN/TensorRT vendor archives.

✨ Release Highlights

  • C# bindings and source are grouped by module under src.
  • TensorRT engine building, execution contexts, bindings, dynamic-shape profiles, allocators, logging, profiling, progress monitoring, streams, events, CUDA graphs, and CUDA RTC are covered by the managed API.
  • Runtime package roles are explicit: the .Bridge packages with split_package_roles=bridge contain only the project bridge for a fixed CUDA/TensorRT line.
  • NuGet branding is fixed: nuget/logo.jpg is the package logo and the English root README is embedded as the package README.
  • The release license is Apache-2.0.

Latest Update: 4.0.0

  • Finalizes the stable JYPPX.TensorRtSharp and JYPPX.CudaSharp namespace roots and the 4.0 managed API surface.
  • Publishes one managed package plus 6 Windows and 12 Linux project-owned Bridge packages; consumers install the matching NVIDIA runtime themselves.
  • Keeps CUDA, cuDNN, TensorRT, NVRTC, sample applications, and model binaries outside all NuGet packages.
  • The compatible managed-package maintenance revision 4.0.0.1 is available for current C# core changes; the Bridge package matrix remains on 4.0.0.

Read the detailed 4.0.0 notes, the 4.0.0.1 managed-package notes, or browse the complete version index.

Get Started In 30 Seconds

Create a console project, reference the managed package, and install the bridge package that matches the CUDA/TensorRT installation on the target machine:

powershell
dotnet new console -n TrtQuickstart
cd TrtQuickstart
dotnet add package JYPPX.TensorRT.CSharp.API --version 4.0.0
dotnet add package JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt10.11.cuda12.9.cudnn9.22.Bridge --version 4.0.0

The exact 4.0.0 version keeps restores reproducible without selecting API-incompatible historical 4.x packages such as 4.0.6170. Replace the Bridge package ID with the RID and NVIDIA-runtime matrix installed on the target machine.

Then create a runtime, load an engine, bind input/output tensors, execute, and read the result. The bridge package is not a replacement for the user-installed NVIDIA runtime. See the inference bindings tutorial and Windows installation guide.

Package Layout

Package Contents
JYPPX.TensorRT.CSharp.API Managed TensorRT and CUDA-facing C# API
JYPPX.TensorRT.CSharp.API.Runtime.*.Bridge Project-owned native bridge only; select one by RID/TensorRT/CUDA/cuDNN

Classification at samples/ComputerVision/01.Classification and YoloVision at applications/YoloVision are runnable examples. They consume the public 4-series managed package and are deliberately excluded from all public package feeds and Release assets.

Example Series

Series Project Focus
CUDA Cuda/01.RuntimeCompilation CUDA RTC compilation, module loading, launch, and readback
Inference Inference/01.Bindings, Inference/02.DynamicShapes Bindings, memory ownership, and dynamic profiles
Performance Performance/01.MultiStream CUDA streams, events, and ordering
Computer vision Classification Image preprocessing, Top-K output, JSON, and annotated results
Applications YoloVision, OnnxToEngine, TensorRtExec Complete multi-step workflows and advanced usage

See the sample series and applications for runnable commands and matching articles.

CUDA RTC roadmap: English | 简体中文 | technical article

Public Packages And Release Assets

The stable 4.0.0 release is available through GitHub Releases, NuGet.org, and GitHub Packages. The compatible managed-package maintenance revision is 4.0.0.1; the Bridge matrix remains at 4.0.0. Package README content is the English root README, package branding uses nuget/logo.jpg, and the core managed package uses the Apache-2.0 SPDX license expression.

Package Version NuGet.org GitHub Packages Purpose
JYPPX.TensorRT.CSharp.API Gallery Package feed Core managed TensorRT/CUDA API
Release channel Link Assets
GitHub Release v4.0.0 Source archive, core managed .nupkg, and project-owned Bridge .nupkg files
GitHub Packages NuGet package feed Core managed package and the published project-owned Bridge matrix
NuGet.org Core package 4.0.0 Core managed package and all 18 project-owned Bridge packages

Bridge package matrix

Every published Bridge package is listed below. CUDA, cuDNN, and TensorRT are prerequisites installed by the consumer; the .Bridge package contains only jyppxtrtbridge. The Version column is a live NuGet.org badge. published-4.0.0 means the exact 4.0.0 package is available in GitHub Packages, the GitHub Release, and NuGet.org.

Package ID Version Runtime key CUDA cuDNN TensorRT Publication state
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt8.6.cuda11.8.cudnn8.9.Bridge win-x64-trt8.6-cuda11.8-cudnn8.9 11.8 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt8.6.cuda12.1.cudnn8.9.Bridge win-x64-trt8.6-cuda12.1-cudnn8.9 12.1 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt10.11.cuda11.8.cudnn8.9.Bridge win-x64-trt10.11-cuda11.8-cudnn8.9 11.8 8.9 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt10.11.cuda12.9.cudnn9.22.Bridge win-x64-trt10.11-cuda12.9-cudnn9.22 12.9 9.22 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt11.0.cuda12.9.cudnn9.22.Bridge win-x64-trt11.0-cuda12.9-cudnn9.22 12.9 9.22 11.0 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.win-x64.trt11.0.cuda13.2.cudnn9.22.Bridge win-x64-trt11.0-cuda13.2-cudnn9.22 13.2 9.22 11.0 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu20.04.trt8.6.cuda11.8.cudnn8.9.Bridge linux-x64-ubuntu20.04-trt8.6-cuda11.8-cudnn8.9 11.8 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu20.04.trt8.6.cuda12.1.cudnn8.9.Bridge linux-x64-ubuntu20.04-trt8.6-cuda12.1-cudnn8.9 12.1 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu20.04.trt10.11.cuda11.8.cudnn8.9.Bridge linux-x64-ubuntu20.04-trt10.11-cuda11.8-cudnn8.9 11.8 8.9 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt8.6.cuda11.8.cudnn8.9.Bridge linux-x64-ubuntu22.04-trt8.6-cuda11.8-cudnn8.9 11.8 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt8.6.cuda12.1.cudnn8.9.Bridge linux-x64-ubuntu22.04-trt8.6-cuda12.1-cudnn8.9 12.1 8.9 8.6 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt10.11.cuda11.8.cudnn8.9.Bridge linux-x64-ubuntu22.04-trt10.11-cuda11.8-cudnn8.9 11.8 8.9 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt10.11.cuda12.9.cudnn9.22.Bridge linux-x64-ubuntu22.04-trt10.11-cuda12.9-cudnn9.22 12.9 9.22 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt11.0.cuda12.9.cudnn9.22.Bridge linux-x64-ubuntu22.04-trt11.0-cuda12.9-cudnn9.22 12.9 9.22 11.0 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu22.04.trt11.0.cuda13.2.cudnn9.22.Bridge linux-x64-ubuntu22.04-trt11.0-cuda13.2-cudnn9.22 13.2 9.22 11.0 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu24.04.trt10.11.cuda12.9.cudnn9.22.Bridge linux-x64-ubuntu24.04-trt10.11-cuda12.9-cudnn9.22 12.9 9.22 10.11 published-4.0.0
JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu24.04.trt11.0.cuda12.9.cudnn9.22.Bridge linux-x64-ubuntu24.04-trt11.0-cuda12.9-cudnn9.22 12.9 9.22 11.0 published-4.0.0
`JYPPX.TensorRT.CSharp.API.Runtime.linux-x64.ubuntu2

Issues· 0 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

C#

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月18日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言