由于 trendforge.devlive.top 访问受限，请切换到 trendforge.devlive.org 域名
tensorrt
话题找到数量
NVIDIA/TensorRT
NVIDIA® TensorRT™是用于NVIDIA GPU高性能深度学习推理的SDK，本仓库包含其开源组件
smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
NVIDIA/DeepStream
NVIDIA DeepStream Monorepo：DeepStream SDK及参考应用，用于构建基于GStreamer、TensorRT和视觉AI模型的GPU加速实时视频与多传感器分析管道，支持边缘、本地及云端部署。