GitHub 火線榜 · 倉庫檔案

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed. (簡介來自倉庫自身文件。)

資料截至 October 21NVIDIA