AIlibraryPython

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

2,108 stars190 forks209 issuesApache-2.0更新于 2026/4/23

GitHub 仓库

deep-learninginferencepytorch

暂无详细内容

同类推荐

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

183,678

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

183,678

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

159,773

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

159,773

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

98,225

NextChat

87,771