AIlibraryPython

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

2,107 stars191 forks209 issuesApache-2.0更新于 2026/6/7

GitHub 仓库

deep-learninginferencepytorch

暂无详细内容

同类推荐

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

184,800

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

184,800

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

161,357

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

161,357

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

101,782

NextChat

88,185