AIlibraryPython

LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

4,086 stars332 forks137 issuesApache-2.0更新于 2026/6/7

GitHub 仓库

deep-learninggptllamallmmodel-servingnlpopenai-triton

暂无详细内容

同类推荐

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

184,800

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

184,800

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

161,357

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

161,357

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

101,782

NextChat

88,185