AIlibraryPython

LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

4,022 stars320 forks135 issuesApache-2.0更新于 2026/4/23

GitHub 仓库

deep-learninggptllamallmmodel-servingnlpopenai-triton

暂无详细内容

同类推荐

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

183,659

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

183,659

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

159,742

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

159,742

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

98,189

NextChat

87,764