Pinned Loading

1. baidu/vLLM-ERNIE baidu/vLLM-ERNIE Public

   vLLM-based inference plugin for the open-source ERNIE models.

   Python 40 4

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 38.8k 10.4k

3. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

   High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

   Python 3.7k 757

4. PaddlePaddle/PaddleFormers PaddlePaddle/PaddleFormers Public

   PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.

   Python 13k 2.2k

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. mini-lsm mini-lsm Public

   Forked from skyzh/mini-lsm

   A tutorial of building an LSM-Tree storage engine in a week!

   Rust 1