1 vllm-project/vllm GitHub A high-throughput and memory-efficient inference and serving engine for LLMs
93.9k ★ open 2 microsoft/onnxruntime GitHub ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
22.1k ★ open 3 ray-project/ray GitHub Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
44k ★ open 4 huggingface/diffusers GitHub 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
34.7k ★ open 5 huggingface/datasets GitHub 🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
22.1k ★ open 6 huggingface/transformers GitHub 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
167.7k ★ open 7 Comfy-Org/ComfyUI GitHub The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.
137.7k ★ open 8 AUTOMATIC1111/stable-diffusion-webui GitHub Stable Diffusion web UI
165.1k ★ open