Privacy and advertising choices

Git-Stars uses essential storage for site operation. Optional analytics and ad-measurement scripts stay disabled unless you accept them; partners such as Google may then use cookies or similar identifiers where required. Privacy Policy

LogoGit-Stars
Top StarsTrendingAI AgentsDaily PicksViral ReposInsights
LogoGit-Stars

Discover top GitHub projects with real rankings and AI insights

GitHub
Built withLogo of Git-StarsGit-Stars
Rankings
  • Top Stars
  • Trending
  • AI Agents
  • Daily Picks
  • Explore
Resources
  • Insights
  • Editorial Policy
About
  • About
  • Contact
Legal
  • Privacy Policy
  • Terms of Service
© 2026 Git-Stars. All Rights Reserved.
Search the radar

Explore Projects

Search across all tracked GitHub repositories.

Active filters
1
Results
7
Mode
Keyword
7 results in LLM Tool for "inference"
All
AI Agent
MCP Server
LLM Tool
AI App
Developer Tool
Automation
Data Tool
Observability
UI Framework
Infrastructure
1Rank
TR
TR

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

PythonLLM ToolAutomationApache-2.0
164k
Stars
34k
Forks
2k
Open Issues
2Rank
LC
LC

ggml-org/llama.cpp

LLM inference in C/C++

C++LLM ToolInfrastructureMIT
124k
Stars
22k
Forks
2k
Open Issues
3Rank
KT
KT

kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

PythonLLM ToolApache-2.0
19k
Stars
1k
Forks
470
Open Issues
4Rank
L2
L2

Lightricks/LTX-2

Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model.

PythonLLM ToolAI AppNOASSERTION
9k
Stars
1k
Forks
122
Open Issues
5Rank
OD
OD

Osmantic/ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

PythonLLM ToolInfrastructureApache-2.0
4k
Stars
543
Forks
254
Open Issues
6Rank
LL
LL

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

TypeScriptLLM ToolData ToolNOASSERTION
1k
Stars
163
Forks
48
Open Issues
7Rank
TC
TC

handy-computer/transcribe.cpp

ggml speech-to-text inference for 16+ model families

C++LLM ToolDeveloper ToolMIT
1k
Stars
31
Forks
19
Open Issues