Privacy and advertising choices
Git-Stars uses essential storage for site operation. Optional analytics and ad-measurement scripts stay disabled unless you accept them; partners such as Google may then use cookies or similar identifiers where required. Privacy Policy
Git-Stars is independent and not affiliated with GitHub or this project. Analysis may be AI-assisted and based on public repository metadata plus short README-derived summaries. We do not mirror full README files, docs, issues, or social comments.
cactus-compute/needle is tracked as a Python project in the AI Agent, LLM Tool area. This evaluation combines public GitHub metadata, category signals, short source summaries, and Git-Stars editorial rules rather than copying project documentation.
Momentum check: the repository has 3.2k total stars, with +0 today, +219 this week, and +0 this month. These growth windows help distinguish durable adoption from short-lived visibility spikes.
Maintenance check: current activity is Active; the latest push was 1 days ago, and the open issue queue is 25, about 0.77% of total stars. Treat this as an adoption signal, not a substitute for engineering due diligence.
Adoption check: 245 forks and 3.2k watchers suggest how often the project is reused or followed. License signal: MIT. Always verify license compatibility before commercial or internal use.
Practical fit: this project is most relevant when you need AI prototypes, LLM workflows, and agent-style applications. Be cautious when you need a legal review, security audit, or production SLA.
Source check: Git-Stars currently has 2 explicit source reference(s) for this report and a recent growth signal of 219. Follow the original GitHub repository for final install, security, and release information.
Momentum
3.2k Stars
Reuse
245 Forks
Attention
3.2k Watchers
Maintenance
active
License
MIT
Open issues
25
Needle is a 26m parameter Simple Attention Network distilled from Gemini 3.1, designed for efficient single-shot function calling on consumer devices. It runs at high speed on Cactus infrastructure and can be finetuned locally on a Mac or PC.
Key Features
- Distilled from Gemini 3.1 into a 26m parameter model with 6000 toks/sec prefill and 1200 decode speed. - Fully open weights and dataset generation, with easy finetuning via web UI or CLI. - Outperforms larger models (FunctionGemma-270m, Qwen-0.6B) on single-shot function call tasks.
AI Agent
Agent frameworks, autonomous workflows, and tool-use systems
LLM Tool
Libraries and tools for LLM apps, RAG, prompts, and evals
git clone https://github.com/cactus-compute/needle.git && cd needle && source ./setup83
Health Score
Active
Commit Activity
Feb 24, 2026
Created
Jul 20, 2026
Last push
+0
Today's growth
+0
7-day growth
+0
30-day growth
Forks
Open
Watchers
cactus-compute
GitHub profilecodecrafters-io/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
sindresorhus/awesome
😎 Awesome lists about all kinds of interesting topics
freeCodeCamp/freeCodeCamp
freeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.
public-apis/public-apis
A collective list of free APIs
EbookFoundation/free-programming-books
:books: Freely available programming books
✓
License
✓
Forked
✓ Active
Maintained
Problem Solved
Needle solves the problem of running capable AI agents on resource-constrained devices without cloud dependency, offering a tiny model that outperforms larger ones (e.g., FunctionGemma-270m, Qwen-0.6B) on single-shot function calling. It enables local finetuning on consumer hardware, reducing latency and privacy concerns compared to cloud-based solutions.
Capabilities
Developers can build personal AI assistants that execute function calls (e.g., weather queries, tool invocations) directly on-device with low latency. Real-world use cases include smart glasses that fetch information hands-free, smartwatches that control IoT devices, and mobile apps that process user commands offline. The ceiling includes complex multi-step agentic workflows, though the model is optimized for single-shot tasks and may struggle with conversational depth.
Bottom Line
Needle is ideal for developers building lightweight, on-device AI agents for single-shot function calling, especially in privacy-sensitive or low-latency applications. It should be avoided for tasks requiring deep conversational understanding or broad general knowledge. The key trade-off is extreme efficiency and specialization at the cost of versatility and scope.