llm-tools
Projects tagged with llm-tools on GitHub.
54 projects
llm-space
TypeScriptA desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
waggle
RustAttributed, resolvable artifact references for agent handoffs — a ~30-byte token instead of pasted context. MCP-native; the reference layer for the agent-harness world.
deja-vu
GoYour agents already solved this. deja finds it — memory operations for fifteen coding agents: retroactive search and MCP recall (84.9% R@1 on LongMemEval-S, no LLM), trust scopes, curated notes with tags and lifecycle states, measured impact. One zero-dep binary, fully local.
AutoGPT
PythonAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
shard
PythonPipeline-parallel LLM inference across GPUs on separate machines.
awesome-llm-apps
Python100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
chorus
TypeScriptMulti-LLM peer review for code decisions. Bring your own CLI; Chorus convenes 2-4 other LLMs to review the work before you ship.
Photo-agents
PythonAutonomous self-evolving agents. Vision-grounded layered memory and self-written skills for LLM agents that operate your computer.
harness
SwiftAI-driven user testing for iOS Simulator, macOS apps, and web apps. Write a goal in plain language; an LLM agent drives the UI and reports friction. macOS 14+, Swift 6.
browser-use
Python🌐 Make websites accessible for AI agents. Automate tasks online with ease.
ECC
JavaScriptThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
ponytail
JavaScriptMakes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
sample-specship
ShellSpec-driven autonomous engineering workflow for AI coding agents: recon → plan → build → validate → ship — with TDD, adversarial validation, and anti-slop quality gates. Packaged as a Kiro Power.
omnigent
PythonOmnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.
evonic
PythonOpen Agentic AI Platform - The home your agents deserve
langchain
PythonThe agent engineering platform.
klaatcode
TypeScriptOpen-source AI coding agent for the terminal. Claude Code-grade accuracy with smart model routing — uses the right AI model for each task, cutting costs 10x. Supports Claude, GPT, Gemini, DeepSeek & more.
openwiki
TypeScriptOpenWiki is a CLI that writes and maintains agent documentation for your codebase.
gemma-chat
TypeScriptLocal AI chat + coding agent for Apple Silicon, powered by Gemma 4 via MLX / Supports Ollama
market-pilot
JavaScriptEvidence-grounded market research prototype with traceable AI workflows.
appless
TypeScriptWhat if your phone had no apps
zep
PythonZep | Examples, Integrations, & More
Flowise
TypeScriptBuild AI Agents, Visually
filetree-skill
PythonA Claude Code plugin that maintains `FILETREE.md`.
mirage
TypeScriptThe World's First Unified Virtual Filesystem For AI Agents
looper
PythonDesign visual, review-gated agent loops for Claude Code before you run them.
dify
TypeScriptBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
forsy-trace-skill
PythonOpen skill for capturing AI agent work as structured traces.
MTPLX
Python3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
local-llm
ShellEverything I know about running LLMs locally
llama.cpp
C++LLM inference in C/C++
Investbrain
PHPSmart LLM-enabled investment tracker that consolidates and monitors market performance across your different brokerages
voidllm
GoPrivacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
tokenspeed
PythonTokenSpeed is a speed-of-light LLM inference engine.
MLX-LoRA-Studio
SwiftA native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
inference-school
SwiftA hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.
feeds.fun
PythonNews reader with tags, scoring, and LLM
ollama
GoGet up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
open-webui
PythonUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
jarvis
ShellJarvis meta-repository: shared docs, configs, and setup scripts
LocalAI
GoLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
lora-speedrun
PythonSpeedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.
transformers
Python🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
ragflow
GoRAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
SiliconScope
SwiftSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
mdflux
SvelteTurn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.
hermes-agent
PythonThe agent that grows with you
prompts.chat
HTMLf.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.