gpu

shard

Python

77

Pipeline-parallel LLM inference across GPUs on separate machines.

pytorch

Python

85

Tensors and Dynamic neural networks in Python with strong GPU acceleration

LocalAI

Go

95

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

SiliconScope

Swift

82

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

local-llm

Shell

77

Everything I know about running LLMs locally

ai-trains-ai

Python

77

RL-training an AI agent to RL-train AI agents.

hermes-agent

Python

85

The agent that grows with you

pyre-code

Python

85

A self-hosted ML coding practice platform. 68 problems from ReLU to flow matching — attention, training, RLHF, diffusion, and more. Instant feedback in the browser.