🐙 GitHub
1818 tools
Chatd is a desktop application that lets you chat with your own documents using a local large language model — no cloud,…
MARLIN is an open-source, highly optimized FP16xINT4 matrix multiplication kernel for large language model inference, developed by IST-DASLab. It delivers close to…
ThinkAny RAG Search is an open-source retrieval-augmented generation search API from the ThinkAny team: it combines web search results with large language…
Qwen2.5-Math is a series of open large language models from Alibaba's Qwen team, specialized for mathematical reasoning. Released as the successor to…
Performer PyTorch is an open-source PyTorch implementation of Performer, the linear attention-based transformer variant from Google Research that approximates softmax attention with…
Cotabby brings AI autocomplete to almost every text field on your Mac. It is a free, open-source macOS app — maintained by…
Samila is an open-source generative art generator written in Python: it creates images from many thousands of points whose positions are calculated…
HyperDB is a hyper-fast local vector database designed for use with LLM agents: embed your documents, index them in-process, and retrieve semantically…
GPU Poor answers the two questions every local-LLM enthusiast asks first: can my GPU run this model, and how fast will it…
AWS Deep Learning Containers (DLC) is Amazon's open collection of prebuilt, optimized Docker images for training and serving deep learning models on…
ToMeSD applies token merging to Stable Diffusion, speeding up image generation by merging redundant tokens inside the model — using nothing but…
Ongrid is an open-source ops AI agent that understands your infrastructure, finds the root cause of incidents and fixes them, right from…