Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
Archive
Realistic first-contribution target: active project, 19 open issues, small enough for a newcomer PR to land.
Derived from this repo's Cargo dependencies and activity — difficulty is an estimate from codebase size and scope.
Matched by dependency overlap in Cargo manifests — each card notes the most distinctive crates both projects share.
Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
The official Rust library for the Edgee AI Gateway
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
MLX-based experimental inference engine
High-performance LLM inference engine — drop-in replacement for Ollama with faster multi-turn inference, lower TTFT, and higher throughput through prefix caching and continuous batching.
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
Pure Rust Inference Engine
Open-source MITM proxy to intercept, inspect, and mock network traffic.
Fork() for AI agent microVMs. Spawn 100 children in ~100ms from a warm parent; BRANCH a live VM in ~150ms. KVM-isolated, snapshot CoW.