Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Derived from this repo's Cargo dependencies and activity — difficulty is an estimate from codebase size and scope.
Matched by dependency overlap in Cargo manifests — each card notes the most distinctive crates both projects share.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Fast, flexible LLM inference
Growing list of apps and tools for enhancing social media experiences.
Mock REST APIs from JSON with zero coding within seconds.
Nix Package Tool. A (humble) successor to linux's apt, which makes life easier when using nix as a package manager.
A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
a metadata search engine similar to searxng in rust
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Interactive, persistent shell for HTTP requests. Built with Rust for ultimate speed and simplicity.
Official IANA IP blocks for each country | IPV4 and IPV6 | TEXT | CSV | JSON