Derived from this repo's Cargo dependencies and activity — difficulty is an estimate from codebase size and scope.
Matched by dependency overlap in Cargo manifests — each card notes the most distinctive crates both projects share.
SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs. Zero-config multi-GPU: measures PCIe bandwidth, places attention and hot experts where they fit.
Advanced configuration options for sockets.
Rust async child-process management for tokio: whole-tree kill-on-drop (no orphans), plus streaming, pipelines, timeouts, and supervision library.
Asynchronous implementation of ping in rust, based on tokio 1.x
An io_uring backed runtime for Rust
A DuckDB extension for graph data analytics
The official Rust library for the Edgee AI Gateway
A flexible ping utility Tool written in Rust, that is focused on being size efficient and fast.