A machine learning library for Python and Rust, for PyTorch, Tensorflow and SKLearn models

A blazing fast inference solution for text embeddings models

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Minimalist ML framework for Rust

Build apps powered by on-device AI

An Optical Character Recognition (OCR) and Document Layout Analysis library written in Rust.

A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.

Fast, flexible LLM inference