Scalable datastore for metrics, events, and real-time analytics
arrow-flight
Counted from the Cargo.toml manifests of the 28 indexed repositories that declare arrow-flight as a dependency — not download counts. Dependency data last verified 2026-07-25.
Crates that show up unusually often in arrow-flight projects. The most distinctive pairings rank first — crates these projects use far more than the average indexed Rust project does, not just crates that are popular everywhere. Each percentage is the share of arrow-flight projects that also use it.
Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.
Apache DataFusion SQL Query Engine
The open-source Observability 2.0 database. One engine for metrics, logs, and traces — replacing Prometheus, Loki & ES.
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Graph Node indexes data from blockchains such as Ethereum and serves it over GraphQL
A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.
Parseable is an observability datalake built from first principles.
Apache DataFusion Ballista Distributed Query Engine
A cloud-native open source distributed time series database with high performance, high compression ratio and high availability.
Local-first ETL/ELT studio: a drag-and-drop visual pipeline designer that compiles to SQL and runs on DuckDB. Tiny desktop app, no servers, git-friendly workspaces.
Local-first ETL/ELT studio: a drag-and-drop visual pipeline designer that compiles to SQL and runs on DuckDB. Tiny desktop app, no servers, git-friendly workspaces.
Analytical database for data-driven Web applications 🪶
Command line SQL interface for relational databases and common data file formats
DataFusion TableProviders for reading data from other systems
Batteries included CLI, TUI, and server implementations for DataFusion.
DuckLake took Flight. Welcome to SwanLake.
Library for bringing distributed capabilities to Apache DataFusion
HyprStream: agentic infrastructure for continous online-learning applications
Multi-engine SQL query router in Rust—with routing, queuing, and sqlglot dialect translation
Sub-millisecond cache for ML/AI workloads. Parquets in, Arrow-Flight out.
Databricks's Zerobus Ingest SDKs
Scalable Observability
IceGate is an observability data lake engine
A Rust ingester for GreptimeDB, which is compatible with GreptimeDB protocol and lightweight.
Scalable Kubernetes-native implementation of the Open Data Fabric protocol for global collaborative data processing
ModelarDB: Model-Based Time Series Management from Edge to Client