Radar's data platform stack uses TypeScript, Rust, and Python. Role focuses on building and scaling the data infrastructure powering 1B+ API calls per day.
Async Production Systems
required2,411 repos of evidenceInfrastructure roles assume backend fluency — the corpus's infra projects are async services first, distributed systems second.
The destination — non-negotiable
- operate (not just build) long-running async services
- write code that assumes the network will fail
- debug a task leak or a stuck future
+ beyond Cargo: everything from the Backend path's first two legs · deadlines everywhere · graceful degradation
The vehicles — 2 ways in, any combination works
Long-running daemons operated by real organizations — read their shutdown, retry, and failure paths.
xintaofei/codegapproachableCollaborative multi-agent AI coding workspace: aggregate sessions from Claude Code, Codex, Gemini CLI, etc. Desktop app, self-hosted server, or Docker.wshm-dev/wshmapproachableAI-powered repository agent for GitHub, GitLab, Gitea, Azure DevOps. Issue triage, PR analysis, merge queue, notifications, dashboard, backup. Self-hosted, multi-provider.PNRxA/openposterdbapproachableA self-hosted, drop-in replacement for RPDB (Rating Poster Database).tokio-rs/axumintermediateHTTP routing and request-handling library for Rust that focuses on ergonomics and modularitybiomejs/biomeintermediateA toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LSP.actix/actix-webintermediateActix Web is a powerful, pragmatic, and extremely fast web framework for Rust.denoland/denoadvancedA modern runtime for JavaScript and TypeScript.zed-industries/zedadvancedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.unionlabs/unionadvancedThe trust-minimized, zero-knowledge bridging protocol, designed for censorship resistance, extremely high security, and usage in decentralized finance.
helius-labs/helius-rust-sdkapproachableAsynchronous Helius Rust SDKnirholas/pump-fun-sdkapproachableToken creation launching, bonding curve trading, AMM migration, tiered fees, creator fee sharing, vanity keygen, MCP server, Telegram bot & live dashboardssreedevk/pocketbase-sdk-rustapproachableRust SDK for Pocketbasecloudflare/pingoraintermediateA library for building fast, reliable and evolvable network services.zama-ai/fhevmintermediateFHEVM, a full-stack framework for integrating Fully Homomorphic Encryption (FHE) with blockchain applicationsawslabs/aws-sdk-rustintermediateAWS SDK for the Rust Programming LanguageFuelLabs/fuel-coreadvancedRust full node implementation of the Fuel v2 protocol.FuelLabs/fuels-rsadvancedFuel Network Rust SDKpola-rs/polarsadvancedExtremely fast Query Engine for DataFrames, written in Rust
Prove it — build this
If you haven't: complete the Backend path's API project — it's the substrate everything below runs on.
Can you honestly tick these?
Networking Under Failure
required1,092 repos of evidenceEvery distributed failure is a network failure first. The corpus's proxies, DNS servers, and transports are where those failures live in readable code.
The destination — non-negotiable
- understand network failures: partitions, timeouts, retries, backpressure
- understand what proxies and load balancers actually do to your traffic
- reason about latency budgets across hops
+ beyond Cargo: TCP vs QUIC tradeoffs · connection pooling & reuse · retry storms & jitter · health checking
The vehicles — 3 ways in, any combination works
Production proxies and mesh dataplanes — the code your packets already flow through.
monosans/proxy-scraper-checkerapproachableHTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.raine/claude-code-proxyapproachableUse Claude Code with your ChatGPT or Kimi subscription via a local Anthropic-compatible proxyvalnesfjord/tg-ws-proxy-rsapproachableTelegram MTProto WebSocket Bridge Proxy — a Rust vibecoded port of Flowseal/tg-ws-proxylinkerd/linkerd2-proxyintermediateA purpose-built proxy for the Linkerd service mesh. Written in Rust.xin2017338/lynx-proxyintermediateLynx Proxy is a high-performance and flexible proxy tool developed in Rustferro-labs/ferrotunnelintermediateSecure, embedded, High Performance API-first tunneling with public URLs, acting as a lightweight ingress and HTTP/3 proxy focused on low-latency forwardingrtk-ai/rtkadvancedCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependenciesagentgateway/agentgatewayadvancedNext Generation Agentic Proxy for AI Agents and MCP serversDevolutions/devolutions-gatewayadvancedA blazing fast relay server adaptable to different protocols and desired levels of traffic inspection.
razvandimescu/numaapproachablePortable DNS resolver in Rust — .numa local domains, ad blocking, developer overridesDNSCrypt/encrypted-dns-serverapproachableAn easy to install, high-performance, zero maintenance proxy to run an encrypted DNS server.containers/aardvark-dnsapproachableAuthoritative dns server for A/AAAA container records. Forwards other request to host's /etc/resolv.confhickory-dns/hickory-dnsintermediateA Rust based DNS client, server, and resolveractix/actix-webintermediateActix Web is a powerful, pragmatic, and extremely fast web framework for Rust.cloudflare/pingoraintermediateA library for building fast, reliable and evolvable network services.astral-sh/uvadvancedAn extremely fast Python package and project manager, written in Rust.denoland/denoadvancedA modern runtime for JavaScript and TypeScript.tauri-apps/tauriadvancedBuild smaller, faster, and more secure desktop and mobile applications with a web frontend.
holon-run/uxcapproachableA unified CLI for discovering and invoking tools across OpenAPI, MCP, GraphQL, gRPC, and JSON-RPCBarre/ZeroFSapproachableZeroFS - The Filesystem That Makes S3 your Primary Storage. ZeroFS is 9P/NFS/NBD on top of S3. Initially built for www.merklemap.comcontainers/netavarkapproachableContainer network stackgrpc/grpc-rustintermediateA native gRPC client & server implementation with async/await support.tokio-rs/axumintermediateHTTP routing and request-handling library for Rust that focuses on ergonomics and modularityzama-ai/fhevmintermediateFHEVM, a full-stack framework for integrating Fully Homomorphic Encryption (FHE) with blockchain applicationsunionlabs/unionadvancedThe trust-minimized, zero-knowledge bridging protocol, designed for censorship resistance, extremely high security, and usage in decentralized finance.FuelLabs/fuel-coreadvancedRust full node implementation of the Fuel v2 protocol.qdrant/qdrantadvancedQdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Prove it — build this
Build a small L7 reverse proxy: health checks, per-backend circuit breaking, and a chaos script that kills backends while a load test runs.
Can you honestly tick these?
Coordination & Consensus
required64 repos of evidenceThe corpus puts consensus in code you can read — implementations, coordination clients, and the databases built on them. Theory is table stakes; these repos are the source.
The destination — non-negotiable
- understand consensus: what Raft guarantees and what breaks it
- understand leader election, membership, and split brain
- understand why exactly-once delivery is a lie and what to do instead
+ beyond Cargo: Raft mental model · quorums & fencing · clocks & ordering · idempotency as a design tool
The vehicles — 3 ways in, any combination works
Raft and consensus libraries themselves — read the state machine, not the blog post about it.
openraft21 reposraft8 repos
Scottcjn/clawrtc-rsapproachableRust crate for RustChain RTC mining — Ed25519 wallets, hardware attestation, Proof-of-Antiquity consensus. Published on crates.io.tikv/raft-rsintermediateRaft distributed consensus algorithm implemented in Rust.databendlabs/openraftintermediaterust raft with improvementstikv/raft-engineintermediateA persistent storage engine for Multi-Raft logqdrant/qdrantadvancedQdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/tikv/tikvadvancedDistributed transactional key-value database, originally created to complement TiDBsigp/lighthouseadvancedEthereum consensus client in Rust
etcd-client19 reposzookeeper
keepsimple1/mdns-sdapproachableRust library for mDNS based Service Discoverysuperfly/corrosionintermediateGossip-based service discovery (and more) for large distributed systems.al8n/serfintermediateA highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration that is lightweight, highly available, and fault tolerant.openebs/mayastorintermediateDynamically provision Stateful Persistent Replicated Cluster-wide Fabric Volumes & Filesystems for Kubernetes that is provisioned from an optimized NVME SPDK backend data storage stack.ai-dynamo/dynamoadvancedA Datacenter Scale Distributed Inference Serving FrameworkGreptimeTeam/greptimedbadvancedThe open-source Observability 2.0 database. One engine for metrics, logs, and traces — replacing Prometheus, Loki & ES.restatedev/restateadvancedRestate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
raft8 reposopenraft21 repos
wolfsoftwaresystemsltd/WolfScaleapproachableFree tools for building robust, clustered server infrastructure — WolfStack, WolfScale, WolfDisk, WolfNeteclipse-zenoh/zenohintermediatezenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.habitat-sh/habitatintermediateModern applications with built-in automationorbitinghail/graftintermediateGraft is an open-source transactional storage engine optimized for lazy, partial, and strongly consistent replication—perfect for edge, offline-first, and distributed applications.spacedriveapp/spacedriveadvancedSpacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.paradigmxyz/rethadvancedModular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rustsupabase/etladvancedStream your Postgres data anywhere in real-time. Simple Rust building blocks for change data capture (CDC) pipelines.
Prove it — build this
Build a replicated key-value store on a Raft crate: three nodes, leader failover test, and a README explaining exactly what is and isn't guaranteed.
Can you honestly tick these?
Queues & Streaming
required176 repos of evidenceQueues are how distributed systems absorb failure. The corpus's stream processors, log shippers, and messaging clients show the semantics in running code.
The destination — non-negotiable
- understand queues: delivery guarantees, visibility timeouts, dead letters
- understand streams versus queues and when each fits
- design consumers that survive redelivery and reordering
+ beyond Cargo: at-least-once semantics · consumer groups & offsets · backpressure end-to-end · windowing basics
The vehicles — 2 ways in, any combination works
The engines that transform data in motion — windowing, watermarks, and exactly-once claims to audit.
parseablehq/parseableapproachableParseable is an observability datalake built from first principles.volga-project/volgaapproachableReal-time data processing/feature engineering tailored for modern AI/ML systems.kaushiksrini/parqeyeapproachablePeek inside Parquet files right from your terminalPRQL/prqlintermediatePRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacementquickwit-oss/quickwitintermediateCloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.cube-js/cubeintermediate📊 Cube Core is open-source semantic layer for AI, BI and embedded analyticsvectordotdev/vectoradvancedA high-performance observability data pipeline.pola-rs/polarsadvancedExtremely fast Query Engine for DataFrames, written in Rustjuspay/hyperswitchadvancedOpen source, composable payments platform | PCI compliant | SaaS and Self-host options | Enables connectivity to multiple payment, payout, fraud, vault and tokenization providers | Uplifts authorization with intelligent routing and revenue recovery | Reduce payment processing costs with cost observability | Reduces payment ops with reconciliation
nubskr/walrusapproachable🦭 Distributed log streaming engine built from first principlesEdJoPaTo/mqttuiapproachableSubscribe to a MQTT Topic or publish something quickly from the terminalaannoo/hcomapproachableLet AI agents message, watch, and spawn each other across terminals. Claude Code, Codex, Antigravity CLI, Cursor CLI, OpenCode, Kilo, Pi, Kimizama-ai/fhevmintermediateFHEVM, a full-stack framework for integrating Fully Homomorphic Encryption (FHE) with blockchain applicationswindmill-labs/windmillintermediateOpen-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.apecloud/ape-dtsintermediateApeCloud's Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios.rustfs/rustfsadvanced🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.zeroclaw-labs/zeroclawadvancedFast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀ruvnet/RuViewadvancedπ RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
Prove it — build this
Build a work-queue system with at-least-once delivery, visibility timeouts, and a chaos test that kills workers mid-job.
Can you honestly tick these?
Storage Tradeoffs
recommended441 repos of evidenceRust's storage-engine corpus is unusually strong — reading these codebases is the fastest route to credible storage conversations.
The destination — non-negotiable
- understand storage tradeoffs: LSM vs B-tree, WALs, compaction
- know what fsync guarantees and what durability actually costs
- work against object storage semantics without pretending it's a filesystem
+ beyond Cargo: LSM trees vs B-trees · WALs & durability · compaction · object storage semantics
The vehicles — 3 ways in, any combination works
B-tree and LSM engines you can read end to end — the WAL, the compactor, the recovery path.
fjall-rs/lsm-treeapproachableK.I.S.S. LSM-tree implementation in safe Rustfjall-rs/fjallapproachable🗻 Log-structured, embeddable key-value storage engine written in Rustmarvin-j97/rust-storage-benchapproachableBenchmarking Rust key-value storage enginesskyzh/mini-lsmintermediateA course of building an LSM-Tree storage engine (database) in a week.slatedb/slatedbintermediateA cloud native embedded storage engine built on object storage.embassy-rs/ekvintermediateKey-value store for embedded systems, for raw NOR flash, using an LSM-Tree.FuelLabs/fuel-coreadvancedRust full node implementation of the Fuel v2 protocol.spacedriveapp/spacedriveadvancedSpacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.linera-io/linera-protocoladvancedMain repository for the Linera protocol
awslabs/aws-security-analytics-bootstrapapproachableAWS Security Analytics Bootstrap enables customers to perform security investigations on AWS service logs by providing an Amazon Athena analysis environment that's quick to deploy, ready to use, and easy to maintain.parseablehq/parseableapproachableParseable is an observability datalake built from first principles.ashvardanian/StringWarsapproachableComparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, edit-distances, sketching, and sorting across CPUs and GPUs in Rust 🦀 and Python 🐍apache/datafusionintermediateApache DataFusion SQL Query Enginedbt-labs/dbt-coreintermediatedbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.delta-io/delta-rsintermediateA native Rust library for Delta Lake, with bindings into Pythonpola-rs/polarsadvancedExtremely fast Query Engine for DataFrames, written in Rustinfluxdata/influxdbadvancedScalable datastore for metrics, events, and real-time analyticsnautechsystems/nautilus_traderadvancedProduction-grade Rust-native trading engine with deterministic event-driven architecture
Barre/ZeroFSapproachableZeroFS - The Filesystem That Makes S3 your Primary Storage. ZeroFS is 9P/NFS/NBD on top of S3. Initially built for www.merklemap.comnidor1998/s3syncapproachableA reliable, flexible, and fast synchronization tool for S3axpdev-lab/aeroftpapproachableAeroFTP is a Cross-platform desktop client for FTP, FTPS, SFTP, WebDAV, S3-compatible storage, GitHub, and Cloud providers, built with Rust 🦀 (Tauri) + Reactcloudflare/pingoraintermediateA library for building fast, reliable and evolvable network services.zama-ai/fhevmintermediateFHEVM, a full-stack framework for integrating Fully Homomorphic Encryption (FHE) with blockchain applicationsawslabs/mountpoint-s3intermediateA simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.rustfs/rustfsadvanced🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.zed-industries/zedadvancedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.nushell/nushelladvancedA new type of shell
Prove it — build this
Write a tiny persistent KV store: WAL, crash-recovery test, and a README explaining your durability guarantees honestly.
Can you honestly tick these?
Observability & Reliability
required465 repos of evidenceInfra engineers are judged on behavior under failure. The corpus's reliability layers — tracing, otel, governor — are the tools of that judgment.
The destination — non-negotiable
- propagate trace context across service boundaries
- understand SLOs, error budgets, and load shedding
- run async systems in production and learn from their incidents
+ beyond Cargo: SLOs & error budgets · distributed tracing · rate limiting & load shedding · incident habits
The vehicles — 3 ways in, any combination works
OpenTelemetry-instrumented systems and the collectors themselves — context propagation done for real.
parseablehq/parseableapproachableParseable is an observability datalake built from first principles.apache/skywalking-query-protocolapproachableQuery Protocol for Apache SkyWalking in GraphQL formatDataDog/pupapproachableGive your AI agent a Pup — a CLI companion with 200+ commands across 33+ Datadog products.zama-ai/fhevmintermediateFHEVM, a full-stack framework for integrating Fully Homomorphic Encryption (FHE) with blockchain applicationsquickwit-oss/quickwitintermediateCloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.katanemo/planointermediatePlano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic. juspay/hyperswitchadvancedOpen source, composable payments platform | PCI compliant | SaaS and Self-host options | Enables connectivity to multiple payment, payout, fraud, vault and tokenization providers | Uplifts authorization with intelligent routing and revenue recovery | Reduce payment processing costs with cost observability | Reduces payment ops with reconciliationdenoland/denoadvancedA modern runtime for JavaScript and TypeScript.openai/codexadvancedLightweight coding agent that runs in your terminal
surrealdb/surrealmcpapproachableThe official MCP server for SurrealDBBarre/ZeroFSapproachableZeroFS - The Filesystem That Makes S3 your Primary Storage. ZeroFS is 9P/NFS/NBD on top of S3. Initially built for www.merklemap.comQovery/engineapproachableThe Orchestration Engine To Deliver Self-Service Infrastructure ⚡️joshrotenberg/tower-resilienceintermediateResilience features for towern0-computer/irohintermediateIP addresses break, dial keys instead. Modular networking stack in Rust.mozilla/sccacheintermediateSccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.astral-sh/uvadvancedAn extremely fast Python package and project manager, written in Rust.dani-garcia/vaultwardenadvancedUnofficial Bitwarden compatible server written in Rust, formerly known as bitwarden_rsinfluxdata/influxdbadvancedScalable datastore for metrics, events, and real-time analytics
anvil-verifier/anvilapproachableAnvil is an experimental framework to build practical, formally verified, cluster management controllers.kdash-rs/kdashapproachableA simple and fast dashboard for Kubernetessarub0b0/kubetuiapproachableAn intuitive Terminal User Interface (TUI) tool for real-time monitoring and exploration of Kubernetes resourcesstackabletech/operator-rsintermediateA collection of crates to make implementing Kubernetes operators easierkube-rs/kubeintermediateRust Kubernetes client and controller runtimestackabletech/spark-k8s-operatorintermediateOperator for Apache Spark-on-Kubernetes for Stackable Data Platformchroma-core/chromaadvancedSearch infrastructure for AIvectordotdev/vectoradvancedA high-performance observability data pipeline.kubewarden/adm-controlleradvancedManage admission policies in your Kubernetes cluster with ease
Prove it — build this
Add distributed tracing across two services with OpenTelemetry — include the cross-service trace screenshot and an SLO doc.
Can you honestly tick these?
At the end of this road
Organizations building with this stack in the open:
Open roles matching this destination right now:
Open
Backend stack at Radar is TypeScript, Rust, Python, and Scala. Role owns server-side features and pipelines powering the location platform.
Main server language at Radar is TypeScript and Rust. SRE role owns reliability, observability, and infrastructure for the location platform.
ML stack at Radar includes Python, Rust, Airflow, and Spark. Role focuses on machine learning models and data pipelines for geospatial intelligence.