Axiom: Atomic-Level Execution Plan (16 Weeks)
This plan integrates the original execution timeline with advanced engineering constraints to ensure mastery of high-performance, distributed systems.
Phase 1: Storage & Ingest Foundations (Weeks 0-4)
Focus: Mechanical sympathy, syscalls, and binary serialization.
Week 0: Foundations & Environment
- Execution: Define non-goals and SLOs. Initialize
axiom-infra with Kubernetes and CI skeletons.
- Atomic Detail: Establish a benchmarking suite using
cargo bench (Rust) and pprof (Go) to measure baseline overhead.
- Materials: The Site Reliability Engineering (SRE) Book (Google); Systems Performance (Brendan Gregg).
Week 1: Ingest API & Custom Binary Protocol
- Execution: Build
POST /v1/events in Go. Implement a custom TLV (Type-Length-Value) binary protocol for internal node communication.
- Atomic Detail: Use
sync.Pool in Go to manage memory and reduce Garbage Collection (GC) pressure under high traffic.
- Success Metrics: P95 latency < 100ms at 1k req/s.
- Materials: Pragmatic Guide to Go Concurrency; Designing Data-Intensive Applications (Chapter 4: Encoding).
Week 2: The Core: Zero-Copy Append-Only Log
- Execution: Implement the log engine in Rust. Use
mmap for memory-mapped file I/O and fsync for durability.
- Atomic Detail: Implement Zero-Copy data transfers using the
sendfile(2) syscall to bypass user-space copying.
- Materials: Operating Systems: Three Easy Pieces (Persistence section); Linux man pages for
mmap(2) and sendfile(2).
Week 3: Vertical Integration & Backpressure
- Execution: Integrate Gateway with Log Engine. Implement LMAX Disruptor-style ring buffers for internal event passing.