<aside> ⚠️ Deprecated

Content is now in https://github.com/testground/testground/blob/master/ROADMAP.md https://github.com/libp2p/test-plans/blob/master/ROADMAP.md

</aside>

🚚: working on this week

🟢: done

🟡: blocked

Roadmap Version 2:

• Milestone 1: We have a single working interop test available for rust-libp2p and go-libp2p
  • 🟢 go-go interop testing was merged.
  • 🟢 rust-rust interop testing will be merged,
    • waiting for https://github.com/libp2p/rust-libp2p/pull/2835
    • blocked by https://github.com/libp2p/test-plans/pull/30
  • 🟢 rust-go interop testing will be merged with rust-rust interop above
• Milestone 2: The rust & go libp2p repos are using our interop test with every PR
  • Issues we need to fix
    • The go-go interop test was shut down after ~ one week
      • https://github.com/libp2p/test-plans/issues/29 (too slow), https://github.com/libp2p/go-libp2p/issues/1670 (flakiness)
    • The rust-rust & rust-go interop tests are slow and might get shut down too
      • Performances (30 min) + flakiness
  • Tasks
    • (1) 🟢 Improve Testground Stability by fixing issues as we discover them
      • https://github.com/testground/testground/issues/1401
      • 🚚 (1.1) We decided to “accept” longer runtime (around 30 minutes) temporarily, which means we’re going to use retries to fix the network issues during the build steps.
      • Status: https://github.com/libp2p/test-plans/pull/32 merged
    • 🚚 (2) Improve Interop tests build times with caching (15 minutes ⇒ ~ 3 minutes)
      • https://github.com/libp2p/test-plans/issues/29
      • ❗That’s probably where we’ll get the most improvements: So far the issues we’ve seen in go-libp2p are network drops when we download docker images & go packages.
      • Not easy, there is a quick win
        • Notes: https://github.com/libp2p/test-plans/issues/31
        • WIP Pull Request: https://github.com/libp2p/test-plans/pull/38
    • 🟢 (3) Improve Interop tests build times with Testground releases (5 minutes ⇒ ~1 minutes)
      • Use go cache in GitHub actions during build
      • Repurpose the Testground unified CI + Binary releases work and focus on binary releases + docker publish (https://github.com/testground/testground/pull/1371)

Medium Term

• Milestone 3: The libp2p maintainers are using remote runners for benchmarking
  • Tasks
    • Catch up with https://github.com/testground/testground/pull/1425 (Marco’s MVP)
    • Implement the “final” version of Remote Runners
• Milestone 4: The libp2p maintainers can write NAT-related tests with Testground docker & Kubernetes runners
  • Reliables Network Simulations
    1. Custom Topologies features https://github.com/testground/testground/issues/1354
    2. NAT Traversal / Hole Punching Features https://github.com/testground/testground/issues/1299
    3. MTU Fix https://github.com/testground/testground/issues/1385
  • Tasks
    • Connect with https://github.com/testground/testground/issues/1299#issuecomment-1214806843

Long Term

(order here is less meaningful, we’ll reevaluate)

• Add js-libp2p to Interop Testing
  • node
  • browser
• Conformance Testing?
  1. Kubo, Iroh, etc.
• Maintainers QoL
  1. Clarify integration testing https://github.com/testground/testground/issues/1368
  2. Complete the Testground unified CI + Binary releases (https://github.com/testground/testground/pull/1371)