Hi all!

After two furious weeks at Lab Week and Compute over Data summit, we are pleased to announce the new Bacalhau Roadmap for the next 12 months!

You can see a summary in StarMaps (thank you, Starmaps team and @Julia Armbrust!) or a summary of the milestones and work below.

• Identify developers who will be the most successful on Bacalhau (BigData, data engineers, Web3, academics, statisticians)

Inspire/Breadth:

• 7 blogs
• 2 Conferences
• 3 Hackathons
• hackathon re-usable materials 1-pager, slides

Education/Breadth:

• DOCS revamp
• 3 Short videos

Engagement/Depth:

• FEEDBACK loop: partner with Eng/PM on DevEx from 3 of 1-1 developers
• 2 Grants for engineers | | M2 Q1, Mar23 | • Support for WASM: Make it easier to bring common workloads to WASM transparently (e.g. Go, Python…) • Improved reliability. • Faster REPL (local code -> executing remotely -> feedback). • API/client reaches 1.0. • Grant program & “Bacalhau Season” starts. • Production-ready Airflow integration • Pipelines view in UI • Many new examples available • Users can make limited use of networking from inside their jobs • Initial support for keypairs to encrypt data going into IPFS | • Unified control plane across nodes and metrics dashboard. • Partner program for CP to augment their storage systems. • Multiple executors support. • API/server reaches 1.0. • Onboard 5 compute providers and compute nodes via direct outreach • FIL+ integration with Evergreen • Improve Separation between Requester and Compute nodes • Communication on results from initial protocol hardening efforts (simulation, formal verification & game theory approaches) | Partners: • Bacalhau workload growth: continued direct outreach to add 5 new partners • Plan to scale partnership outreach via contractors • Filecoin large dataset onboarding research. • BOINC projects selected

CODWG • 4 new funded grants via a revised CODWG Grants Program (fork of the Filecoin Grants Program to a CODWG repo). Add RFPs for specific shared Pneeds/standards. • Invocation Spec implemented in Bacalhau • Initial Octostore service available (see below) | * DOCS DOCS DOCS
plan/exec

• FEEDBACK loop: partner with Eng/PM on DevEx from 6 of 1-1 developers

Inspire/Depth:

• Content/Marketing Outreach alignment to product positioning & use cases
• 2 Influencers

Inspire/Breadth:

• 5 Conferences
• 1 Hackathon

Education:

• 10 Short videos
• 2 Quickstart guides

Engagement/Depth:

• 5 engineer grants
• 2 education grants | | M3 Q2, Jun23 | • Streamlined developer experience (with lots of syntactic sugar). • Support for DAGs: Ability to view lineage • Federated Reads • Rich Local Client • Documentation excellent for end users • Trusted Execution Environments on AMD hardware available as alpha • Support for nodes to select based on the availability of encryption key | • Additional deal engines • Support for up to ⅓ unreliable nodes in a job. • Recruit Compute Providers with FIL+ incentive • Documentation excellent for computer providers • External state storage for better resilience/HA setups • Communication on results from further protocol hardening efforts (simulation, formal verification & game theory approaches) | Partners • Bacalhau workload growth: sourced via direct outreach and via scaled contractors • BOINC integration live!

CODWG • “COD WG 2.1: User Demand Gen (Market Making)”: driving awareness among COD target users to drive workloads • Documentation excellent for CODWG members • Invocation Spec implemented in other CODWG projects • Bacalhau contributing to Octostore metadata service (see below) | * DOCS for Advanced users

• FEEDBACK loop: partner with Eng/PM on DevEx from 12 of 1-1 developers

Bacalhau week 1.0 plan:

• 5 blogs
• Outreach/5 ads/3 paid blogs/appearance in 5 newsletters
• 5 Influencers
• 2 Podcasts with Aronchick

Inspire/Breadth:

• 5 Conferences
• 1 Hackathon
• 2 Meetups

Engagement/Depth:

• COD Summit Spring
  • SWAG
• 10 engineer grants
• 4 education grants
• 2 grants for champions (speakers/presenters/meetup organizers)
• 1 SDKs grant | | M4 Q3, Sep23 | • Consensus & verification of deterministic jobs. • Website for data & common jobs. • Arbitrary networking via gateway. • Self-hosted Airflow (i.e., orchestrator runs inside Bacalhau) • End-to-end support for the encryption of private data | • “Anyone can be a compute provider” via rich client execution in Station. • Reputation system highlights trustworthy compute providers. • Clustered deployments with internode connectivity. • Onboard 10 compute providers and compute nodes and inbound marketing (social media, blog, website, partner program) • Better node selection strategies and optimized inter-node communication | • Two other CoD networks contributing to Octostore metadata service (see below) | * DOCS
• FEEDBACK loop: partner with Eng/PM on DevEx from 12 of 1-1 developers

Inspire:

• 2 Universities (webinars/hackathons/teaching content)
• 4 Conferences
• 1 Hackathon
• 2 Meetups local
• 1 Event with Partners (tap into Partners community)
• 2 PARTNERs present their success who built Bacalhau

Education:

• 3 Quickstart guides
• 5 Training
• 10 Blogs
• 1 Train the Trainer
• 1 Cheatsheet
• 2 online Webinars

Engagement/Depth:

• 2 Office hours
• 15 engineer grants
• 4 education grants
• 2 SDKs grants |

Additionally, we have larger/longer milestones.

Overarching Projects (Mapped into Milestone Deliverables)

Represented by epic-label issues in GitHub.

Deterministic WASM

Status: In progress

Owner: Simon

Collaborators: Will (from Jan)? TODO find owner

Goal: Make it possible to run WASM directly on the Bacalhau network rather than only Docker jobs.

Milestones:

• (Q1) Make it easier to bring common workloads to WASM transparently (e.g., Go, Python…)