Initial proposal: Verifiable Off-chain Data Aggregation
FIP Dicussion: https://github.com/filecoin-project/FIPs/discussions/512
FIP Discussion for on-chain verification: https://github.com/filecoin-project/FIPs/discussions/562
Solution Blueprint: https://docs.google.com/document/d/1M0uj7oUqF3b2CjBhsf_4UbMwrGk9cbGvBbPAT5PHMzE/edit
<aside> ⭐ A large majority of users onboard data onto the Filecoin network via an aggregator. Today the work done by aggregators is unverifiable and unprovable. The user relies on the aggregator to perform the work correctly and at the same time, it is impossible to prove to a third party that a given piece of data was included in a deal which is a highly requested functionality for FVM.
</aside>
Tech Lead: Kuba
PM: Honghao Qiu
Retrieval Engineering (Boost): Will Scott, Hannah Howard, Jacob Heun
Actors Engineering: AlexNorth / Kuba
Deal Data processing: Kuba/Aggregator teams
| Milestone | Detail | Status | ETA | DRI |
|---|---|---|---|---|
| Publish FRC | Publish FRC and approved by community | |||
| https://github.com/filecoin-project/FIPs/discussions/562 | Done | Week of 12/5 | Kuba | |
| Formatting library | Aggregation formatting library to be used by estuary and .storage (daghouse). Batch proof library on top. | |||
| (Needs to break this into smaller tasks) | ||||
| Note: | ||||
| Once format library is available, share with Boost/Indexer team to prep update | Done | By nv18 upgrade | ||
| Mostly done (need more test), shared with partner teams | Kuba | |||
| Proof Library | Single proof library. Need this for verification contract work to start | Done | By nv18 upgrade | |
| Mostly done (need more test), shared with partner teams | Kuba | |||
| Verification contract | Contract to validate the proof produced by aggregators on-chain for use in “Storage Products”. | |||
| Need solidity expertise to implement in Jan since Kuba might not have bandwidth available for this work | Done | Completed by Estuary | Potential help from Kevin Li, when library is available. | |
| Kuba to share spec with Kevin | ||||
| Build-in actor change | Implement actor change based on alignment with Alex | |||
| https://github.com/filecoin-project/builtin-actors/tree/integration/builtin-api | Done | By nv18 upgrade | Aayush | |
| Estuary integration | Integrate library to provide access to inclusion proof to users | In Progress | Estuary evaluating ETA | Cake (Estuary) |
| .Storage integration | Steps to integrate: |