What to include in the indexer discussion
Findings about errors in autoretrievals
| Step | Cohorts Removed | 
|---|---|
| Requests: incoming CIDs from bitswap | |
| Requests to the Indexer for CIDs that did not return any SP | |
| Requests with Indexer Candidates | |
| SPs already working on a retrieval | |
| Requests with Indexer Candidates (Filtered) | |
| Query-ask unsuccessful (Query Ask Errors) | |
| Requests with Successful Queries | |
| Query responses asking for payment (per byte or for unsealing) and still had >0 | |
| Requests with Successful Queries (Filtered) | |
| We attempted retrieval on at least one of the remaining candidates and did not get a piece (Retrieval Errors) | |
| SPs working on a retrieval already | |
| Requests with Successful Retrievals | 
Requests with Successful Queries / Requests with Indexer Candidates (Filtered)
| Software bug | In SP control | ||
|---|---|---|---|
| "getting pieces for cid" (DAGStore) | 82% | ✅ unsealing should be easier | ✅ | 
| "failed to fetch storage deal state" | 10% | ✅ data transfer stack | |
| "failed to dial" | 8% | Mismatch in multiaddr in the indexer and on the chain | ✅ not listening - firewall etc. | 
| "failed to read response: stream reset'" | 0.0% | ✅ likely networking problem | |
| "failed to read response: EOF" | 0.0% | ✅ DAG transfer stack | |
| "failed to open stream to peer" | 0.0% | ✅ networking problem | 
Requests with Successful Retrievals / Requests with Successful Queries (Filtered)
| Software bug | In SP control | ||
|---|---|---|---|
| Too many retrieval deals received" | 33% | ✅ CID Gravity | |
| "miner is not accepting online retrieval deals'" | 21% | ✅ configuration maybe CID Gravity or other | |
| "unconfirmed block transfer" | 13% | ✅ data transfer error (reports success but no data received) | |
| "Access Control" | 11% | ✅ configuration maybe CID Gravity or other | |
| "response rejected" | 10% | ✅ don’t have a way to express what the actual error is | |
| "timeout after 1m" | 10% | ✅ didn’t set an unsealing price but actually need to unseal | |
| "Under maintenance, retry later" | 1% | ✅ similar to access control | |
| Other | 0.0% | 
Questions: