fission-codes/kubo-car-mirror

Sessions

justindotpub opened this issue · 0 comments

Push sessions

  • Update CLI to accept diff param
  • Pass diff param to /dag/push
  • Update Push code to not include all CIDs in the CAR file
    • What is the cutoff criteria? Number of blocks? Perhaps since that is the case for streaming.
    • Fine tune sharness tests accordingly, to ensure we send enough data to have multiple rounds, or make that parameter configurable.
  • Once provider adds CIDs from CAR file to local block store...
    • Generate list of CIDs nested underneath those CIDs that have not been imported and that we are missing locally (i.e. subgraph roots)
      • Any CIDs that have links that we are missing
    • Generate a bloom filter for the diff param
      • Make sure sizing / param tuning logic is sound
    • Return both in provider payload
  • Update Push code to make additional requests based the returned payload
  • Update Push code to maintain a local cache for the peer (based on peerId) with CIDs that have been sent to that peer