coreweave/tensorizer

Issues

• FP8 support

  #171 opened 4 months ago by markoarnauto
  0

• Tensorizer Support for Large Models( 70B+) that dont fit into a single GPU

  #81 opened 10 months ago by SujoyDutta
  11

• [3.0] [future-work] Cryptographic auth for headers

  #154 opened 5 months ago by bchess
  0

• [3.0] Make data_offset relative to the data section of the file

  #142 opened 5 months ago by bchess
  0

• [3.0] Validate incremental bulk_write calls

  #149 opened 5 months ago by bchess
  0

• [3.0] Use fallocate in incremental mode

  #150 opened 5 months ago by bchess
  1

• [3.0] Use fallocate holes to optimize header size

  #159 opened 5 months ago by bchess
  0

• [3.0] [future-work] Turn `TensorSerializer` into a context manager

  #157 opened 5 months ago by bchess
  0

• [3.0] remove compress_tensors

  #156 opened 5 months ago by bchess
  0

• [3.0] smarter way to identify overlapping storage regions

  #146 opened 5 months ago by bchess
  0

• [3.0] Operate on detached copies of tensors

  #147 opened 5 months ago by bchess
  0

• [3.0] Read all metadata in one read

  #148 opened 5 months ago by bchess
  0

• [3.0] Avoid duplicate clone task in encryption where possible

  #145 opened 5 months ago by bchess
  0

• [3.0] Have _FutureGroup.result pop successful futures before it returns

  #141 opened 5 months ago by bchess
  0

• [3.0] Encrypt headers

  #151 opened 5 months ago by bchess
  0

• [3.0] Introduce a way to prioritize work in the ThreadPoolExecutor

  #162 opened 5 months ago by bchess
  0

• [3.0] remove barrier in _prepare_for_write_encryption

  #160 opened 5 months ago by bchess
  1

• [3.0] Canceled serialization should still do in-place decryption

  #144 opened 5 months ago by bchess
  0

• [3.0] separate header hash from tensor hash

  #143 opened 5 months ago by bchess
  0

• [3.0] Protect against chunk reordering and truncation in ChunkedEncryption authentication

  #158 opened 5 months ago by bchess
  1

• [3.0] [maybe] More granular future dependencies

  #152 opened 5 months ago by bchess
  0

• [3.0] Optional syncing

  #153 opened 5 months ago by bchess
  0

• [3.0] Document `max_tensors`

  #140 opened 5 months ago by bchess
  0

• [3.0] Optimize deserialization for new schema

  #161 opened 5 months ago by bchess
  0

• [3.0] [future-work] Use consistent well-documented exception types

  #155 opened 5 months ago by bchess
  0

• Signature version not loaded from S3 config file on S3 deserializer

  #138 opened 5 months ago by broussea1901
  0

• utils.get_device() should include 'mps'

  #136 opened 6 months ago by Zihann73
  1

• Is it possible to serialize LoRA adapter bin / safetensors file?

  #135 opened 6 months ago by AAnirudh07
  2

• Is there support for downloading via s5?

  #133 opened 6 months ago by vrdn-23
  3

• Support S3 auth via the EC2 Instance Metadata Service / AWS SSO temporary credentials

  #130 opened 7 months ago by danielchalef
  1

• Deserialisation issue: KeyError: "attribute 'bias' already exists"

  #67 opened a year ago by milo157
  1

• Release 2.9.0?

  #116 opened 7 months ago by mikeoconnor0308
  2

• Jax support

  #119 opened 8 months ago by dmarx
  0

• Fail to deserialize model: Expected all tensors to be on the same device

  #90 opened 9 months ago by lizzzcai
  3

• support setting S3 region and signature version in stream_io

  #92 opened 9 months ago by lizzzcai
  0

• Unexpected results on attention mask (Blip2ForConditionalGeneration)

  #64 opened a year ago by geret1
  3

• Add encryption and hash verification to tensorizer

  #33 opened 10 months ago by wbrown
  1

• ValueError: Tensor index in the file is empty

  #78 opened 10 months ago by mikob
  3

• missing dependency: serializer

  #4 opened a year ago by dmarx
  1

• Support self-signed certificates in `CURLStreamFile`

  #58 opened a year ago by spmkone
  1

• `mmap` issues with loading models form PVC as of `tensorizer` `v2.4`

  #55 opened a year ago by wbrown
  0

• Eager vs. Lazy Loading in Plaid Mode

  #30 opened a year ago by Eta0
  0

• Unintuitive behaviour of `verify_hash` parameter to `load_into_module`

  #40 opened a year ago by Eta0
  0

• Stability example should download all artifacts from S3 rather than HuggingFace Hub

  #7 opened 2 years ago by wbrown
  1

• Tensorizer Serializer Image

  #8 opened 2 years ago by wbrown
  0