memoryview is too large when encoding large arrays
Gilthans opened this issue · 1 comments
Gilthans commented
Hey there,
We're trying to use messagepack to serialize classes with very large data matrices.
When trying to save them though, we got 'memoryview is too large'.
Looking at the code, it seems there's a check if the length of data is more than 2**32 an exception is raised.
Is this hardcoded value a format limitation, or an implementation detail?
jfolz commented
It's a format limitation: https://github.com/msgpack/msgpack/blob/master/spec.md#bin-format-family