python-lz4/python-lz4

Stream bindings are slow and broken

jonathanunderwood opened this issue · 0 comments

The streaming bindings are currently flagged as experimental and are not built by default. The problems with these bindings include:

  • The test suite fails on windows (64 bit) and Aarch64 architectures
  • The test suite takes too long to run hindering development
  • Decompression performance is terrible (#218)
  • Ring buffer is not implemented (#187)

Overall the design of these bindings and their test suite needs revisiting. An approach to consider:

  • Provide bindings in the extension module for the API bindings, but not the double buffer and ring buffer implementations
  • Implement double buffer and ring buffer functionality at the Python layer
  • Drastically reduce the set of test cases