TattdCodeMonkey/crc

Add ability to chunk calculation for larger binaries

TattdCodeMonkey opened this issue · 0 comments

For larger binaries sending the entire value to a NIF could possibly cause issues with the scheduler, if execution time in the NIF is too great.

Some testing should be done to see what a sensible max binary size is. With that information we should limit calls to the NIF functions with binaries smaller than that, and for larger ones chunk calls to the NIF and calculate the CRC as we go. This will require modifications to the NIF functions to take continue a CRC instead of always starting from a seed.

  • Decide on Max binary size to send to NIFs
  • Add ability to continue a CRC to NIFs
  • Chunk calls with binaries larger than max to make multiple calls to NIFs