Issue about how to improve the efficiency of LFP processing in spikeinterface?
sunjie454 opened this issue · 1 comments
My data is collected by Intan in RHD data, which is then converted into raw files and stored using spikeinterface. I subsequently read this raw files again and gain LFP data through filtering. However, my data size is over 1 terabyte, and the processing speed is very slow and unstable. There are instances where the program finishes running without any output, but running the same data again produces results. This inconsistency occurs without any error messages, which is very puzzling. Therefore, I would like to know if there are methods in spikeinterface to improve the efficiency and stability of LFP processing. For example: (1) Does spikeinterface provide specific methods for processing LFP data? (2) How can I read raw files, process them into LFP data, and store them simultaneously, instead of reading all raw files first, processing, and then writing the output? (3) How to use global_job_kwargs to enhance processing speed? (4) How to improve the overall stability of the program?
Looking forward to everyone's response and answers.
Hi, can you open the issue in SpikeInterface? This is not related to probeinterface. Closing here