Throttle large rawspec dumps
david-macmahon opened this issue · 2 comments
Dumps with many fine channels can be large. For example, each dump of 64 coarse channels that have been channelized into 64M fine channels is 256MB of data. It would be nice if rawspec were able to throttle the "instantaneous" data rate to be half the actual rate. If these 256 MB dumps occur every 16 seconds, it would be great to write out the data over the span of 8 seconds (32MB/s). This will (hopefully) help keep the raw data from backing up in the ring buffer quite so much.
This is useful for real-time "online" operation. When channelizing existing RAW files, there isn't really a need to throttle the output.
While this may be a useful feature, it belongs in the code providing the real-time "online" output rather than in rawspec itself. IOW, it belongs in the client-provided callback function(s).