/benchmark_demultiplexing

Some scripts to benchmark demultiplexing on our NGI infrastructure

Primary LanguagePythonMIT LicenseMIT

README

TODO

  • Collect PID of the started run

  • Create file when run is finished

  • Only start a run if the previous is done

  • Check if the run has already been done in previous script run

  • Output psutil stats into a text file with timestamps (to avoid overwriting)

  • Output psutil stats for the specific pid as well as for the entire system

  • Collect both memory and cpu stats

  • Handle parallel runs

  • Check for more stats (IO)

  • process specific memory usage

  • Delete output files after run

  • Modify the command to fit each clone/run

  • [x]] Cleanup fails when directory is not empty

  • process cpu percentage is always 0...

Runs will create the same output directory, and delete if once the command is done.