olcf/olcf-test-harness

Issues

• Refactor database logging backend

  #164 opened 5 months ago by hagertnl
  2

• Feature Request: Add Kafka data logging backend

  #165 opened 5 months ago by hagertnl
  0

• Feature Request: Lmod integration to use & save user-specified configuration files

  #176 opened a month ago by hagertnl
  0

• rgt_test_input.ini mis-configuration causes harness crash

  #135 opened 3 months ago by hagertnl
  0

• Harness crash and stack trace dump

  #169 opened 3 months ago by hagertnl
  2

• Harness attempts to submit job script even when job template does not exist

  #116 opened a year ago by hagertnl
  0

• Feature request: Support using environment variables in the definition of variables in EnvVars section

  #132 opened a year ago by hagertnl
  1

• Incorrect numbers printed in "Launched <x> tests, skipped <y> tests." ending line

  #158 opened 4 months ago by hagertnl
  3

• HTTPS Git protocol does not append machine name to remote path

  #171 opened 4 months ago by hagertnl
  0

• Feature Request: log end event when a test is CTRL+C'd

  #168 opened 4 months ago by hagertnl
  0

• Feature Request: auto-detect certain machine configurations

  #167 opened 4 months ago by hagertnl
  0

• Feature Request: add `setup_start`/`setup_end` state before `build_start`

  #166 opened 5 months ago by hagertnl
  0

• Inspect handling of double-quotes in InfluxDB fields like output_txt

  #142 opened 5 months ago by hagertnl
  1

• Allow user-defined environment variables in machine.ini

  #162 opened 6 months ago by hagertnl
  0

• Feature Request: allow a run input file to define an environment variable

  #161 opened 6 months ago by hagertnl
  0

• Feature Request: Improve handling of application exit code and job exit status

  #160 opened 8 months ago by hagertnl
  0

• test_harness_driver.py does not recognize NOTSET as a log level

  #156 opened 8 months ago by hagertnl
  5

• add_comment_to_influx.py utility timestamp rounding error

  #141 opened 8 months ago by hagertnl
  0

• machine_type undefined in configs/olcf_examples

  #147 opened 8 months ago by hagertnl
  0

• influx_log gives vague and unhelpful output

  #153 opened 9 months ago by hagertnl
  1

• InfluxDB timestamp issues

  #140 opened 10 months ago by hagertnl
  1

• Feature Request: Create a Python API for launching the OLCF Test Harness

  #154 opened 9 months ago by hagertnl
  2

• Checkout mode silently failing

  #143 opened 8 months ago by hagertnl
  1

• Harness prints "Skipped 0, launched 1" when build fails

  #138 opened 8 months ago by hagertnl
  0

• LogLevel flags hard-coded in several object classes

  #102 opened 8 months ago by hagertnl
  4

• Feature request: ability to re-run the exact run from a specific test ID

  #150 opened 9 months ago by hagertnl
  0

• Feature request: Best practices in test development section in docs

  #149 opened 9 months ago by hagertnl
  0

• Feature request: improve grep-ability of status files

  #146 opened 10 months ago by ddietz89
  0

• Feature request: allow configuring parallel builds/job launches

  #145 opened 10 months ago by ddietz89
  0

• Feature request: command-line flag to randomize test order

  #144 opened 10 months ago by hagertnl
  1

• Feature request: allow test name to be templated by an environment variable

  #139 opened a year ago by hagertnl
  1

• Feature Request: Include either test ID or job ID for node health entries

  #133 opened a year ago by hagertnl
  1

• Feature request: write node_health data points in batches

  #137 opened a year ago by hagertnl
  0

• Documentation request: document all automatic variable replacements available

  #134 opened a year ago by hagertnl
  1

• Slashes in app, test names runs but breaks things later

  #129 opened a year ago by hagertnl
  1

• Several classes in harness code do not have access to a logger

  #130 opened a year ago by hagertnl
  3

• Mysterious error given with bad cmd options

  #126 opened a year ago by ddietz89
  0

• Feature request: a way to prevent a specific test_id from resubmitting

  #125 opened a year ago by hagertnl
  0

• Specifying number of iterations in the rgt.input file does not work

  #113 opened a year ago by hagertnl
  1

• Feature request: `--scheduler-notify` flag to add email to job notification

  #124 opened a year ago by hagertnl
  0

• Feature request: Add an `strigger` line after submitting a job to check for job abort

  #122 opened a year ago by hagertnl
  0

• Feature request: --peek-build functionality

  #121 opened a year ago by hagertnl
  0

• Clean up/refactor code around job submission

  #112 opened a year ago by ddietz89
  0

• is_numeric method in harness/libraries/apptest.py:890 does not support scientific notation

  #105 opened a year ago by hagertnl
  0

• Broken `latest` link does not get updated

  #97 opened a year ago by hagertnl
  0

• Command line or env var for specifying machine.ini file directory

  #110 opened a year ago by ddietz89
  0

• Feature request: command-line flag or env-var for max resubmissions

  #109 opened a year ago by hagertnl
  0

• rgt_test_input.txt no longer supported

  #107 opened a year ago by hagertnl
  0

• Feature request: alias a test name to a group of tests run in parallel

  #104 opened a year ago by hagertnl
  1

• Harness task data structure seems overcomplicated

  #103 opened a year ago by hagertnl
  0