mlcommons/logging

Issues

• Add missing RCPs for RNN-T

  #147 opened 5 months ago by mwawrzos
  3

• Create a github actions for publishing to pypa

  #72 opened 5 months ago by sub-mod
  0

• fatal errors in result_summarizer if all reult logs failed mlp_compliance check

  #65 opened 5 months ago by lliuBR
  0

• package import problem

  #61 opened 5 months ago by Shawn-IEITSystems
  1

• BERT tensor name for weight initialization not clear (`cls/predictions/decoder/kernel`)

  #204 opened 3 years ago by qpjaada
  4

• Address 1.1 review period issues

  #203 opened 3 years ago by emizan76
  2

• Add hparams and compliance checks for training and eval samples for all benchmarks

  #143 opened 3 years ago by emizan76
  3

• Use of constants in constants.py

  #199 opened 3 years ago by emizan76
  0

• BERT compliance checker: please change opt_epsilon to opt_lamb_epsilon

  #120 opened 3 years ago by itayhubara
  4

• Better logging proposal

  #152 opened 3 years ago by emizan76
  1

• missing model_bn_span in schema for rcp_checker resnet hyperparams

  #142 opened 3 years ago by matthew-frank
  4

• Seed checker gets confused when handling multiple implementations

  #129 opened 4 years ago by emizan76
  8

• Document RCPs method of production

  #116 opened 4 years ago by nv-rborkar
  6

• [package checker] weights initialization log fails

  #197 opened 3 years ago by qpjaada
  2

• [compliance checker] logging features from Python 3.9

  #190 opened 3 years ago by mwawrzos
  10

• Package checker's dependencies not installed with `pip install`

  #98 opened 3 years ago by shangw-nvidia
  3

• [HPC-1.0.0 | compliance checker] Error for open division results

  #172 opened 3 years ago by koichishirahata
  2

• [Result Summarizer] FOLDER's multi-org input does not work

  #160 opened 3 years ago by shangw-nvidia
  3

• [Result Summarizer] result summarizer returns instance_scale=0.0 for logs from CPU-based systems

  #165 opened 3 years ago by koichishirahata
  3

• [BERT|RNNT] Verify vocab size in compliance checker

  #148 opened 3 years ago by shangw-nvidia
  3

• [RCP Checker|HPC] Package checker not working for CosmoFlow and OpenCatalyst

  #162 opened 3 years ago by koichishirahata
  12

• Compliance checker: epoch number for evaluations should be validated against reference schedule

  #79 opened 4 years ago by xyhuang
  3

• [Result Summarizer] details_url and code_url are broken.

  #159 opened 3 years ago by shangw-nvidia
  1

• [Package Checker] Incorrect log naming convention check

  #158 opened 3 years ago by shangw-nvidia
  6

• [Result Summarizer] Incorrect "host_processor_core_count" reporting

  #157 opened 3 years ago by shangw-nvidia
  1

• New directory structure proposal.

  #156 opened 3 years ago by emizan76
  2

• REQ conditioned on context values

  #150 opened 3 years ago by azrael417
  1

• Pretrained model checkpoint validation

  #76 opened 4 years ago by xyhuang
  1

• Compliance checker should check if the log shows correct line numbers

  #74 opened 4 years ago by xyhuang
  1

• Add info about initialization method in logging

  #80 opened 4 years ago by xyhuang
  3

• Detect results/<system>/<benchmark>/result*.log in addition to results/<system>/<benchmark>/result*.txt

  #138 opened 3 years ago by matthew-frank
  5

• Add info about gradient accumulation in logging

  #78 opened 3 years ago by xyhuang
  2

• Seed verification

  #85 opened 3 years ago by mwawrzos
  0

• Outdated checkers

  #88 opened 3 years ago by mwawrzos
  0

• Implementation proposal for RCPs

  #90 opened 3 years ago by emizan76
  0

• Validate number of logging entries

  #91 opened 4 years ago by mwawrzos
  1

• Missing MLPERF BERT training hyperparameters in mlperf-logging's constants.py

  #106 opened 3 years ago by lshao2
  1

• Make README.md more useful to new users

  #137 opened 3 years ago by matthew-frank
  3

• Should we just use -csv with result summarizer?

  #141 opened 3 years ago by emizan76
  1

• bug in BERT-sepcific progress reporting

  #131 opened 3 years ago by cocteautwins
  3

• How to use compliance_checker

  #130 opened 3 years ago by tkunlin
  3

• [Training] File level checker

  #51 opened 4 years ago by xyhuang
  0

• [Training+Inference] Package checker

  #52 opened 4 years ago by xyhuang
  0

• [Training+Inference] Spec of common format

  #53 opened 4 years ago by xyhuang
  0

• [Training+Inference] Common lib for common logging format

  #54 opened 4 years ago by xyhuang
  0

• Inference directory structure is out of date

  #104 opened 4 years ago by DilipSequeira
  0

• system_description_checker is not called in package_checker

  #89 opened 4 years ago by mwawrzos
  1

• Include preprocessing script as part of the submission

  #77 opened 4 years ago by xyhuang
  0

• Enable dataset validation

  #75 opened 4 years ago by xyhuang
  0

• Wrong string in mlperf_logging/system_desc_checker/system_desc_checker.py

  #60 opened 4 years ago by Shawn-IEITSystems
  0