facebookresearch/dynabench

Issues

• Randomly initialize multiclass label selection when switching to a new context. Make it stay the same otherwise.

  #904 opened 3 years ago by TristanThrush
  0

• Give task owners the ability to choose default setting for getting random contexts

  #902 opened 3 years ago by maxbartolo
  2

• dataset deletion doesn't work when there are already scores for it (foreign key constraint failure)

  #847 opened 3 years ago by TristanThrush
  3

• Recover Datasets for NLI Task

  #900 opened 3 years ago by Rebecca-Qian
  1

• Refactor code in `/tasks/admin_or_owner`

  #895 opened 3 years ago by ktirumalafb
  0

• Bulk Create Interface Submission Feature

  #898 opened 3 years ago by TristanThrush
  0

• Moving data collection to EC2Architect instead of heroku

  #844 opened 3 years ago by ktirumalafb
  0

• Speed up query for retrieving validation examples

  #894 opened 3 years ago by ktirumalafb
  0

• QA CreateInterface: Whitespace around punctuation

  #872 opened 3 years ago by maxbartolo
  2

• QA (not urgent): Clicking on an answer no longer removes that answer

  #886 opened 3 years ago by maxbartolo
  0

• QA: storeExample() not working

  #884 opened 3 years ago by maxbartolo
  0

• QA: getRandomContext() only seems to be returning from around 5 possible contexts

  #885 opened 3 years ago by maxbartolo
  2

• Wrap `db.commits()` in a try/catch that `rollback` when failed to prevent directly throwing SQL errors to users

  #883 opened 3 years ago by ktirumalafb
  0

• Decentralized Eaas to reduce cost of dynabench

  #814 opened 3 years ago by ktirumalafb
  0

• Give users the capability to delete their own models

  #880 opened 3 years ago by TristanThrush
  0

• Enable Admins to see user (and user email) associated with a task proposal

  #878 opened 3 years ago by TristanThrush
  0

• It seems that models that fail are not taken down anymore?

  #842 opened 3 years ago by TristanThrush
  4

• new perturb script returns a format that doesn't quite work with the evaluation server

  #846 opened 3 years ago by TristanThrush
  1

• Edge-case bug with model interaction

  #856 opened 3 years ago by TristanThrush
  1

• Suggestion: Can we add a way for get_random_example() in "turk" mode to prevent getting examples for the current annotator (by annotator_id)?

  #821 opened 3 years ago by maxbartolo
  6

• Ensure login messages take you to the correct place after login

  #863 opened 3 years ago by TristanThrush
  0

• Small Dataperf changes

  #837 opened 3 years ago by douwekiela
  0

• "You are on round x" message seems to be a different style than the rest of dynabench

  #854 opened 3 years ago by TristanThrush
  0

• we should remove a recently introduced warning

  #849 opened 3 years ago by TristanThrush
  1

• dataset name issue again (my fault)

  #850 opened 3 years ago by TristanThrush
  0

• Bug with adding a new dataset, failing evaluation if name is misformatted / round is not selected

  #835 opened 3 years ago by ktirumalafb
  4

• Remove the button in the create interface that enables selection of previous rounds

  #816 opened 3 years ago by TristanThrush
  0

• Fix red react warnings

  #810 opened 3 years ago by TristanThrush
  0

• Dataset name issues

  #838 opened 3 years ago by TristanThrush
  1

• Dynabench documentation says to clone the wrong repo

  #798 opened 3 years ago by TristanThrush
  3

• bug: if `smtp` configs are not set, `build_server.py` crashes instead of ignoring email sending

  #829 opened 3 years ago by kokrui
  0

• tiny issue: `api/config_example.py` has two `evaluation_sqs_queue` properties

  #827 opened 3 years ago by kokrui
  0

• Enable option to automatically generate perturb files when uploading datasets

  #807 opened 3 years ago by TristanThrush
  1

• Export bug with a large number of validations

  #824 opened 3 years ago by TristanThrush
  0

• Add functionality to delete your own models

  #820 opened 3 years ago by maxbartolo
  0

• Give task owner ability to select contexts to put in the loop by tag

  #809 opened 3 years ago by TristanThrush
  0

• Give task owners the ability to select their annotators

  #811 opened 3 years ago by TristanThrush
  1

• Cost-cutting via taking down unused models

  #797 opened 3 years ago by ktirumalafb
  3

• ujson escapes forward slashes by default

  #800 opened 3 years ago by kokrui
  0

• Better dynalab feedback

  #792 opened 3 years ago by douwekiela
  0

• Change annotation config JSON to something more human-readable

  #791 opened 3 years ago by douwekiela
  0

• Rename `Admin Task Proposals` to `All Task Proposals` in the left menu bar on Admin account

  #786 opened 3 years ago by Ishita-0112
  2

• tiny bug: PR #753 uses `react-router-hash-link` but doesn't include it in package.json

  #789 opened 3 years ago by kokrui
  0

• Proposed Task: Use React table for tables

  #785 opened 3 years ago by s0mya
  0

• Proposed Task: Incorporate Storybook

  #784 opened 3 years ago by s0mya
  0

• Proposed Task: Migrate from Javascript to Typescript

  #782 opened 3 years ago by s0mya
  1

• Proposed Task: Migrate an existing class component

  #783 opened 3 years ago by s0mya
  0

• Breaking change in pred_field_converter logic

  #778 opened 3 years ago by gwenzek
  0

• Save->saved button in model response card doesn’t actually ask the backend whether it successfully saved the create metadata

  #767 opened 3 years ago by TristanThrush
  0

• Export data buttons in the rounds page all show loading icons when you click on just one button in particular

  #765 opened 3 years ago by maxbartolo
  0