OpenBioLink/ThoughtSource

Issues

• mawps dataset cot incorrect

  #138 opened a year ago by KonstantinHebenstreit
  0

• New CoT Dataset Report: CoT-Collection

  #137 opened a year ago by chunhuizng
  0

• Tutorial notebook does not open

  #128 opened a year ago by TolgaCorbaci
  1

• Annotator sort by dataset

  #100 opened a year ago by KonstantinHebenstreit
  0

• Add info on ThoughtSource-100 to Readme

  #115 opened a year ago by matthias-samwald
  0

• Source mode not working for new datasets

  #132 opened a year ago by KonstantinHebenstreit
  1

• Generate takes very long time to finish

  #129 opened 2 years ago by michalrzak
  3

• krippendorff scores

  #130 opened 2 years ago by KonstantinHebenstreit
  0

• from_json seems not to work for empty datasets

  #125 opened 2 years ago by KonstantinHebenstreit
  2

• Annotator "star" feature does not work properly

  #127 opened 2 years ago by KonstantinHebenstreit
  0

• Add "_annotated" subscript to downloaded file from annotator

  #126 opened 2 years ago by elmaestrobert
  0

• Annotator does not allow unselecting annotations

  #124 opened 2 years ago by elmaestrobert
  0

• rename "cot" in config to "generated_cot"

  #118 opened 2 years ago by KonstantinHebenstreit
  0

• Annotator does not show correct option for boolean dataset.

  #114 opened 2 years ago by KonstantinHebenstreit
  2

• save generated cots in case of error

  #102 opened 2 years ago by KonstantinHebenstreit
  2

• loading collections and generated_cots accept single strings, not only lists

  #107 opened 2 years ago by KonstantinHebenstreit
  1

• evaluation for duplicated answer choices

  #117 opened 2 years ago by KonstantinHebenstreit
  1

• link to Annotator example file broken

  #113 opened 2 years ago by tmontana
  4

• throw error if from_json is used on already loaded collection

  #106 opened 2 years ago by KonstantinHebenstreit
  0

• change saving of default template

  #105 opened 2 years ago by KonstantinHebenstreit
  0

• PubmedQA dataset: Add reference CoT based on LONG_ANSWER field in source

  #81 opened 2 years ago by matthias-samwald
  0

• add conda

  #90 opened 2 years ago by KonstantinHebenstreit
  0

• Integrate context into template field possibilities

  #83 opened 2 years ago by KonstantinHebenstreit
  0

• Add datasets to Hugging Face dataset hub

  #82 opened 2 years ago by matthias-samwald
  0

• Check that contributor's guide is still up-to-date

  #76 opened 2 years ago by matthias-samwald
  1

• Default values for str if empty: None or ""

  #48 opened 2 years ago by nomisto
  2

• Datasets: MedQA, MedMCQA, PubmedQA

  #68 opened 2 years ago by matthias-samwald
  1

• medmc_qa dataset does not contain generated CoTs

  #66 opened 2 years ago by matthias-samwald
  1

• Rename templates.json

  #50 opened 2 years ago by nomisto
  1

• Document our standardized data schema

  #16 opened 2 years ago by matthias-samwald
  2

• Build tests sometimes fail because of "too many requests" HTTP error in our remote sources

  #61 opened 2 years ago by matthias-samwald
  0

• `document_id` is redundant

  #47 opened 2 years ago by nomisto
  0

• Dataset: AQuA

  #18 opened 2 years ago by nomisto
  8

• Grant application writing

  #14 opened 2 years ago by matthias-samwald
  0

• Add datasets from 'Can large language models reason about medical questions?' paper (?)

  #22 opened 2 years ago by matthias-samwald
  0

• Create script that generates an overview of our converted datasets and their contents

  #12 opened 2 years ago by matthias-samwald
  1

• Create first interactive demo for at least one task

  #11 opened 2 years ago by matthias-samwald
  1

• Create motivating demos of CoT streams

  #13 opened 2 years ago by matthias-samwald
  1

• Add markdown page describing added datasets (transfer from Google Doc)

  #6 opened 2 years ago by matthias-samwald
  1

• Update primary Readme page so it introduces project to broader public

  #8 opened 2 years ago by matthias-samwald
  0

• Collect prompts used to generate CoTs

  #10 opened 2 years ago by matthias-samwald
  1

• Compile license info for all included datasets

  #17 opened 2 years ago by matthias-samwald
  0

• Dataset: EntailmentBank

  #7 opened 2 years ago by matthias-samwald
  17

• Dataset: OpenBookQA

  #4 opened 2 years ago by matthias-samwald
  1

• Dataset: CommonsenseQA

  #19 opened 2 years ago by nomisto
  8

• Reorganize Github repo to accomodate multiple subcomponents

  #15 opened 2 years ago by matthias-samwald
  0

• Datasets: Datasets from Wei2022 repository (aqua, asdiv, commonsenseqa, date_understanding, gsm, mapwps sports_understanding, strategy_qa, svamp)

  #9 opened 2 years ago by matthias-samwald
  7

• Dataset: WorldTree

  #5 opened 2 years ago by matthias-samwald
  5

• Add field 'generated_answer' to schema

  #21 opened 2 years ago by matthias-samwald
  0

• Error during pip install

  #20 opened 2 years ago by matthias-samwald
  0