cogtoolslab/cognitive-ai-benchmarking

Issues

• Survey should have a field marked complete

  #67 opened 2 years ago by felixbinder
  0

• Preloading of videos is broken

  #65 opened 2 years ago by felixbinder
  0

• Integrate S3 password into cab_config

  #64 opened 3 years ago by felixbinder
  0

• Provide example familiarization section

  #14 opened 3 years ago by felixbinder
  0

• Add common pitfalls to .readme

  #25 opened 3 years ago by felixbinder
  0

• document dominoes_local

  #50 opened 3 years ago by felixbinder
  0

• Write example notebook using the aforementioned (#16) functions to turn data into pandas dataframe/.csv

  #17 opened 3 years ago by felixbinder
  2

• Write watchdog file that performs exclusions and adapts stimuli database

  #15 opened 3 years ago by felixbinder
  0

• PII: add stern reminder about what is personally identifiable information (eg. prolific IDs) to readme

  #19 opened 3 years ago by felixbinder
  0

• better documentation

  #63 opened 3 years ago by yamins81
  3

• rename files to sensible names + add readme

  #57 opened 3 years ago by felixbinder
  0

• Add cab config documentation & example (w/o secrets, but explaining where they'd go)

  #59 opened 3 years ago by felixbinder
  0

• Write example .py module for exclusion (use flags with reasons from `exclusions.py` in `curiophysion`)

  #18 opened 3 years ago by felixbinder
  0

• add mutex to `store_local` to prevent concurrent writes

  #61 opened 3 years ago by felixbinder
  0

• figure out a way to not hardcode completion code (maybe a chiffre inclusion as URL parameter)?

  #62 opened 3 years ago by felixbinder
  0

• option to auto open new prolific slots after exclusion in watch dog

  #54 opened 3 years ago by felixbinder
  0

• adapt store.js to serve according to number of good games first, then the games after all

  #52 opened 3 years ago by felixbinder
  0

• figure out a way to connect a certain experiment with a certain exclusions.py

  #55 opened 3 years ago by felixbinder
  0

• Function to fetch data that applies exclusions (or flags them, or ignores them)

  #60 opened 3 years ago by felixbinder
  0

• PII: add `.py` module with PII encoder

  #20 opened 3 years ago by felixbinder
  0

• Security: upgrade default settings for authenticating into AWS and lab mongodb

  #27 opened 3 years ago by judithfan
  0

• backport changes to dominoes_local

  #49 opened 3 years ago by felixbinder
  0

• security: create default cabUser that must authenticate into mongo (not admin role)

  #58 opened 3 years ago by judithfan
  0

• Expand Prolific integration

  #13 opened 3 years ago by felixbinder
  0

• add handling/warning when app.js isn't opened from the experiments folder

  #51 opened 3 years ago by felixbinder
  0

• add different exclusion functions for different experiments

  #56 opened 3 years ago by felixbinder
  0

• make `app.js` autostart the watchdog

  #53 opened 3 years ago by felixbinder
  0

• `store.js`: clean up mongoDB version and remove experiment specific adaptations

  #10 opened 3 years ago by felixbinder
  2

• `store.js`: provide simple drop-in version of `store.js` that reads stimuli/metadata from local `.json` file and writes out/appends local `.csv` with results

  #9 opened 3 years ago by felixbinder
  0

• `setup.js`: maybe change naming convention/folder&file names to make clear what is server/client side?

  #11 opened 3 years ago by felixbinder
  0

• `setup.js`: include database name, exp name, iteration... on every message

  #35 opened 3 years ago by felixbinder
  1

• `setup.js`: clean up setup.js and remove experiment specific code

  #12 opened 3 years ago by felixbinder
  0

• Add simple way to run the experiment locally by simply clicking `experiment.html`

  #22 opened 3 years ago by felixbinder
  1

• `setup.js`: send request to get stimuli instead of receiving them on socket connection (see #32)

  #33 opened 3 years ago by felixbinder
  0

• Give proper acknowledgement to those who contributed to code

  #23 opened 3 years ago by felixbinder
  7

• Recruitment: Working example for Prolific API

  #28 opened 3 years ago by judithfan
  1

• Conduct compatibility test: object localization

  #29 opened 3 years ago by judithfan
  2

• Conduct compatibility test: surface normals

  #30 opened 3 years ago by judithfan
  2

• Testing: Guideline for experimenters to test that the experiment is running correctly before launching

  #37 opened 3 years ago by yifr
  2

• `setup.js`: add flag for internal port

  #38 opened 3 years ago by felixbinder
  0

• Add simple version of node.js that can be used to start the webserver while printing to file

  #26 opened 3 years ago by felixbinder
  2

• `app.js`: add check to only allow serving from db/coll that have stimuli in the name

  #39 opened 3 years ago by felixbinder
  0

• `app.js`/`store.js`: Generalize server side code away from individual experiments

  #32 opened 3 years ago by felixbinder
  0

• `setup.js`: move all hardcoded database names, experiment names, iterations, collection names... into config file for the experiment

  #36 opened 3 years ago by felixbinder
  1

• Add open source license

  #24 opened 3 years ago by felixbinder
  2

• PII: prefill `.gitignore` with lookup table

  #21 opened 3 years ago by felixbinder
  0

• Create and document generalizable exclusion scripts that can be loaded by watch dog

  #34 opened 3 years ago by felixbinder
  0

• Conduct compatibility test: mass inference

  #31 opened 3 years ago by judithfan
  0

• write `.py` with helper functions to pull entire experiment/iteration of experiment from mongoDB

  #16 opened 3 years ago by felixbinder
  0

• `app.js`: add favicon

  #8 opened 3 years ago by felixbinder
  0