weigq/neurips2021_stats

NeurIPS2021 Statistics

• More detailed data is available online.
• ICLR 2022 statistics.

Note

• The statistics are collected only from finally accepted submissions in main conference.
• Finally rejected submissions are excluded, most of these are not available in public.
• Workshop and Track submissions are excluded.

All submissions

• 2334 submissions are finally accepted.
• 298(13%) submissions received two set of reviews.
• 2632(=2334+298) set of reviews in total.
• 6.36 average rating of all 2632 ratings.

• Decision	#	rating avg.	rating max	rating min
  Oral	56	7.56	8.75	6.33
  Spotlight	282	7.01	8.33	5.50
  Poster	2095	6.36	8.00	4.67
  Reject	199	5.19	7.33	3.75
  Total	2632	6.36	8.75	3.75

• Ratings distribution
• Top 40 original keywords
• Top 30 keywords after merging some redundancies

Consistency experiment

• 298 submissions received two set of reviews.

• 221(74%) submissions received two disagreed decisions.

• 77(26%) submissions received two agreed decisions.

• 199(67%) submissions received one Reject decision.

• Details (the two decisions are ordered.)

  

Acknowledgement

Some code is motivated by ICLR2019-OpenReviewData and iclr2022_stats.