We are the Automated Screening Working Group, a group of researchers aiming to improve scientific manuscripts on a large scale. Our pipeline combines tools that check for common problems in scientific manuscripts to produce a single, integrated report for any paper. Currently, we are using the pipeline to evaluate COVID-19 preprints from medRxiv and bioRxiv. See our publicly available reports, generated with this pipeline, at @SciScoreReports.
Our pipeline offers a unified framework for retrieval and preprocessing of papers, a pluggable interface for tools, and formatting and public release of tool results as a unified report. While we encourage developers to experiment with and add their own tools, we are currently using the following tools in our production pipeline (that publishes to our Twitter account):
- JetFighter
- limitation-recognizer
- trial-identifier
- SciScore
- Barzooka
- ODDPub
- scite Reference Check
- rtransparent
Automated screening of COVID-19 preprints: can we help authors to improve transparency and reproducibility? in Nature Medicine.