The referia library provides tools for assisting with assessment, originally written as an aide for 2021 REF Assessment, code has gone through many addtions and then a major restructuring for version 0.2.0
The library uses jupyter notebook as an interface.
The library builds on functionality provided in the lynguine
data oriented architecture library. The main difference between the two is that functionality that is general for the flow-based model the code follows sits in lynguine
. The referia
code provides convenience functionality for ease of creation of reviewing software.
To install use
%pip install referia
Configuration is stored in a local file, _referia.yml
.
This file provides the source and format of input data (for assessment), the location and format of annotations to store on the assessment as well of details of how to view files and urls associated with the assessment.
The configuration has the following fields
input
This contains the input data to be assessed.
viewer
Provides information at the top of the score sheet that gives background (for example reviewing instructions).
editpdf
Lists pdfs to copy and allow the user to edit (for example to make notes on a submitted thesis).
Subfields are field
which contains the filename, sourcedirectory
and storedirectory
. Also provides ability to specify pages
from the source, so that we have something like
field: ColumnName0
sourcedirectory: ./
pages:
first: ColumnName1
last: ColumnName2
storedirectory: ./pdfs
Functionality is provided in system.Sys.edit_files
.
urls
Lists urls that should be opened for providing additional information on the review.
output
This specifies how the annotation information is to be stored.
scored
Specifies how the code should "count up" how many reviews are complete.
series
This specifies how to store annotation information which is available with a subindex (such as a time series).
review
This specifies a set of widgets to create for human reviewing.
compute
Specifies fields that should be filled in by computations.
documents
Allows for the creation of documents (such as word docx or emails) that summarise the provided information.
summary_documents
Similar to documents, but this section provides documents that summarise all the data. Can be useful for summarising a sequence of reviews.