/ia2020-facetouch

Seminar Project Interactive Analytics - FaceTouch

Primary LanguageJupyter Notebook

FaceTouch

This is a TECO-seminar project.

Annotation with Anvil

This is a quick guide for annotating (labeling) videos with the anvil tool. (https://www.anvil-software.org/)

General

shortcut: f1 to start (green line) and f2 to end (red line) for creating an annotation, f3 to directly edit the annotation.

Guideline

  1. Open the video that should be annotated, change the sepcification in annotation properties to the path of touch-spec-keys.xml
  2. Click at the wished start point in timeline and press f1, click at the whished stop point press hotkeys (q=begin,w=stop,a=lefthand,s=righthand,d=bothhands) to create an annotation. Make sure the block is selected(pink shadow).
  3. If the spec file was changed, remember to click the 3rd icon to reload the xml and click the 4th icon to refresh the annotation.

Design of touch-spec-keys.xml

There are overall 4 kinds of tracks.

  1. the anchor track determines start and end periods.
  2. the trl track records face touch in general.
  3. the mouthzone, eyezone and nosezone tracks record the touch events at the most dangerous zones with mucosa. In each zone 3 to 5 subtracks are defined as follows:
    • the touches track records all touches in this zone.
    • the oralcavity, eyes, nostril tracks record the direct touchs of the mucosa in each dangerous zone.
    • the left eye, right eye tracks record the direct touches of the eyes mucosa in detail.
    • the surroundings track records the touches of surrounding skins in each dangerous zones
  4. the otherskin track the touch events at other facial skins, including forehead, jaws, cheeks and ears. There are several subtracks defined as follows:
    • the touches track records all touches in these facial parts.
    • the forehead, jaws, cheeks, ears tracks record the touches in regard to each facial part
    • the left jaw, right jaw, left cheek, right cheek, left ear, right ear track the corresponding touches in detail.
  • The anchor track has a attribute status with value begin and stop. The corresponding hotkeys are "q"and "w", and the block will be colored either green or red.
  • The last 2 types of tracks have an attribute touchType with values lefthand, righthand and bothhands. The corresponding hotkeys are "a", "s" "d", and the block will be colored yellow, orange and olive.
  • the trl track is the only primary track except the anchor track. That means once the blocks in trl track are annotated, annotation in following tracks could be easily remarked with double klicks and hotkeys for touchType (left-, right-, bothhands). Thus, the annoattion in trl tracks should include all the breakpoints in every below detail track.
  • the touches tracks reference driectly to trl, the facial parts of this zone reference to touches in its groups(eyes reference to eyezone.touches, jaws reference to otherskin.touches), the detail destinguishment of left and right reference to its corresponding facial parts(left eye reference to eyezone.eyes, left jaw reference to otherskin.jaws).