This is the custom dataset builder, web-dsl-mapping and bootstrap.vocab generator for Screenshot-2-Code and Pix2code.
It's based off of the Pix2code library by Tony Tony Beltramelli, but in particular the screenshot-2-code version by Emil Walner which uses Keras + Tensorflow.
It allows you to create your own custom datasets as well as vocab. It also includes training scripts for AWS, Colab, and local cpu. Folders:
/dataset-builder- Build your dataset here, contains your .npz and .gui pairs for model training.
/dsl-builder- This is where you build your dsl library (web-dsl-mapping.json + bootstrap.vocab).
/training- Contains training scripts for Colab, AWS and local for model training
My build: https://www.youtube.com/embed/Jr6DyjczXUA (Note the weights file is not included in this project).