Identify island maps in Sea of Thieves using a second device!
In Sea of Thieves you can retrieve in-game treasure maps that describe only the shape of the island and the location of treasure. Players are expected to use their shipboard maps to identify these islands. The Pickled Cartographer uses WebRTC and some rudimentary computer vision techniques to identify treasure maps in Sea of Thieves. Since this relies on camera input data, the application was designed with Mobile Safari in mind.
Point it at your monitor and the application will display the current camera input, some visual debugging info from the image detection, and a best match or ranked list of best matches.
That's this file
The primary application
A reusable getUserMedia-based camera class for mobile devices. You could probably use this in another project with minimal modification.
A relatively simple edge detection function
A developer page that pre-processes images of every island in the assets folder and produces a set of 'signatures' intended to be manually copied into the 'signatures.json' blob.
This should be done every time a change is made to the image processing code.
A dictionary of island metadata in the format {coordinate: {name:, type:, cat:}...}. Current as of the SoT 1.4.3 patch.
Defines several Computer Vision and image manipulation functions, including our Sobel filter.
The workhorse script that manipulates the HTML and coordinates the reusable components together.
A list of two item lists of the format [[location, signature],...]. Output by intake.html. These signature represent a pre-processed image from the assets folder and are suitable for comparison with camera input.
The primary CSS information for the main app and intake page.
This file describes custom rules for when to restart which files during development. It is used by Glitch to manage container behavior. Read more about how to use it here.
Assets for this project include images of every island in the game named with their primary grid-square. Images were manually captured from the master map, cropped, labelled, and edited to remove cartographic embelleshments (waves, grid lines, etc).