/SIMPAC-2023-308

The software tool to detect changes within datasets

Primary LanguagePythonOtherNOASSERTION

SOM-QE is a software tool that can be used to detect differences within data sets. For example, it can be applied to tell the differences between two sets of medical images taken from the same patient at different times - possibly two consecutive clinical visits. This can assist the radiologists/surgeons in determining the effects of their prescription on the patient between the duration of the two clinical visits.

It is based on the artificial neural network algorithm called Self-Organizing Map (SOM), developed by Teuvo Kohonen. You can read more about it in his book, MATLAB Implementations and Applications of the Self-Organizing Map, or in one of his numerous publications available online.

After learning a data set, the final weights of SOM are found to have a difference with the real values of the data. This difference is known as the quantization error (QE), and is traditionally used to tell how close SOM was to the real values. In SOM-QE, the values are used to tell differences between the contents of data sets, an idea that finds numerous applications in life. You can read on how we used SOM-QE to tell the difference between two sets of medical images, obtained from a patient with a sprained knee from this open source paper, Detection of small changes in medical and random-dot images comparing self-organizing map performance to human detection, for details.

In this demonstration of the working of SOM-QE, an implementation of SOM, named MiniSOM, is used.

SOM-QE is used to process satellite images of Lake Mead - a water reservoir formed by the Hoover Dam on the Colorado River in the Southwestern United States. The aim is to determine the yearly raising/falling of water levels in the lake, which is significant in determining effects of drought, climate change, etc. The duration covered is from the year 1984 to 2011. The SOM-QE values for each image were obtained, shown in this figure: SOM-QE analysis of water level trends in Lake Mead from 1984 to 2011.

These values indicate the changing water levels of the lake over the years, and corresponds with the findings of other measurements by organization like Bureau of Reclamation, as accessed on 3rd June 2023 or NASA's earth observatory which sums up the situation thus:

'Lake levels rose steadily through the 1980s, reaching 24.8 million acre-feet in August 1985, when the bottom image was taken. But as of August 2010 (top image), Lake Mead held 10.35 million acre-feet, just 37 percent of the lake's capacity.'

Check out the link for the images referred to in this quote. Note the corresponding SOM-QE values for year 1985 (higher) and for year 2010 (low).

Cite this work as:

Wandeto, J.M., Nyongesa, H., Rémond, Y., Dresp-Langley, B., 2017. Detection of small changes in medical and random-dot images comparing self-organizing map performance to human detection. Informatics in Medicine Unlocked 7, 39–45. https://doi.org/10.1016/j.imu.2017.03.001