This repository contains the implementation of a privacy-preserving Image Processing system using Homomorphic Encryption, specifically the Paillier Cryptosystem. Our project enables operations on encrypted images, eliminating the need for decryption during processing. This approach ensures the privacy and security of image data. An example of the power of this idea is shown below.
This figure shows 2 encrypted images being matched directly in the encrypted domain, where any external observer cannot tell the original contents of the image. The original images contain 2 shots of the Pyramids of Giza, justificating the traingular structure detected by the keypoints. How this operation was performed will be discussed in the upcoming sections.
- Paillier Cryptosystem: Implementation of encryption, decryption, and key generation based on the Paillier Cryptosystem.
- Homomorphic Operations: Support for addition and scalar multiplication on ciphertexts.
- Image Processing Operations: Implements various image processing tasks like smoothing, edge detection, and morphology on encrypted images.
- HESIFT Algorithm: Adaptation of the Scale Invariant Feature Transform (SIFT) algorithm for feature extraction from encrypted images.
- Image Matching: Utilizes the Fast Library for Approximate Nearest Neighbors (FLANN) for efficient image matching.
The structure of the code is as follows:
- The "utils_encryptedDomain" folder contains our implementation of the Paillier Cryptosystem, specifically tuned for efficiency and compatability with NumPy Arrays. Furthermore, it contains our implementation of Convolutions in the encrypted domain, as well as any other operations that can potentially be performed on encrypted images
- The "feature_extractors" folder contains our implementation of Lowe's SIFT algorithm on encrypted images, named HESIFT (Homomorphically Encrypted SIFT). The HESIFT function found at the end of the file can be directly called to extract the keypoints and descriptors.
To run the project locally, follow the steps below:
-
Clone the Repository:
git clone https://github.com/AhmedAbdelaal2001/Homomorphically-Encrypted-SIFT cd your-repo -
Install Required Packages: Ensure that you have the necessary packages installed. You can install them using
pip:pip install django cv2 numpy scikit-image pickle matplotlib
Note: Make sure to have Python and pip installed on your system.
-
Run the Project:
python manage.py runserver
This command will start the Django development server. Once the server is running, you can access the project at http://127.0.0.1:8000/ in your web browser.
-
Explore the Application:
- Open your web browser and navigate to http://127.0.0.1:8000/.
- Explore the functionalities related to secure image matching using Paillier encryption and HE-SIFT.
-
Upload Images:
- On the web application, navigate to the image upload section.
- Upload the image you want to match from your local machine.
-
Get Results:
- After uploading the image, click on the "Match" button.
- The application will securely process the image using Paillier encryption and HE-SIFT.
- The result will display the top 5 matches found for the uploaded image.
-
Review Results:
- Examine the matched images and their corresponding details.
- The results will include information such as similarity scores or other relevant metrics.
- Django: A high-level Python web framework that encourages rapid development and clean, pragmatic design.
- OpenCV (cv2): An open-source computer vision and machine learning software library.
- NumPy: A powerful library for numerical operations in Python.
- scikit-image: A collection of algorithms for image processing.
- Matplotlib: A comprehensive library for creating static, animated, and interactive visualizations in Python.
- Pickle: A module for serializing and deserializing Python objects.
This project is licensed under the MIT License.