duplicates
There are 230 repositories under duplicates topic.
qarmin/czkawka
Multi functional app to find duplicates, empty folders, similar images etc.
kucherenko/jscpd
Copy/paste detector for programming source code.
sahib/rmlint
Extremely fast tool to remove duplicates and other lint from your filesystem
scinos/yarn-deduplicate
Deduplication tool for yarn.lock files
sean-public/python-hashes
Interesting (non-cryptographic) hashes implemented in pure Python.
F483/dejavu
Quickly detect already witnessed data.
kouhin/redux-dataloader
Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.
kristiankoskimaki/vidupe
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
matteodelabre/mongoose-beautiful-unique-validation
Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors
jvirkki/dupd
CLI utility to find duplicate files
Canop/backdown
A deduplicator
cloud-py-api/mediadc
Nextcloud Media Duplicate Collector application
microsoft/near-duplicate-code-detector
A simple tool for detecting near-duplicate source code
PJDude/dude
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
eyalroz/removedupes
Remove Duplicate Messages
scrubbbbs/cbird
Command-line program for managing a media collection, with focus on Content-Based Image Retrieval (Computer Vision) methods for finding duplicates.
deplicate/deplicate
Advanced Duplicate File Finder for Python
shevchenkoartem/lastfm-smart-deduper
JS script that allows you to remove duplicates from your Last.fm scrobbles library.
StephaneCouturier/Katalog
Katalog is an application to manage catalogs of disks and files to search and get statistics.
deric/es-dedupe
Tool for removing duplicate documents from Elasticsearch
src-d/gemini
Advanced similarity and duplicate source code at scale.
src-d/apollo
Advanced similarity and duplicate source code proof of concept for our research efforts.
LyonSyonII/akin
Rust crate for writing repetitive code easier and faster.
Bartozzz/potential-duplicates-bot
A configurable GitHub App which checks for potential issue duplicates using Damerau–Levenshtein distance algorithm.
guicamest/GDuplicate-Finder
GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!
github-userx/Awesome-Duplication-Finders
Apps to find duplicate files including same/similar images & videos (with computer vision/AI)
Navid2zp/dups
A CLI tool to find/remove duplicate files supporting multi-core and different algorithms (MD5, SHA256, and XXHash).
gacarrillor/AppendFeaturesToLayer
QGIS Processing plugin to add an algorithm for upserting features from a source vector layer to an existing target vector layer.
caluml/finddups
Find duplicate files on your computer
rasheedsulayman/DuplicateContactsRemover
📒 A simple app to optimize your address book and remove duplicate contacts.
rustomax/ndf
Duplicate file finder written in Nim
mkearney/funique
⌚️ A faster unique() function
vladsmirnov/url-rewrites
Magento 1.x module to target the URL Rewrite issue
arikw/outlook-duplicated-items-remover
A VBA script that finds and moves duplicated items in selected outlook folders
elias123tre/bitwarden_find_duplicates
Find duplicate logins based on domain, from bitwarden export. Open source for your safety.
kevinpollet/pocket-deduper
Remove duplicates from your Pocket list.