duplicates
There are 257 repositories under duplicates topic.
qarmin/czkawka
Multi functional app to find duplicates, empty folders, similar images etc.
kucherenko/jscpd
Copy/paste detector for programming source code.
sahib/rmlint
Extremely fast tool to remove duplicates and other lint from your filesystem
scinos/yarn-deduplicate
Deduplication tool for yarn.lock files
kristiankoskimaki/vidupe
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
F483/dejavu
Quickly detect already witnessed data.
PJDude/dude
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
kouhin/redux-dataloader
Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.
Canop/backdown
A deduplicator
scrubbbbs/cbird
Command-line program for Content-Based Image Retrieval of images and videos. Includes tools for general search and de-duplication.
matteodelabre/mongoose-beautiful-unique-validation
Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors
jvirkki/dupd
CLI utility to find duplicate files
cloud-py-api/mediadc
Nextcloud Media Duplicate Collector application
eyalroz/removedupes
Remove Duplicate Messages
microsoft/near-duplicate-code-detector
A simple tool for detecting near-duplicate source code
StephaneCouturier/Katalog
Katalog is an application to manage catalogs of disks and files to search and get statistics.
shevchenkoartem/lastfm-smart-deduper
JS script that allows you to remove duplicates from your Last.fm scrobbles library.
vuolter/deplicate
Advanced Duplicate File Finder for Python
github-userx/Awesome-Duplication-Finders
Apps to find duplicate files including same/similar images & videos (with computer vision/AI)
eliasfloreteng/bitwarden_find_duplicates
Find duplicate logins based on domain, from Bitwarden export. Open source for your safety.
twpayne/find-duplicates
Find duplicate files quickly.
src-d/gemini
Advanced similarity and duplicate source code at scale.
deric/es-dedupe
Tool for removing duplicate documents from Elasticsearch
src-d/apollo
Advanced similarity and duplicate source code proof of concept for our research efforts.
LyonSyonII/akin
Rust crate for writing repetitive code easier and faster.
Bartozzz/potential-duplicates-bot
A configurable GitHub App which checks for potential issue duplicates using Damerau–Levenshtein distance algorithm.
guicamest/GDuplicate-Finder
GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!
gacarrillor/AppendFeaturesToLayer
QGIS Processing plugin to add an algorithm for upserting features from a source vector layer to an existing target vector layer.
Navid2zp/dups
A CLI tool to find/remove duplicate files supporting multi-core and different algorithms (MD5, SHA256, and XXHash).
arikw/outlook-duplicated-items-remover
A VBA script that finds and moves duplicated items in selected outlook folders
rasheedsulayman/DuplicateContactsRemover
📒 A simple app to optimize your address book and remove duplicate contacts.
caluml/finddups
Find duplicate files on your computer
rustomax/ndf
Duplicate file finder written in Nim
mkearney/funique
⌚️ A faster unique() function
vladsmirnov/url-rewrites
Magento 1.x module to target the URL Rewrite issue
cemahseri/Duplica
A very fast duplicate file finder.