Search Results for "remove duplicates"
Sort By:
Showing 33 open source projects for "remove duplicates"
View related business solutions-
Field Sales+ for MS Dynamics 365 and SalesforceBring Dynamics 365 and Salesforce wherever you go with Resco’s solution. With powerful offline features and reliable data syncing, your team can access CRM data on mobile devices anytime, anywhere. This saves time, cuts errors, and speeds up customer visits.
-
Skillfully - The future of skills based hiringSkillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.
-
1
FDUPES
FDUPES is a program for identifying or deleting duplicate files
...It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates. Once duplicates are identified, the tool offers interactive deletion options where users can choose which copy to keep and which to remove, or apply flags to automate deletion while preserving a single instance. Because it operates directly on file content rather than just filenames, fdupes can accurately detect true copies and guide cleaning operations in data cleanup or migration tasks. ... -
2
RemoveDuplicate
A software that can helps you remove duplicate files
RemoveDuplicate is a Windows application designed to help users find and remove duplicate files within folders. It uses MD5 hashing to identify identical files and provides a user-friendly interface to manage and delete duplicates while keeping one copy of each file. -
3
ParDRe
Parallel tool to remove duplicate DNA reads
...It is faster than multithreaded counterparts (end of 2015) for the same number of cores and, thanks to the message-passing technology, it can be executed on clusters. There also exists a MapReduce counterpart of ParDRe, called MarDRe (see the link above). UPDATE: From version 2.0.5 ParDRe also provides support to remove only optical duplicates (and leave biologically interesting duplicates) as well as to work with compressed input/output with .gz format. -
4
Refundant
Redundant files remover
GUI is little broken - the list of duplicates is not relayeble, but this bug not affected main functionality. -
Rezku Point of SaleRezku is an all-inclusive ordering platform and management solution for all types of restaurant and bar concepts. You can now get a fully custom branded downloadable smartphone ordering app for your restaurant exclusively from Rezku.
-
5
Tartube
Download videos/channels/playlists from YouTube and many other sites
Tartube is a GUI front-end for youtube-dl, yt-dlp and other compatible video downloaders. It is written in Python 3 / Gtk 3 and runs on MS Windows, Linux, BSD and MacOS. -
6
Data Preprocessing Automate
Data Preprocessing Automation: A GUI for easy data cleaning & visualiz
Data Preprocessing Automation is a Python-based GUI application designed to simplify and automate data preprocessing tasks. It allows users to upload Excel files, automatically handle missing values, remove duplicates, and detect and remove outliers using statistical methods. The application provides data visualization tools, including box plots for distribution analysis and scatter plots for exploring relationships between variables. Users can download the processed data for further analysis. Built with Tkinter, Pandas, Matplotlib, and Seaborn, it ensures an intuitive interface and efficient performance. ... -
7
CCleaner
Clean up, speed up, and optimize your PC
CCleaner is a trusted PC optimization tool for Windows or Mac designed to clean, speed up, and secure your computer. It removes junk files, temporary data, and broken settings that slow down system performance over time. The software includes powerful modules like Performance Optimizer, Driver Updater, and Cloud Drive Cleaner, helping you reclaim storage space and improve efficiency. With a simple interface, it provides one-click solutions for beginners while also offering advanced features... -
8
Blazefox
Blazefox: Fast, safe file deduplication and management tool for Linux
Blazefox is a powerful and efficient file deduplication and management tool designed for both everyday users and system administrators. It scans directories recursively, identifies duplicate files using advanced content hashing, and provides safe options to remove, move, or rename duplicates. Blazefox supports flexible filtering with regex/glob patterns, interactive and dry-run modes, and advanced conflict resolution strategies, ensuring no data is lost accidentally. Its undo and redo functionality allows users to safely reverse operations, giving complete control over file management tasks. ... -
9
Image Comparator
Find and remove duplicate or similar images.
Image Comparator is a robust Windows desktop application designed to identify and manage duplicate or visually similar images using advanced Discrete Cosine Transform (DCT) algorithms. Unlike standard comparison tools, it effectively detects images that have been resized, compressed, or slightly modified. -
Collect! is a highly configurable debt collection softwareThe flexible & scalable debt collection software built to automate your workflow. From startup to enterprise, we have the solution for you.
-
10
SafeUtils
110+ developer tools as native MacOS, Linux & Windows desktop apps.
Tools: https://safeutils.com/barcode-generator https://safeutils.com/color-picker https://safeutils.com/qr-code-generator https://safeutils.com/qr-code-scanner https://safeutils.com/word-counter https://safeutils.com/base-64-decoder https://safeutils.com/diff-checker https://safeutils.com/hex-to-ascii https://safeutils.com/json-formatter https://safeutils.com/lorem-ipsum-generator https://safeutils.com/random-generator https://safeutils.com/time-converter https://safeutils.com/... -
11
Remove Duplicate Lines
Remove duplicate lines in text file
A handy tool with graphical interface that remove/delete duplicate lines in a text file. GitHub source: https://github.com/ahmed-fathy/remove-duplicates/ -
12
JAETL - Just Another ETL Tool
Just Another ETL Tool
JAETL - Just Another ETL tool is a tiny and fast ETL tool to develop data warehouse. JAETL allows to Extract data from ARFF (Weka), CSV, and SQL, Transform the data with join, replace missing values, remove duplicates, mapping filtering, variable selection, and Load the data into SQL server and export to CSV and ARFF. -
13
Stock Photo Tagger
Simple tool for tagging photos for stock photo agencies
Based on tool "Image Tagger", adapted for stock photo agencies - handles multiple keywords as a long string with separator, Title and Description which can be automatically recognized by stock photo agencies. Keywords can be sorted and duplicates removed. Metadata can be applied on multiple selected images. All metadata can be copied and pasted from the image from different directory. If there is metadata missing, the image name is shown in red. Whats new in version 1.1.0: Added context... -
14
Angular-filter
Bunch of useful filters for AngularJS with no external dependencies!
Bunch of useful filters for AngularJS (with no external dependencies!). You can install angular-filter using 4 different methods. Include angular-filter.js (or angular-filter.min.js) in your index.html, after including Angular itself. Add 'angular.filter' to your main module's list of dependencies. If a string is provided, it will filter out duplicates using the provided expression. -
15
Picture Mess Organizer
Organize, sort and rename pictures from multiple cameras to one place.
This program is ideal if you need flexible solution for copying, sorting and naming photos from multiple sources. Benefits: - images from different cameras are renamed using same naming template. - movies are in cronological order with images (not at the end of folder as usually) - you have full control over name of files and folders - one click to start copying with saved parameters (saved profiles) -
16
Uniq Copy
Java Desktop application which helps de-duplicate files during copy.
UniqCopy scans a source folder to get a list of all the files and then guesses duplicated files based on file name and file size. Using this information, it copies all files to the target folder, maintaining the relative structure of the files within the target folder. Files considered to have been duplicated in the source folder are copied only once to one of the matching locations in the target folder, and the other locations are skipped. A summary of these "skipped duplicates" is... -
17
duplix
Duplicates Management
With duplix you can search, view and remove duplicate files on your computer (not implemented yet :). I started this project to try out Eclipse 4 Application Platform in conjunction with JavaFX. This project was set up with Eclipse Neon 4.6.0 and e(fx)clipse 2.4.0. At this time there is a first view to select folders with some animations only. So stay tuned to see more in few days... -
18
ClinQC
ClinQC: A tool for quality control of Sanger and NGS data in clinic
...It can analyze raw sequencing data and produces unified output as FASTQ files per sample/patient with Sanger quality encoding. First, ClinQC convert input read files from their native formats to a common FASTQ format and remove adapters, and PCR primers. Next, it split barcoded samples, filter duplicates, contamination and low quality sequences and generates a QC report. -
19
IL Music Library Deduplicator
Easily find and remove duplicates from a music collection
If you want to easily find and remove audio duplicate from a music collection IL Music Library Deduplicator is for you. It can distinguish between similar songs offering you a list with best matches highlighted in green. Audio files with lower similarity are listed as well in case there are duplicates with lower bitrate. These are highlighted in yellow and red. You can select them by color if you wish to delete them or you can add them to a list with excluded files in case you wish to keep duplicates or not to be scanned next time. ... -
20
toastr
Simple javascript toast notifications
toastr is a Javascript library for Gnome / Growl type non-blocking notifications. jQuery is required. The goal is to create a simple core library that can be customized and extended. Toastr will supply default animations, so you do not have to provide any of these settings. However you have the option to override the animations if you like. Optionally override the animation easing to show or hide the toasts. Default is swing. swing and linear are built into jQuery. Use the jQuery show/hide... -
21
duplicate
Remove duplicate files using binary compression
Utility that checks all files for given directory and removed the duplicates by binary compression comparison. -
22
GDuplicateFinder
GDuplicateFinder - A FREE Groovy way to find file duplicates!
Unlike other duplicate finders such as Easy Duplicate File Finder, Auslogics Duplicate File Finder, MindGems Fast Duplicate File Finder, Duplicate Cleaner, DupFiles and others, GDuplicateFinder is a FREE cross-platform application, with the ability to search among not just local files, but files on the network, such as a Windows or a Linux share using VFS library. Taking advantage of Groovy facilities and GPars power to process in parallel, GDuplicateFinder will help you get rid of those... -
23
Toolsverse ETL Framework
Open source Extract Transform Load engine written in Java
ETL Framework is a standalone Extract Transform Load engine written in Java. It includes executables for all major platforms and can be easily integrated into other applications. Key Features: * embeddable, open source and free * fast and scalable * uses target database features to do transformations and loads * manual and automatic data mapping * data streaming * bulk data loads * data quality features using SQL, JavaScript? and regex * data transformations Requirements *... -
24
n way Duplicate File / Directory Finder
please use open source- htp://code.google.com/p/off-dup-finder/
...This project Manages duplicate file / directories in offline/online mode . 'ls-laR' output(offline) from 'ubuntu' linux can be given to this program to generate copy/diff/automated file/dir remove scripts for one way or two way comparison. disk gain, incremental comparison, patterns partial match/timer, copy script generator- are supported. Can be setup in a central server to clean up network duplicates. This is free software and partly open source. Has good speed And Low Memory usage!! License is GPL V3. -
25
Outlook LookForDuplicates
Find and remove duplicate items in Outlook such as contacts and mails.
Find&remove duplicates easily! This VBA-Script with a form searches for duplicate entries of any type (calendar, contact, e-mail, notes, task, etc.) across folders in Outlook. Suspected doublets are listed and can be moved to the folder for Deleted Items.
