Enhancing TMF Efficiency with the New Duplicates Search Feature

The Duplicates Search Feature helps users identify and manage duplicate files within the TMF. It prevents redundant uploads and minimizes manual effort in handling duplicate documents.

When a user uploads files to the TMF or moves files from the Inbox to any other project folder, the system automatically searches for duplicates using a checksum verification method at the project level. If an exact duplicate (100% match) is detected, the system interrupts the upload and notifies the user, who can either proceed with the upload or cancel it (with a “skip” option for batch uploads).

This functionality applies across TMF sections, including:

• TMF Data

• TMF Manager

• My Favorites

• My Views

Enhanced Duplicates Detection for Email Attachments

The feature now extends to files received by email. When a user moves files from the Inbox to any other folder within TMF Data, the system checks for duplicates. If identical files exist, the system interrupts the operation and alerts the user, ensuring a clean, organized, and regulation-compliant TMF.

• Background Near-Duplicates Search: Identifies files with similar content, even if they are not exact matches.

• Configurable Similarity Threshold: Admin users can define the minimum similarity percentage (default: 90%, minimum: 70%) or disable the feature.

• New Duplicate Files Interface: Users can check, compare, and manage potential duplicates in a dedicated interface.

• Duplicate Files Log: Tracks all actions related to duplicate file management for audit purposes.

General Workflow

After a file is uploaded, the system conducts a background search for duplicates within the project’s eTMF. If a similar file is found, it appears in the new Duplicate Files section in the TMF Project Menu. Admin users can adjust the similarity threshold or enable OCR auto mode for improved detection.

Exporting Duplicate Data

Users can export the duplicate files list, including:

• File name

• Source file name

• Duplicate file names

• Location path

• Upload date

• Match percentage

Duplicate Files Log

Located in: TMF → (Open Project) → Admin Area → Logs → Duplicate Files Log

The log tracks:

• Uploading a duplicate after a 100% match warning

• Deleting a duplicate via the interface

• Retaining a duplicate via the interface

Sorting, filtering, and export options improve tracking and audit readiness.

With these updates, Flex Databases’ TMF system offers a more efficient, automated approach to duplicate file management. These enhancements reduce workload, improve data integrity, and streamline compliance efforts. Visit the Duplicate Files section in your TMF settings for more details.