DeDuplicate

DeDuplicate is a flow element for Enfocus Switch that automatically detects and suppresses duplicate jobs before they waste processing time or cause downstream issues. Whenever a job arrives, it is checked against a persistent record of recently seen jobs. If it matches, it is routed to the error output — otherwise it passes straight through to the success output and is registered for future comparison.

Three detection modes

• Job name — flags any job whose filename was already seen within the retention window, regardless of content.
• Hash — computes a SHA-256 fingerprint of the job's file or folder contents and flags bit-for-bit identical submissions, even if they arrive under a different name.
• Both — requires both name and content to match before a job is considered a duplicate, giving you the strictest possible check.

Flexible retention window Set how long a job stays on record using the Timeout and Units properties (seconds, minutes, hours, or days). Once the window expires, the job is no longer considered a duplicate and can pass through again. Set the timeout to 0 to keep records indefinitely.

Multi-flow safe scoping By default, each element instance maintains its own isolated deduplication space, so two DeDuplicate elements in different flows never interfere with each other. Switch to Custom scope mode to share a deduplication pool across multiple elements — useful for consolidating jobs from parallel branches.

Persistent and lightweight Deduplication records are stored in a local SQLite database, surviving Switch restarts without any external infrastructure. Expired records are cleaned up automatically on a background timer.