# CDP Pipeline: Overview of Pre-Defined Filters in Destinations

### Introduction

This feature helps you find and remove duplicate records in your **Destination**. This functionality is available in pipeline.

### Follow These Steps to Remove Duplicate Records from Your Pipeline:

**Step 1:** In the navigation panel, click **Pipeline**.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2Fs2yc3scKx2PZvjFcV6j1%2Fimage.png?alt=media&#x26;token=3b6dba46-fb8e-41f2-b33f-c25b40027d39" alt=""><figcaption></figcaption></figure>

**Step 2:** A list of pipelines appears. Click the pipeline you wish to open.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2Fy7vCd7o01KwpFVCPuL8r%2Fimage.png?alt=media&#x26;token=2509a335-7cf4-479f-81b7-2641aa78ab12" alt=""><figcaption></figcaption></figure>

**Step 3:** Click **Destinations**.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FXFu5MTGTh7wb1jfO6hPE%2Fimage.png?alt=media&#x26;token=425feb15-ba46-4ee1-b093-3518720489cf" alt=""><figcaption></figcaption></figure>

**Step 4:** Click on **Add Destination**.&#x20;

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FZe7OvyZ7x39g0o4fNL2S%2Fimage.png?alt=media&#x26;token=545db096-4f57-49b6-8263-cd4778c28535" alt=""><figcaption></figcaption></figure>

**Step 5:** The Destinations panel opens on the right side. Click **Select Destination.**

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FXc1bmxa2AejRdZE7WZHl%2Fimage.png?alt=media&#x26;token=d8b6ac4c-3e6e-4641-b507-a33ef47a6c35" alt=""><figcaption></figcaption></figure>

**Step 6:** The Select Destination panel opens. Use the search bar to find a destination, select one from the list, or create a new destination by clicking Create Destination.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2F6LK2PnDEnmxok81PgGrT%2Fimage.png?alt=media&#x26;token=b85841a6-c1db-4227-82d2-4c5f51defce5" alt=""><figcaption></figcaption></figure>

**Step 7:** Click on Filter.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2F0d4MWtJCS8ggnZCBdKZ0%2Fimage.png?alt=media&#x26;token=6a08e0a0-eacf-492f-b987-a37ff8b3dbb1" alt=""><figcaption></figcaption></figure>

**Step 8:** Check the **Enable Filter** box.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FMGqBEHkeHhMehlSy03fZ%2Fimage.png?alt=media&#x26;token=9a00009d-f080-48c7-959d-cf214377431d" alt=""><figcaption></figcaption></figure>

**Step 8:** When you check the box, the Function tab will open.&#x20;

Under the Type dropdown, select **Pre Defined Fn**.

**Predefined Functions:** Built-in system functions with standard logic that require no customization.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FU11a8n2JjcCig2Z3gsdx%2Fcdp%20dropdown.png?alt=media&#x26;token=e18b2c8c-af22-4de3-84a6-0bd6af7567b4" alt=""><figcaption></figcaption></figure>

**Step 8.1:** In the **Select Function Typ**e dropdown, select **Event Deduplication**.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FCko0iMQMcz3oGpPxO9vs%2Fcdp%20fun.png?alt=media&#x26;token=09f01bec-f419-42ae-a2af-2d74c4e29f1c" alt=""><figcaption></figcaption></figure>

**Step 8.2:** **Additional Arguments** will open. In the **Event Namespace**, select the value from the corresponding **Value** dropdown, or you can enter a value manually.

In the **Deduplication ID**, select the appropriate value from the corresponding **Value** dropdown, or you can enter a value manually.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2Fk1dX5Sg6EB1UqTmPR51d%2Fcdp%20value.png?alt=media&#x26;token=1b0d5909-cea7-4bdf-93ce-b94408831ed7" alt=""><figcaption></figcaption></figure>

**Step 9:** Click **Custom Fn**

**Custom Functions:** User-defined functions that allow customization based on specific requirements.

**Step 9.1**: Function Arguments: To configure function arguments, follow these steps:

**Step: 9.2: Enter a Name** in the **Name** field to define the function argument.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FOKC9B1V8707gZmox60bM%2Fimage.png?alt=media&#x26;token=54ea7182-a773-4536-b9ed-c21fa104bf83" alt=""><figcaption></figcaption></figure>

**Step: 9.3:** Click on the **Data Source Field** tab. A list of available data source fields appears on the right side. Select the appropriate **Data Source Field** from the list.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FKAUMEhR9ChZx1TH53KO5%2Fimage.png?alt=media&#x26;token=3be33a8a-45ab-40b3-8ebe-83edf3f544c2" alt=""><figcaption></figcaption></figure>

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FalLOO4lPZAjvtHqv0Aq0%2Fimage.png?alt=media&#x26;token=8bb8e736-f6ee-4087-bb54-7a777699bfbe" alt=""><figcaption></figcaption></figure>

**Step 9.4**: Code&#x20;

In this tab, you can write custom code for the function. After writing the code, click the **Test Function** button to execute and validate the function.

<figure><img src="https://2731380315-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaDMDmegqZUJFhJhF4JQG%2Fuploads%2FeTDmCaTGEVPLphFwjfkr%2Fimage.png?alt=media&#x26;token=09bd101f-4655-44d3-9b9d-c5e13809ce3c" alt=""><figcaption></figcaption></figure>

**Step 10:** Click **Save**.
