In this example, we are taking employee data as input and we are going to capture the duplicate and unique employees on the basis of EmployeeID.

Input Data :

job2 - Scenario Ques 2

Design the job as shown below:

job8 - Scenario Ques 2

Open Sort stage properties, select the key ’employeeID’ and select the Option ‘Create Key Change Column = True’, this will add one new output column ‘keychange’ code representing ‘0’ as duplicate record and ‘1’ as unique record.

job3 - Scenario Ques 2

In Sort stage properties, select Mapping tab to provide input-output mapping as shown below.

job4 - Scenario Ques 2

Open Filter stage properties, provide the where condition and the output link associated with it as shown below.

job5 - Scenario Ques 2

In Filter stage properties, select the Link Ordering tab to provide the output links.

job6 - Scenario Ques 2

In Filter stage properties, select the Mapping tab to provide the output mapping.

job7 - Scenario Ques 2

Save the job, compile and run it to see the results.

job1 - Scenario Ques 2

 Output Data :

1. Duplicate Records

resdup - Scenario Ques 2

2. Unique Records

resUniq - Scenario Ques 2