Filter Stage Example
It is one of the processing stages and filters out records of the input data as per the specified Conditions. It supports one input link and n number of output links. All the data which don’t satisfy the condition can be passed to an output link.
In below example we have Employee Department details as an input and we are going to filter out employees with Department as ‘A100’ to one file and ‘DV100’ to another.
Design the job as shown below:
Open Filter stage properties, Under Stageà Properties tab select the Where clause to define the condition Where Clause = department = ‘A100’ and add Output link = 0 for the same. Similarly add another Where clause for department ‘DV100’
We can specify the Link order to let the stage know, where conditional data needs to flow to the corresponding link as shown below.
Under OutputàMapping tab of filter stage, drag and drop columns to be mapped from input to output i.e Dept_A100.
Similarly, Under OutputàMapping tab of filter stage, drag and drop columns to be mapped from input to output i.e. Dept_DV100.