Unique Tool
The Unique tool distinguishes whether a data record is unique or a duplicate by grouping on one or more specified fields, then sorting on those fields.
Configure the tool
Unique fields: Select the field or fields to find unique values from. Select All to compare entire records. The data is sorted based on the Unique fields. Therefore if there is a specific sort order desired, use the Sort Tool to assign the specific sort order of the file prior to using the Unique tool. Select Clear to deselect all fields.
Output anchors
The Unique tool has two output anchors:
U anchor: The first record of each group.
D anchor: The remaining records from each group.
Output example
Input data stream
| Field 1 | Field Unique |
|---|---|
|
A |
1 |
|
B |
1 |
|
C |
1 |
|
D |
2 |
|
E |
2 |
|
F |
2 |
|
G |
3 |
|
H |
4 |
|
I |
5 |
U anchor output
| Field 1 | Field Unique |
|---|---|
|
A |
1 |
|
D |
2 |
|
G |
3 |
|
H |
4 |
|
I |
5 |
D anchor output
| Field 1 | Field Unique |
|---|---|
|
B |
1 |
|
C |
1 |
|
E |
2 |
|
F |
2 |