Eliminate duplicates based on multiple columns

Chinnadu · New User Joined: 05 Mar 2009 Posts: 46 Location: Hyderabad

I've only one input file in which I have to eliminate duplicates based on some columns which are scattered across file.

I've to eliminate duplicates based on first 2 bytes and based on 4-5 bytes

My input is like this

AA1ZZ
AA2YY
AA3ZZ

Expeted output is as below:

AA1ZZ
AA2YY

Can somebody suggest me solution using ICETOOL.

expat · Posted: Thu Feb 28, 2013 1:08 pm

SUM FIELDS=NONE

Bill Woodger · Posted: Thu Feb 28, 2013 1:16 pm

Have a look at ICETOOL's SELECT operator.

If the data is already sorted, account for that in a ctlnCNTL file.

It can equally be done with PGM=SORT. As expat says, SORT on your fields and SUM FIELDS=NONE if the data needs sorting. If the data is already sorted, you can use MERGE with just SORTIN01 and SUM FIELDS=NONE.

For can also look at the reporting features of OUTFIL.