eliminate duplicates using syncsort

dkalyan_c · New User Joined: 06 Apr 2006 Posts: 17

HI,

I have a flat file in the below fashion.

USA 9999999999 7022611210 OPEN
USA 9999999999 7022611210 OPEN
USA 9999999999 7022611210 CLOSE

i want to eliminate duplicates from this file.
my expected output is:

USA 9999999999 7022611210 OPEN
USA 9999999999 7022611210 CLOSE

how do i do this with SYNCSORT ot can i do this with any other sort utility

i tried the below

SORT FIELDS=COPY
SUM FIELDS=NONE

and this wont work.

The question here is i just want to eliminate the duplicate records and retain the order of the rest as it is

superk · Posted: Wed Jan 19, 2011 10:28 pm

In order for any program to eliminate duplicate records, those records must be presented in a sorted order. You MUST sort those records on the key (whatever it is). So you need to tweak your statements:

SORT FIELDS=(position,length,type,A)
SUM FIELDS=NONE