View previous topic :: View next topic
|
Author |
Message |
kris_chennai
New User
Joined: 19 Dec 2005 Posts: 7 Location: Chennai
|
|
|
|
Hi,
My name is Kris 'Hi' to all users and Thanks to Forum Administrator.
We are using SYNCSORT in our work shop. We have a request to process more than 50 million records. The requirement is:
For all Duplicate records from an input file, apply corrections.
I have 2 solutions in my mind one is using
1). SORT based on key and COBOL to determine non-duplicates
The only issue we are facing is Job execution time
2). Using SORT only
I remember the SUM FIELDS=NONE,XSUM option will produce records
eliminated by NONE option but I can't get first record from Duplicate set..
Ex:
Input Key
AAAAA XXXXX
AAAAA XXXXX
BBBBB BBBBB
CCCCC CCCCC
CCCCC CCCCC
SORTXSUM DD OUTPUT
AAAAA XXXXX
CCCCC CCCCC
Still my preference is using SORT alone. Could you suggest me the right solution? |
|
Back to top |
|
|
pushpagiri
New User
Joined: 07 Jul 2005 Posts: 51
|
|
|
|
Hi Kris,
Quote: |
I remember the SUM FIELDS=NONE,XSUM option will produce records
eliminated by NONE option but I can't get first record from Duplicate set.. |
Does this mean the following:
Code: |
INPUT:
AAAABBBB
AAAABBBB
AAAABBBB
SSSSDDDD
CCCCCCC
CCCCCCC
REQUIRED OUTPUT:
AAAABBBB
AAAABBBB
AAAABBBB
CCCCCCC
CCCCCCC |
that is,you need duplicates along with the parent record ? |
|
Back to top |
|
|
pushpagiri
New User
Joined: 07 Jul 2005 Posts: 51
|
|
|
|
Hi Kris,
Try this code and let the forum know if there is any issue.(correct me if am wrong)
Code: |
//DFSORT EXEC PGM=ICETOOL
//TOOLMSG DD SYSOUT=*
//DFSMSG DD SYSOUT=*
//IN1 DD DSN=infile,DISP=SHR
//OUT1 DD DSN=outfile,DISP=SHR
//TOOLIN DD *
SELECT FROM(IN1) TO(OUT1) ON(1,10,CH) ALLDUPS
/* |
|
|
Back to top |
|
|
kris_chennai
New User
Joined: 19 Dec 2005 Posts: 7 Location: Chennai
|
|
|
|
can u pls suggest using SYNCTOOL? We don't have ICETOOL in our work shop. |
|
Back to top |
|
|
|