Removing duplicates on the basis on fields.

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

Hi,
I need to remove the duplicates from the file using few perticular fields.
Please give me the statement for it.

PeterHolland · Posted: Sun Dec 19, 2010 6:02 pm

Well this statement is for free :

What did you try yourself?

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

I did't try anything.
But my PL told me that it can be done using DFSORT.

PeterHolland · Posted: Sun Dec 19, 2010 6:35 pm

The DO something instead asking others for a ready made solution. Im not working for your PL.

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

Its not like that i haven't tried. But watever I have given it throws JCL error.
So thats Y I said I need a statement.
If you have some idea tell me, I will try that.

PeterHolland · Posted: Sun Dec 19, 2010 6:57 pm

Then show us what you did. JCL, input, expected output, JES messages, sort messages, fields you want to operate on etc.

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

Ok I have written the following step

//*********************************************************************
//STEPAAAA EXEC PGM=ICETOOL
//TOOLMSG DD SYSOUT=*
//DFSMSG DD SYSOUT=*
//IN DD *
IN5281013PB 2010-11-22-11.51.13.241123
IN5281013PB 2010-11-22-11.51.13.241109
IN5281023PB 2010-11-22-11.51.13.241176
IN5281047PB 2010-11-22-11.51.13.241189
IN5281047PB 2010-11-22-11.51.13.241437
IN5281047PB 2010-11-22-11.51.13.241490
IN5281053PB 2010-11-22-11.51.13.241504
IN5281059PB 2010-11-22-11.51.13.241557
IN5281053PB 2010-11-22-11.51.13.241610
IN5281053PB 2010-11-22-11.51.13.241624
//OUT DD DSN=I50TS.UNLOAD.IMTSIH.TEMP1,DISP=SHR
//TOOLIN DD *
SELECT FROM(IN) TO(OUT) ON(1,15,CH) LAST
/*

Using this JCL i m getting the last dup record. But now I want the record which has greater timestamp
eg.
IN5281013PB 2010-11-22-11.51.13.241123
IN5281013PB 2010-11-22-11.51.13.241109
Out of two above records i want in the output file

IN5281013PB 2010-11-22-11.51.13.241123

So Please guide me.

enrico-sorichetti · Posted: Sun Dec 19, 2010 7:45 pm

the requirements have changed in two hours !

the only thing where You need guidance is how to express clearly and unambiguously Your requirements

didn' t You know You wanted the highest <thing> to start with ???

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

Ok I m sorry for that.
But can u please provide me the solution.

enrico-sorichetti · Posted: Sun Dec 19, 2010 8:25 pm

today is sunday, the DFSORT gurus work in a different time zone ( california )
do not expect an answer for them before tomorrow ( about 24 hours from now )
searching the forums wit sort max value returned quite a few hits
here is one of them
ibmmainframes.com/viewtopic.php?t=39319&highlight=dfsort+max+value

Frank Yaeger · Posted: Mon Dec 20, 2010 1:08 am

Here's a DFSORT/ICETOOL job that will do what you asked for. I assumed your date field starts in position 16 - adjust as necessary.

dick scherrer · Posted: Mon Dec 20, 2010 2:49 am

Hello,

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

@Frank Yaeger

Thnks for th reply it worked out.
Actualy I was also using same JCL but I havnt given the initial spaces for the "SORT FIELDS" statement.

@dick scherrer
No In our Project we need to use SHR only

dick scherrer · Posted: Tue Dec 21, 2010 10:59 pm

Hello,

ppravin47 · New User Joined: 23 Mar 2010 Posts: 17 Location: Bangalore

@dick scherrer

I didnt got, why jobs will generate incorrect data? and it will abend?

As per I know if we give files in SHR mode. And job is using that file then at that time I can OPEN the file only in VIEW mode(I cant open in EDIT mode)...

giraffe · Posted: Wed Dec 22, 2010 5:31 pm

This is my frequently-used solution:

Frank Yaeger · Posted: Wed Dec 22, 2010 11:20 pm

Your frequently used solution wil NOT work in this case because the OP is trying to SORT with SUM on one field, but SORT without SUM on another field. You can't do that with SORT and SUM, but you can do it with SELECT as shown.

Please test your "solutions" before posting them.

dbzTHEdinosauer · Posted: Mon Mar 07, 2011 11:12 pm

another job can have shr, but OPEN OUTPUT.