Remove Duplicates and update the count in trailer record.

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Hi

Could anyone help on how to achieve the below requirement,

My requirement is to eliminate duplicate recs and update the trailer record count.

Input Data :
HDR~record
ABC~1234
ABC~1224
ABC~1233
ABC~1234
ABC~1233
TRL~00005 -count

I want output as below :
HDR~record
ABC~1234
ABC~1224
ABC~1233
TRL~00003 -count

I want to do this using syncsort as we dont have DFSORT in our shop.

Thanks in Advance,
Raj

enrico-sorichetti · Posted: Tue Apr 09, 2013 12:19 pm

search the forum, the question has been asked and the solution has been given quite a few times.

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Hi Enricco,

My bad luck When searched i could find the sample's on DFSORT and not on the SYNCSORT.

Can you provide some links for the same.

Bill Woodger · Posted: Tue Apr 09, 2013 3:04 pm

And did you try any of the DFSORT examples?

enrico-sorichetti · Posted: Tue Apr 09, 2013 3:07 pm

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Hi Bill,

I want to do this using syncsort as DFSORT will not work in our shop.

Enrico,

My apologies for the misspell.

Bill Woodger · Posted: Tue Apr 09, 2013 3:45 pm

I understand that, really I do.

However, there are enormous similarities between the products. If you find a DFSORT solution which doesn't use IFTRAIL, why don't you try it?

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Yes Bill, as per the DFSORT smaple's i have seen for Trailer count updation. I understand that IFTRAIL is the only way we have for updating the trailer count.

Correct me if i am wrong.

bodatrinadh · Posted: Tue Apr 09, 2013 4:41 pm

Hi Raj,

You want the output in same non-sorted order which you have provided or can it be in sorted order ?

Thanks
-3nadh

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Hi Trinadh,

I want the records to be sorted and then eliminate the duplicates.

I tried with below sort card,

SORT FIELDS=(01,1500,CH,A)
SUM FIELDS=NONE
OUTFIL REMOVECC,
TRAILER1=(1:'TRL~',COUNT,15:'~~')

but i am getting output like below,
TRL~ 251 ~~

I want O/P like below,
TRL~0000000251~~

Any suggestions please,

Bill Woodger · Posted: Tue Apr 09, 2013 5:02 pm

Use EDIT.

bodatrinadh · Posted: Tue Apr 09, 2013 5:22 pm

Raj,

In your SORT card, COUNT is including Header and Trailer records...I think without those records it should be 249.

And also your sort card will produce duplicate trailer record.

Thanks
-3nadh

Bill Woodger · Posted: Tue Apr 09, 2013 5:24 pm

Also your header will no longer be the first record.

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Yes Raj,

As you said it is counting HDR and TRL record too.
Could anyone please suggest some other solution for this.

Bill Woodger · Posted: Tue Apr 09, 2013 6:36 pm

Aren't you Raj?

If you OMIT the existing trailer, then you can create a new one in OUTFIL. You should be able to adjust, and edit, the COUNT.

You need to deal with the header. Assuming no design on the file, so it can't be sorted "naturally", you want to add one byte to each record, temporarily. If the header, set it to, say, "3", else set it to, say, "7". Sort on that field first, then the rest of the record. Then drop the extra byte after the SORT, can be in OUTFIL since you have one already.

Are you removing entirely duplicated records? Ensure OPTION NOEQUALS for a little more swiftness.

Anuj Dhawan · Posted: Tue Apr 09, 2013 7:54 pm

rajkumarmf1985 · New User Joined: 09 Aug 2010 Posts: 18 Location: bangalore

Hi All,

Thanks for your time and valuable suggestions.

Below sort card is working fine for my requirement.

Bill Woodger · Posted: Wed Apr 10, 2013 11:17 am

Thanks for letting us know.

For future reference, please learn how to use the Code tags and use them for anything where spacing needs to be preserved.