Need Help Regarding removing duplicate

itjagadesh · New User Joined: 05 Dec 2006 Posts: 12 Location: chennai

Hi All Consider a scenario below,
Input
1001 B 2008100
1001 O 2007100
1002 O 2008100
1002 B 2008101
1003 B 2008102
1003 B 2008103
1003 B 2008104

Output
1001 B 2008100
1002 B 2008101

Problem: Input contains employee,indicator and timestamp.
When an employee contains both 'B' and 'O' records we need to write only B records into output. If an employee doesn't contains 'O' records then no need write into output (1003 employee doesn't contains O record).

Frank Yaeger · Posted: Tue May 06, 2008 9:12 pm Post subject:

What would you want for output for these input records?

itjagadesh · New User Joined: 05 Dec 2006 Posts: 12 Location: chennai

Hi Frank,

I need the output in following format(only one record inthe output)

1005 B 2008104

ie) 1004 employee doesn't contains B type record. so no need to write into output.
ie)1005 conatins both 'B' and 'O' type record so we need to write into output (with latest time stamp).

Req : Need to write only 'B' type record into output only when employee contains both 'B' and 'O' type record.otherwise no need to write into output

Frank Yaeger · Posted: Wed May 07, 2008 10:44 pm Post subject:

Here's a DFSORT/ICETOOL job that will do what you asked for. I assumed your input file has RECFM=FB and LRECL=80, but the job can be changed appropriately for other attributes.