Joined: 09 Mar 2011 Posts: 7309 Location: Inside the Matrix
Your file is not actually in "collating" sequence, strictly, as seen by the trailer moving its position.
Check whether select enjoys having a sorted file. If it does, test very carefully with Gerry's solution.
The problem with the way that you have applied my second solution is that you haven't specified the full extend of the record areas for matching.
With that one you have three record areas, all the same length, all as one record. You need to compare the second and third record areas, for the entire length of your record. I suspect you can only do this in 256-byte "chunks", hence my reference to 1,256 257,256 etc, where you have to offset the starting points for the two additional record areas.
So something likse 784,256,etc with each area matching against the third record area with AND joining each togeteher
a=a1,and,b=b1,and,c=c1,and,d=d1
where a,b,c,d are the chunks from the first extension (first PUSH) and a1,b1,c1,d1 are from the second.
find below steps for removing duplicates(irrespective duplicate record position - contigious or not) with out sorting the file. Let me know the status once u tried this.
Used recod length as 80
&input = input file
&output2 = required output file