I am having more than 3999996 records in a file .I am doing a sort using DFsort my sort card corresponds to
SORT FIELDS=(225,1,PD,A,
164,1,PD,A,
165,1,PD,A,
166,5,PD,A)
My file is of 200 in lrecl .After the sort i writing the records to a datset .while doing doing this lot of records are getting truncated(ie, lot of records which are there in input dataset are not present in output dataset after the sort).Is there any limiitation in DF sort for the number of records.
Actually we have a file which is having more than 3999996 records in a file in the first step we will do a sort SORT FIELDS=(225,1,PD,A,
164,1,PD,A,
165,1,PD,A,
166,5,PD,A
This will do the sort and writes the records to a dataset.
In the next step we uses the ice tool and our key fields and the sort card corresponding to icetool is
SELECT FROM(INFILE) TO(OUTFILE) ON(154,1,PD) ON(155,1,PD) -
ON(156,5,PD) ON(161,5,PD) ON(14,4,PD) FIRST
In this step we will be selecting the first records based on the sort condition in the sort card.The issue is with this step.
If i am taking 3000 records from the file and doing the sort i will be getting around 2000 records.But if I am taking the file as a whole and use the same the 2000 records got trimmed to 12 or 13 .But these 2000 should be there since the key corresponding to them are unique and they won't get filtered out due to that condition first in the sort .
Joined: 15 Feb 2005 Posts: 7129 Location: San Jose, CA
Quote:
But these 2000 should be there since the key corresponding to them are unique and they won't get filtered out due to that condition first in the sort .
Something doesn't add up here. If the keys are unique, then DFSORT's ICETOOL would keep all of the records. If you're not getting all of the records, then either the keys are not unique or there's something else you're not showing us.
SPLICE will sort the records on the ON fields, so your initial sort with other keys doesn't really accomplish or change anything.
In order to figure out what's going on, I'd need to start by seeing your complete JCL and control statements, and the DFSORT and ICETOOL messages you received. Feel free to e-mail me offline (yaeger@us.ibm.com) with that information. Please put "DFSORT" somewhere in your Subject line.
