Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Truncation of records happening in DFSORT

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
prasanth_bs

New User


Joined: 08 Aug 2005
Posts: 9

PostPosted: Wed Jan 10, 2007 2:39 pm    Post subject: Truncation of records happening in DFSORT
Reply with quote

Hi,

I am having more than 3999996 records in a file .I am doing a sort using DFsort my sort card corresponds to
SORT FIELDS=(225,1,PD,A,
164,1,PD,A,
165,1,PD,A,
166,5,PD,A)

My file is of 200 in lrecl .After the sort i writing the records to a datset .while doing doing this lot of records are getting truncated(ie, lot of records which are there in input dataset are not present in output dataset after the sort).Is there any limiitation in DF sort for the number of records.

Could you please share your thoughts on this???

Thanks a lot
Back to top
View user's profile Send private message

guptae

Moderator


Joined: 14 Oct 2005
Posts: 1187
Location: Bangalore,India

PostPosted: Wed Jan 10, 2007 2:42 pm    Post subject:
Reply with quote

HI prasanth_bs,

Do u have any omit or include cond in your sort card?
Back to top
View user's profile Send private message
William Thompson

Global Moderator


Joined: 18 Nov 2006
Posts: 3158
Location: Tucson AZ

PostPosted: Wed Jan 10, 2007 2:51 pm    Post subject: Re: Truncation of records happening in DFSORT
Reply with quote

Hi,

prasanth_bs wrote:
lot of records are getting truncated(ie, lot of records which are there in input dataset are not present in output dataset after the sort).
Please post your complete sort control info and the sysout from the sort run.
Quote:
Is there any limiitation in DF sort for the number of records.
I think I can safely say no.

Awaiting your reply,

Bill
Back to top
View user's profile Send private message
prasanth_bs

New User


Joined: 08 Aug 2005
Posts: 9

PostPosted: Wed Jan 10, 2007 5:36 pm    Post subject: Re: Truncation of records happening in DFSORT
Reply with quote

Actually we have a file which is having more than 3999996 records in a file in the first step we will do a sort SORT FIELDS=(225,1,PD,A,
164,1,PD,A,
165,1,PD,A,
166,5,PD,A
This will do the sort and writes the records to a dataset.

In the next step we uses the ice tool and our key fields and the sort card corresponding to icetool is
SELECT FROM(INFILE) TO(OUTFILE) ON(154,1,PD) ON(155,1,PD) -
ON(156,5,PD) ON(161,5,PD) ON(14,4,PD) FIRST
In this step we will be selecting the first records based on the sort condition in the sort card.The issue is with this step.

If i am taking 3000 records from the file and doing the sort i will be getting around 2000 records.But if I am taking the file as a whole and use the same the 2000 records got trimmed to 12 or 13 .But these 2000 should be there since the key corresponding to them are unique and they won't get filtered out due to that condition first in the sort .

please share your thoughts
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Wed Jan 10, 2007 9:45 pm    Post subject:
Reply with quote

Quote:
But these 2000 should be there since the key corresponding to them are unique and they won't get filtered out due to that condition first in the sort .


Something doesn't add up here. If the keys are unique, then DFSORT's ICETOOL would keep all of the records. If you're not getting all of the records, then either the keys are not unique or there's something else you're not showing us.

SPLICE will sort the records on the ON fields, so your initial sort with other keys doesn't really accomplish or change anything.

In order to figure out what's going on, I'd need to start by seeing your complete JCL and control statements, and the DFSORT and ICETOOL messages you received. Feel free to e-mail me offline (yaeger@us.ibm.com) with that information. Please put "DFSORT" somewhere in your Subject line.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Check if any Detail records and extra... V S Amarendra Reddy SYNCSORT 19 Mon May 08, 2017 8:54 pm
No new posts DFSORT - Overriding default option TU... Steve Ironmonger DFSORT/ICETOOL 3 Tue Apr 04, 2017 3:54 pm
No new posts Join giving more records than expected Danielle.Filteau SYNCSORT 2 Thu Mar 09, 2017 3:28 am
No new posts TSO or command line utility to genera... kishpra JCL & VSAM 3 Thu Mar 09, 2017 1:11 am
No new posts Extract set of records matching on ac... bhaskar_kanteti DFSORT/ICETOOL 3 Mon Mar 06, 2017 7:19 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us