Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

sorting a huge tape file into a sequential file

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
smaru

New User


Joined: 22 Oct 2008
Posts: 49
Location: India

PostPosted: Mon Dec 01, 2008 4:20 am    Post subject: sorting a huge tape file into a sequential file
Reply with quote

Hi,

I am tring to sort a tape file with record count 30 million records. The sysin has Sort fields and Sum fields.

I have been providing workspace through dynamic allocation
OPTION DYNALLOC=(SYSTF,30),FILSZ=E30000000


But my Job failed with message,
SORT CAPACITY EXCEEDED - RECORD COUNT 279890649


I have tried increasing the dynalloc from 30 to 50 still it failed with same message.

Can someone suggest on this.
Back to top
View user's profile Send private message

smaru

New User


Joined: 22 Oct 2008
Posts: 49
Location: India

PostPosted: Mon Dec 01, 2008 4:23 am    Post subject:
Reply with quote

The LRECL of the output file is 60
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Mon Dec 01, 2008 5:03 am    Post subject:
Reply with quote

Hello,

You might want to run a job to count the records on the input. You mention 30 million records, but the sort has seen 279 million+ when the capacity was exceeded.

If you post the complete jcl and control statements it may help us help you.

If all else fails, you can split the file into several smaller files, sort the smaller files and then merge them back into a large sorted file.

Is the input record the same length as the output?
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8118
Location: East Dubuque, Illinois, USA

PostPosted: Mon Dec 01, 2008 5:14 am    Post subject:
Reply with quote

You're estimating 30 million records but you've run 279 million through SORT when it runs out of space ... maybe you should increase your estimate first?
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Mon Dec 01, 2008 6:11 am    Post subject:
Reply with quote

Smaru,

You've said your tape has 30 million records, which is obviously wrong since the ICE046A shows that DFSORT processed about 270 million records before it ran out of work space. How many records does your input file really have?

I can't tell if DFSORT is able to determine the input filesize automatically from your tape management system or not. If it can then it will ignore your FILESZ estimate whereas if it can't it will use your way too small FILSZ estimate.

Try increasing the FILSZ estimate to be more accurate. If that doesn't work, add the following to your job to tell DFSORT to show the diagnostic messages:

//SORTDIAG DD DUMMY

Then rerun the job and send me all of the JES and DFSORT messages offline (yaeger@us.ibm.com) and I'll take a look.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
This topic is locked: you cannot edit posts or make replies. Fetching data from BAI File arunsoods JCL & VSAM 1 Wed Jul 19, 2017 4:28 pm
No new posts Write out NODUPS but just from one file Jay Villaverde DFSORT/ICETOOL 8 Fri Jul 14, 2017 12:44 am
No new posts How to add header with Date(YYMMDD) i... Rajan Moorthy DFSORT/ICETOOL 2 Thu Jul 06, 2017 11:44 pm
No new posts How to generate a new unique Input fi... for1ranjith CLIST & REXX 11 Sat Jul 01, 2017 12:09 pm
No new posts Writing a file using online program grvtomar PL/I & Assembler 3 Fri Jun 30, 2017 1:06 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us