Portal | Manuals | References | Downloads | Info | Programs | JCLs | Mainframe wiki | Quick Ref
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Profile Log in to check your private messages Log in
 
Problem in executing 100 MILLION RECORDS in SORTWK

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
harry

New User


Joined: 27 Mar 2006
Posts: 31

PostPosted: Wed Feb 06, 2008 11:29 am    Post subject: Problem in executing 100 MILLION RECORDS in SORTWK
Reply with quote

Hi,

My input file is having more than 100 million records and I am sorting it on some key could any one please let me know how many SORTWORK DATA SETS I NEED TO GIVE FOR EXECUTING THIS JOB:

I have given 16 sortwork data sets each of SPACE=(TRK,(3000,300))

but still it is failing....

Please let me know:

1> How to calculate the Sortwork data sets?

2> If i am giving 10 Sortwork sets then can i give 1 having equal space as 10 datasets. What is the best option and why?

Thanks!!

Regards
Harry P Thomson
Back to top
View user's profile Send private message

Dave Betten

New User


Joined: 24 Jan 2006
Posts: 26

PostPosted: Wed Feb 06, 2008 9:42 pm    Post subject: Reply to: Problem in executing 100 MILLION RECORDS in SORTWK
Reply with quote

Can you tell me what the record length is so I have an idea of how big the sort is?

Generally, the number of sortworks is going to be based on the size of the input file and the amount of freespace you can get on a single volume. If you use DFSORT's dynamic allocation instead of JCL sortworks, we'll calculate the space allocation based on the number of sortworks specified in DYNALLOC and the size of the file. That way you don't need to specify the space parameters. If you'd like to send me your sysout, I'd be happy to take a look and provide some more detailed recommendations.

Dave Betten
DFSORT Development, Performance Lead
IBM Corporation
betten@us.ibm.com
Back to top
View user's profile Send private message
stodolas

Active Member


Joined: 13 Jun 2007
Posts: 632
Location: Wisconsin

PostPosted: Thu Feb 07, 2008 12:26 am    Post subject:
Reply with quote

I was going to say, I thought the concept of SORTWRK statements was superseded by using the DYNALLOC statement
Back to top
View user's profile Send private message
Phrzby Phil

Active Member


Joined: 31 Oct 2006
Posts: 973
Location: Richmond, Virginia

PostPosted: Thu Feb 07, 2008 1:00 am    Post subject:
Reply with quote

Isn't there a sort option that tells it to just sort the key fields, not dragging the entire records along, and then outputs the entire records only at the end of the sort?
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Thu Feb 07, 2008 2:02 am    Post subject:
Reply with quote

No, there's no such option. For non-trivial amounts of data, you need to write the records to intermediate storage of some kind (e.g. work data sets), so you must drag the entire record along so you can get it back when you need it. The kind of technique you mentioned only works with in-memory (small) sorts. Internally, we automatically use appropriate sorting techniques based on lots of different factors.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts CICS startup problem John Poulakos CICS 3 Tue Jun 12, 2018 9:08 pm
No new posts MXG - Processing Compressed DB2 SMF r... vasanthz All Other Mainframe Topics 2 Thu May 10, 2018 12:47 am
No new posts Error executing Java program in OSGI ... danik56 CICS 0 Thu Apr 26, 2018 12:16 am
This topic is locked: you cannot edit posts or make replies. Unavailable RECON datasets while exec... abdulrafi JCL & VSAM 10 Fri Apr 06, 2018 12:45 pm
No new posts Extract the records with a PD field's... sudhakar84 DFSORT/ICETOOL 11 Mon Apr 02, 2018 7:26 pm

Facebook
Back to Top
 
Job Vacancies | Forum Rules | Bookmarks | Subscriptions | FAQ | Polls | Contact Us