Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Problem in executing 100 MILLION RECORDS in SORTWK

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
harry

New User


Joined: 27 Mar 2006
Posts: 31

PostPosted: Wed Feb 06, 2008 11:29 am    Post subject: Problem in executing 100 MILLION RECORDS in SORTWK
Reply with quote

Hi,

My input file is having more than 100 million records and I am sorting it on some key could any one please let me know how many SORTWORK DATA SETS I NEED TO GIVE FOR EXECUTING THIS JOB:

I have given 16 sortwork data sets each of SPACE=(TRK,(3000,300))

but still it is failing....

Please let me know:

1> How to calculate the Sortwork data sets?

2> If i am giving 10 Sortwork sets then can i give 1 having equal space as 10 datasets. What is the best option and why?

Thanks!!

Regards
Harry P Thomson
Back to top
View user's profile Send private message

Dave Betten

New User


Joined: 24 Jan 2006
Posts: 26

PostPosted: Wed Feb 06, 2008 9:42 pm    Post subject: Reply to: Problem in executing 100 MILLION RECORDS in SORTWK
Reply with quote

Can you tell me what the record length is so I have an idea of how big the sort is?

Generally, the number of sortworks is going to be based on the size of the input file and the amount of freespace you can get on a single volume. If you use DFSORT's dynamic allocation instead of JCL sortworks, we'll calculate the space allocation based on the number of sortworks specified in DYNALLOC and the size of the file. That way you don't need to specify the space parameters. If you'd like to send me your sysout, I'd be happy to take a look and provide some more detailed recommendations.

Dave Betten
DFSORT Development, Performance Lead
IBM Corporation
betten@us.ibm.com
Back to top
View user's profile Send private message
stodolas

Active Member


Joined: 13 Jun 2007
Posts: 632
Location: Wisconsin

PostPosted: Thu Feb 07, 2008 12:26 am    Post subject:
Reply with quote

I was going to say, I thought the concept of SORTWRK statements was superseded by using the DYNALLOC statement
Back to top
View user's profile Send private message
Phrzby Phil

Active Member


Joined: 31 Oct 2006
Posts: 962
Location: Richmond, Virginia

PostPosted: Thu Feb 07, 2008 1:00 am    Post subject:
Reply with quote

Isn't there a sort option that tells it to just sort the key fields, not dragging the entire records along, and then outputs the entire records only at the end of the sort?
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Thu Feb 07, 2008 2:02 am    Post subject:
Reply with quote

No, there's no such option. For non-trivial amounts of data, you need to write the records to intermediate storage of some kind (e.g. work data sets), so you must drag the entire record along so you can get it back when you need it. The kind of technique you mentioned only works with in-memory (small) sorts. Internally, we automatically use appropriate sorting techniques based on lots of different factors.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Problem reading GTF trace output danik56 ABENDS & Debugging 7 Thu Mar 16, 2017 1:02 pm
No new posts Join giving more records than expected Danielle.Filteau SYNCSORT 2 Thu Mar 09, 2017 3:28 am
No new posts TSO or command line utility to genera... kishpra JCL & VSAM 3 Thu Mar 09, 2017 1:11 am
No new posts Extract set of records matching on ac... bhaskar_kanteti DFSORT/ICETOOL 3 Mon Mar 06, 2017 7:19 am
No new posts Inserting records based on conditions vickey_dw DFSORT/ICETOOL 9 Wed Feb 22, 2017 1:33 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us