Portal | Manuals | References | Downloads | Info | Programs | JCLs | Mainframe wiki | Quick Ref
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Profile Log in to check your private messages Log in
 
Setting DYNALLOC optimally?

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
Div Grad

New User


Joined: 08 Apr 2005
Posts: 45

PostPosted: Wed Aug 24, 2005 7:06 pm    Post subject: Setting DYNALLOC optimally?
Reply with quote

I'm sorting a file with approx 3,000,000 records. The LRECL is 1400 and the file is FB. Here's my sort card:

OPTION FILSZ=E3000000,AVGRLEN=1400,DYNALLOC=(3390,2)
SORT FIELDS=(2,16,CH,A,949,6,PD,A,1,1,CH,D,18,12,CH,A)
END

How do I optimally set the number of temp work spaces in the DYNALLOC parm? I don't want to use too many because I'm going to have 15 of these jobs running in parallel. These 15 sorted files will then be merged together into one file in a common successor job. This is to replace the prior process where the 15 individual files were all sorted together in a single step that on a good day took 150 minutes. The new merge takes about 35 minutes and the 15 sorts in parallel about 6 minutes each, so this'll shave about two hours off the process (saving clock time is the concern here).

I imagine the answer to my question is in the sysout of the dfsort but I don't know how to read it. I've appended it below. Any help is appreciated.

Code:

ICE143I 0 BLOCKSET     SORT  TECHNIQUE SELECTED                                 
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AN
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R5 - 09:13 ON WED AUG
            OPTION FILSZ=E3000000,AVGRLEN=1400,DYNALLOC=(3390,2)               
            SORT FIELDS=(2,16,CH,A,949,6,PD,A,1,1,CH,D,18,12,CH,A)             
            END                                                                 
ICE201I 0 RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE751I 0 C5-Q95214 C6-Q95214 C7-Q96146 C8-Q95214 E4-Q95214 C9-BASE   E5-Q95214
ICE193I 0 ICEAM1 ENVIRONMENT IN EFFECT - ICEAM1 INSTALLATION MODULE SELECTED   
ICE088I 1 RJMSORTE.SORT01  .        , INPUT LRECL = 1400, BLKSIZE = 32200, TYPE
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)                                 
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6213088,6213088)                           
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERE
ICE129I 0 OPTIONS: VIO=Y,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=Y,TEXIT=N,LISTX=N,EFS=NONE    ,EXITC
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=N,VLLONG=N,VSAMI
ICE235I 0 OPTIONS: NULLOUT=RC0                                                 
ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT                                   
ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN                                   
ICE750I 0 DC 0 TC 2516582400 CS DSVVV KSZ 40 VSZ 40                             
ICE752I 0 FSZ=3000000 RE  IGN=1797558 C  AVG=1408 1400  WSP=5486250 E  DYN=56805
ICE751I 1 DE-Q82816 D5-Q84357 D3-Q95174 ED-Q91626 E8-Q95214                     
ICE090I 0 OUTPUT LRECL = 1400, BLKSIZE = 64400, TYPE = FB                       
ICE055I 0 INSERT 0, DELETE 0                                                   
ICE054I 0 RECORDS - IN: 2300000, OUT: 2300000                                   
ICE134I 0 NUMBER OF BYTES SORTED: 3220000000                                   
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 9480 , TRACKS USED: 0           
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES                                 
ICE180I 0 HIPERSPACE STORAGE USED = 3709216K BYTES                             
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES                                   
ICE052I 0 END OF DFSORT                                                         


Code:

                                     
D MORE                               
 24, 2005 -                         
                                     
                                     
                                     
                                     
E6-BASE   C4-Q95174 E7-Q95214       
                                     
= FB                                 
                                     
                                     
RESET=Y,VSAMEMT=Y,DYNSPC=256         
T=RC16 ,MSGDDN=SYSOUT               
N,DYNALOC=(3390    ,002),ABCODE=MSG 
N,STIMER=Y,COBEXIT=COB2             
Y,DSA=0                             
K=S,PARMDDN=DFSPARM ,FSZEST=N       
O=N,MOSIZE=MAX                       
                                     
                                     
                                     
                                     
 8160                               
                                     
D MORE                               
 24, 2005 -                         
                                     
                                     
                                     
                                     
E6-BASE   C4-Q95174 E7-Q95214       
                                     
= FB                                 
                                     
                                     
RESET=Y,VSAMEMT=Y,DYNSPC=256         
T=RC16 ,MSGDDN=SYSOUT               
N,DYNALOC=(3390    ,002),ABCODE=MSG 
N,STIMER=Y,COBEXIT=COB2             
Y,DSA=0                             
K=S,PARMDDN=DFSPARM ,FSZEST=N       
O=N,MOSIZE=MAX                       
                                     
                                     
                                     
                                     
 8160                               
Back to top
View user's profile Send private message

Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Wed Aug 24, 2005 8:48 pm    Post subject:
Reply with quote

Quote:
How do I optimally set the number of temp work spaces in the DYNALLOC parm? I don't want to use too many because I'm going to have 15 of these jobs running in parallel.


In the job you show, DFSORT actually used Hipersorting and didn't need any work space. But that won't always be the case, especially with jobs running in parallel. DFSORT will spread the work space it needs (based on the filesize and average record length) over the number of work data sets you specify, so whether you specify 2, 5 or 10, DFSORT will allocate the same total space on the work data sets. You would only need a larger number of work data sets if the volumes available did not have much space on them preventing secondary space from being obtained on those volumes. Personally, I'd start with DFSORT's shipped default of DYNALLOC=(,4) and only increase that if necessary.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Setting Font Type for XMIT satish.ms10 All Other Mainframe Topics 3 Fri Sep 15, 2017 10:01 pm
No new posts Finding IMS resource blocker after se... Hooman24 IMS DB/DC 1 Wed Aug 16, 2017 9:17 pm
No new posts setting new limit Key values for inde... srilata83 DB2 1 Fri Feb 10, 2017 9:24 pm
No new posts XFACILIT class setting for Fault Anal... egrove IBM Tools 2 Thu Aug 11, 2016 8:02 pm
No new posts CALL MACRO EXECUTE FORM - Setting the... sudarshan.srivathsav PL/I & Assembler 7 Tue Feb 09, 2016 10:32 pm

Facebook
Back to Top
 
Job Vacancies | Forum Rules | Bookmarks | Subscriptions | FAQ | Polls | Contact Us