Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

DFSort performace improvement in Sorting a VSAM file

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
magesh23586

Active User


Joined: 06 Jul 2009
Posts: 159
Location: Chennai

PostPosted: Wed Jun 11, 2014 12:24 pm    Post subject: DFSort performace improvement in Sorting a VSAM file
Reply with quote

Hi,

I have a dfsort step taking 1hr 30 minutes. Need help on optimizing the same.

Code:


//SORTIN DD DSN=VSAMFILE,DISP=SHR,AMP='BUFNI=24,BUFND=08'
//SORTOUT DD DSN=FLATFILE,DISP=SHR
//SYSIN DD *
   SORT FIELDS=(1,26,CH,A)             
   INCLUDE COND=(1,1,CH,EQ,C'R')   
/*
//SORTWK01 DD UNIT=SYSDA,SPACE=(CYL,(100,25))
//SORTWK02 DD UNIT=SYSDA,SPACE=(CYL,(100,25))
//SORTWK03 DD UNIT=SYSDA,SPACE=(CYL,(100,25))
//SORTWK04 DD UNIT=SYSDA,SPACE=(CYL,(100,25))
//SORTWK05 DD UNIT=SYSDA,SPACE=(CYL,(100,25))
//SORTWK06 DD UNIT=SYSDA,SPACE=(CYL,(100,25))


Code:

******************************** Top of Data **************************************** Top of Data *********************
SARPAGE 5              DS=SYSOUT  .STEP01  .PSTEP01 /0000103                                                           
ICE143I 0 BLOCKSET     SORT  TECHNIQUE SELECTED                                                                       
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE                                 
ICE000I 1 - CONTROL STATEMENTS FOR XXXX-A01, Z/OS DFSORT V1R10 - 21:00 ON TUE JUN 10, 2014 -                           
           SORT FIELDS=(1,26,CH,A)                                             10000
           INCLUDE COND=(1,1,CH,EQ,C'R')                                       20000
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1                                                                 
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 EE-K51707 E4-K51707 C9-BASE   E5-K62201 E7-K62201                   
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED                                       
ICE088I 1 ZZZZZH1 .STEP01  .PSTEP01 , INPUT LRECL = 612, BLKSIZE = 22528, TYPE=   F
ICE093I 0 MAIN STORAGE = (MAX,67108864,67108864)                                                                       
ICE156I 0 MAIN STORAGE ABOVE 16MB = (67051504,67051504)                                                               
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256           
ICE128I 0 OPTIONS: SIZE=67108864,MAXLIM=2097152,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT                 
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO   ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=N             ,ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=8192,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW Y,DSA=64
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE    ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N         
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX                         
ICE235I 0 OPTIONS: NULLOUT=RC0                                           
ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT                           
ICE084I 1 VSAM ACCESS METHOD USED FOR SORTIN                             
ICE750I 0 DC 60857245116 TC 0 CS DSVVV KSZ 30 VSZ 30                     
ICE752I 0 FSZ=99439943 RC  IGN=0 E  AVG=616 0  WSP=79559723 C  DYN=0 0   
ICE751I 1 DE-K61785 D5-K62201 D3-BASE   ED-BASE   E8-K61438             
ICE090I 0 OUTPUT LRECL = 612, BLKSIZE = 27540, TYPE = FB                 
ICE055I 0 INSERT 0, DELETE 97575885                                     
ICE054I 0 RECORDS - IN: 99439943, OUT: 1864058                           
ICE134I 0 NUMBER OF BYTES SORTED: 1140803496                             
ICE253I 0 RECORDS SORTED - PROCESSED: 1864058, EXPECTED: 99439943       
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 9000 , TRACKS USED: 0   
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES                         
ICE180I 0 HIPERSPACE STORAGE USED = 1132440K BYTES                       
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES                             
ICE052I 0 END OF DFSORT 


Questions :
I could see AMP parameter, having more index buffer, may I use
AMP=('ACCBIAS=SO') for DFSORT ?
If I use option DYNALLOC=(,16),FILSZ=E120000000, will there be a improvement
Is there any possibilities to filter the input records before sorting, Because total number of output records we are getting is very less, I feel dfsort is unnecessarily sorting 99439943 rather than 1864058.

Please advice.

Thanks
Magesh
Back to top
View user's profile Send private message

enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10231
Location: italy

PostPosted: Wed Jun 11, 2014 12:35 pm    Post subject: Reply to: DFSort performace improvement in Sorting a VSAM fi
Reply with quote

Quote:
I feel dfsort is unnecessarily sorting 99439943 rather than 1864058.


if instead of looking at Your feeling You had cared to look at the sysout You posted
You could have found that You feeling are just wrong ..

Code:
ICE134I 0 NUMBER OF BYTES SORTED: 1140803496     

which divided by 612 ( the record length ) gives 1864058 ( number of records sorted )

as confirmed also by
Code:
ICE253I 0 RECORDS SORTED - PROCESSED: 1864058, ...


sort as per design processes the include directive before passing records to the <sort> process

PS. ...
when people reply to question they ask themselves
in about 99,99 % of the cases the reply is wrong !
meditate people meditate icon_cool.gif
Back to top
View user's profile Send private message
magesh23586

Active User


Joined: 06 Jul 2009
Posts: 159
Location: Chennai

PostPosted: Wed Jun 11, 2014 12:49 pm    Post subject: Reply to: DFSort performace improvement in Sorting a VSAM fi
Reply with quote

Thanks, enrico-sorichetti, I missed it.

Can some one please advice on other two questions.

Also please advice if we can use any other parameter that can optimize sorting.

Thanks
Magesh
Back to top
View user's profile Send private message
Bill Woodger

DFSORT Moderator


Joined: 09 Mar 2011
Posts: 7306

PostPosted: Wed Jun 11, 2014 2:41 pm    Post subject: Reply to: DFSort performace improvement in Sorting a VSAM fi
Reply with quote

I don't think DFSORT is going to use the AMP parameters at all. DFSORT using its own buffering for VSAM files, and you can't override it.

To get some advice on whether anything can be done, search this forum for the information to e-mail to the DFSORT team.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Changing of LRECL of a file abdulrafi DFSORT/ICETOOL 2 Fri Mar 24, 2017 3:25 pm
No new posts splitting a file abdulrafi DFSORT/ICETOOL 3 Fri Mar 24, 2017 11:51 am
No new posts Receive a file using PCOMM macro Harald.v.K IBM Tools 0 Thu Mar 23, 2017 6:50 pm
No new posts Export flat file data into excel sheet murali.andaluri DFSORT/ICETOOL 2 Mon Mar 20, 2017 5:39 pm
No new posts Formatting VB File Learncoholic DFSORT/ICETOOL 3 Mon Mar 20, 2017 12:29 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us