IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

Sort taking so much CPU time


IBM Mainframe Forums -> JCL & VSAM
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Sat May 23, 2009 12:20 pm
Reply with quote

iam using the below jcl to search the copybook in the cobol program PDs
//LLLLLLLM JOB (YYYYYYY),'SCAN',CLASS=V,MSGCLASS=W,
// NOTIFY=LLLLLLL
//SEARCH EXEC PGM=ISRSUPC,
// PARM=(SRCHCMP,
// 'ANYC MIXED')
//NEWDD DD DSN=XXXXXXX.A.B,DISP=SHR
// DD DSN=XXXXXXX.D.E.DISP=SHR
// DD DSN=ZZZZZZZ.X.Y,DISP=SHR
//OUTDD DD SYSOUT=(A)
//SYSIN DD *
SRCHFOR 'F210CU',W
/* ----------------------------------------------------------------------------

and this step is returing the results fast and not taking mcuh cpu time

but after this step i have coded a sort step in which it will take output file of above step and retrieve only the cobol program name

in that step iam executing SORT program and in include condition i gave
sort options = COPY
Include COND = (position ,EQ,c'string (s) found match line')
ourec fileds=(1:copybook name position)

this step returning the exact results but it is taking lotzzzz of CPU time please llet me know if i can use any other utility which does the performance tuning.

how abt using ICETOOL

and also i wanted to check that user enetered copybook is valid or not by chking in copybook library any idea regarding the same pls suggest.

Thanks & Regarding,
Sandhya Rani.
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales

PostPosted: Sat May 23, 2009 12:43 pm
Reply with quote

How much CPU time is consumed, how much elapsed time is used.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Sat May 23, 2009 5:50 pm
Reply with quote

is this a syncsort question?

why don't you use INREC?
Back to top
View user's profile Send private message
Marso

REXX Moderator


Joined: 13 Mar 2006
Posts: 1353
Location: Israel

PostPosted: Sun May 24, 2009 5:16 pm
Reply with quote

Why didn't you post also step 2, the only one that we really need to see??

Also, in the SEARCH step, the result is written to SYSOUT=(A).
How can it be input to the SORT??

Consider using the following options in your search (instead of just ANYC MIXED).
They will make the whole process (search and sort) faster: COBOL, DPBLKCL, DPCBCMT, FMSTOP, NOSUMS, LMTO, NOPRTCC
Back to top
View user's profile Send private message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Tue May 26, 2009 6:56 pm
Reply with quote

Please find attached documet where i have given the JCL used by me and the

Code:
//TESTJCL1 JOB (@),                                           JOB29708
//         'OPERATIONS',
//         CLASS=K,
//         MSGCLASS=X,
//         REGION=2048K,
//         TIME=NOLIMIT,
//         NOTIFY=&SYSUID
//STEP00  EXEC UCC11RMS,PARM=F
//*****************************************************************
//INITIAL EXEC PGM=ISRSUPC,
//*****************************************************************
// PARM=(SRCHCMP,
// 'ANYC DPCBCMT')
//NEWDD DD DSN=CHGMAN.AXXX.COPYLIB,DISP=SHR
//OUTDD DD DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//SYSIN DD *
SRCHFOR 'RKI073  ',W
//*****************************************************************
//IN1SORT EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.INIT.TEMPP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')
 OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')
//*****************************************************************
//INTSORT EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.INIT.TEMP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')
 OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')
//*****************************************************************
//SEARCH EXEC PGM=ISRSUPC,
//*****************************************************************
// PARM=(SRCHCMP,
//*'ANYC MIXED')
//*'ANYC EXACT')
// 'ANYC DPCBCMT')
//*ANYC,IDPFX,NOPRTCC)
//NEWDD DD DSN=CHGMAN.CXXX.SOURCE,DISP=SHR
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR
//*OUTDD DD SYSOUT=(A)
//OUTDD DD DSN=SX.SXXX.SRCHSTR.TEMP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//SYSIN DD DSN=SX.SXXX.SRCHSTR.INIT.TEMP,DISP=SHR
//      DD DSN=SX.SXXX.SRCHSTR.INIT.TEMPP,DISP=SHR
//*****************************************************************
//SORT     EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.TEMP,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.ACTUAL,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')
 OUTREC FIELDS=(1:2,9)
/*
/* ---------------------------------------------------------------------


CPU normalization factor: 35.3
Unnormalized CPU time: 124.36 seconds

I have also used ICETOOL and JCL as follows
Code:
//TESTJCL1 JOB (UU255503701),   
//         'OPERATIONS',       
//         CLASS=K,             
//         MSGCLASS=X,         
//         REGION=2048K,       
//         TIME=NOLIMIT,       
//         NOTIFY=&SYSUID       
// STEP010  EXEC PGM=IEFBR14                                         
//                                                                   
//DD1      DD DSN=S52.SANDHYA.SRCHSTR.INIT,                         
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//                                                                   
//DD2      DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                   
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD3      DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMP,                     
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD4      DD DSN=S52.SANDHYA.SRCHSTR.TEMP,                         
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD5      DD DSN=S52.SANDHYA.SRCHSTR.ACTUAL,                       
//            DISP=(MOD,DELETE,DELETE),                             
//           UNIT=SYSDA                                             
//***************************************************************** 
//INITIAL EXEC PGM=ISRSUPC,                                         
//***************************************************************** 
// PARM=(SRCHCMP,                                                   
//*'ANYC MIXED')                                                     
//*'ANYC EXACT')                                                     
// 'ANYC DPCBCMT')                                                   
//*ANYC,IDPFX,NOPRTCC)                                               
//NEWDD DD DSN=CHGMAN.AXXX.COPYLIB,DISP=SHR                         
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR                                       
//*OUTDD DD SYSOUT=(A)                                               
//OUTDD DD DSN=S52.SANDHYA.SRCHSTR.INIT,                             
//             DISP=(NEW,CATLG,DELETE),                             
//             UNIT=SYSDA                                           
//SYSIN DD *                                                         
SRCHFOR 'F209ACE1',W                                                 
//***************************************************************** 
//IN1SORT EXEC PGM=ICETOOL                                           
//***************************************************************** 
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                                 
//INPUT    DD DSN=S52.SANDHYA.SRCHSTR.INIT,DISP=SHR                   
//OUTPUT   DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                     
//            DISP=(NEW,CATLG,DELETE),                                 
//            UNIT=SYSDA                                               
//TOOLIN   DD *                                                       
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL1)                             
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL2)                             
//CTL1CNTL DD *                                                       
  INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')                                 
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')           
/*                                                                     
//CTL2CNTL DD *                                                       
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                       
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')           
/*                                                                     
//*****************************************************************   
//SEARCH EXEC PGM=ISRSUPC,                                             
//*****************************************************************   
// PARM=(SRCHCMP,                                                     
//*'ANYC MIXED')                                                       
//*'ANYC EXACT')                                                       
// 'ANYC DPCBCMT')                                                     
//*ANYC,IDPFX,NOPRTCC)                                                 
//NEWDD DD DSN=CHGMAN.CXXX.SOURCE,DISP=SHR                             
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR                                         
//*OUTDD DD SYSOUT=(A)                                                 
//OUTDD DD DSN=S52.SANDHYA.SRCHSTR.TEMP,                               
//             DISP=(NEW,CATLG,DELETE),                               
//             UNIT=SYSDA                                             
//SYSIN DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,DISP=SHR                 
//*****************************************************************   
//SORT EXEC PGM=ICETOOL                                               
//*****************************************************************   
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                           
//INPUT1   DD DSN=S52.SANDHYA.SRCHSTR.TEMP,DISP=SHR               
//OUTPU1   DD DSN=S52.SANDHYA.SRCHSTR.ACTUAL,                     
//            DISP=(NEW,CATLG,DELETE),                           
//            UNIT=SYSDA                                         
//TOOLIN   DD *                                                   
  COPY FROM(INPUT1) TO(OUTPU1) USING(CTL1)                       
//CTL1CNTL DD *                                                   
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                   
  SORT FIELDS=COPY                                               
  OUTREC FIELDS=(1:2,9)                                           
/*                                                               
/* ---------------------------------------------------------------


and this ICETOOL also consuming more CPU time
CPU normalization factor: 35.3
Unnormalized CPU time: 112.01 seconds


please suggest me if i can do something to get the fast results
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 496
Location: USA

PostPosted: Tue May 26, 2009 9:22 pm
Reply with quote

Hello Sandhya Rani,

If you are running SyncSort for z/OS, please feel free to email me offline with the complete job listing as a text attachment and I would be happy to further assist you. You can contact me at alissa.margulies@syncsort.com.
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Tue May 26, 2009 9:29 pm
Reply with quote

Hello,

Each step shows amount of cpu used - it will help if you post all of these statistics for each step of both runs.

How many records are being processed?

Where did the term "unnormalized cpu time" originate?
Back to top
View user's profile Send private message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Thu Jun 04, 2009 12:10 am
Reply with quote

Hi iam using ICETOOL as mentioned above the searcg=h step is pretty fast and not taking much time but the sort step is taking lotzz of time please let me knoe if anyone can suggest me something.........hi alissa i have mailed you please let me know if u can suggest me something
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 496
Location: USA

PostPosted: Thu Jun 04, 2009 12:19 am
Reply with quote

Sandhya,

I have not yet received any email from you. If you sent it to me directly at alissa.margulies@syncsort.com, please forward a copy to zos_tech@syncsort.com to see if that can get through.
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 496
Location: USA

PostPosted: Thu Jun 04, 2009 1:00 am
Reply with quote

Ok, I've got it now. I'll review it and get back to you.
Back to top
View user's profile Send private message
Arun Raj

Moderator


Joined: 17 Oct 2006
Posts: 2481
Location: @my desk

PostPosted: Thu Jun 04, 2009 6:55 am
Reply with quote

Sandhya Rani,
Code:
//IN1SORT EXEC PGM=ICETOOL                                           
//*****************************************************************
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                                 
//INPUT    DD DSN=S52.SANDHYA.SRCHSTR.INIT,DISP=SHR                   
//OUTPUT   DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                     
//            DISP=(NEW,CATLG,DELETE),                                 
//            UNIT=SYSDA                                               
//TOOLIN   DD *                                                       
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL1)                             
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL2)                             
//CTL1CNTL DD *                                                       
  INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')                                 
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')           
/*                                                                     
//CTL2CNTL DD *                                                       
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                       
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')           
/*     
I am not sure if this could be a reason for the performance difference. But the same output ddname - OUTPUT is used for both the 'COPY' statements used above with a DISP=(NEW,CATLG,DELETE). Wont the 2nd 'COPY' overwrite the results of first 'COPY' thereby missing some search strings passed into the subsequent step?

Before going into performance, are you getting the same results from both the runs?
Back to top
View user's profile Send private message
Terry Heinze

JCL Moderator


Joined: 14 Jul 2008
Posts: 1249
Location: Richfield, MN, USA

PostPosted: Thu Jun 04, 2009 8:56 am
Reply with quote

Define
Quote:
lotzz of time
.
Back to top
View user's profile Send private message
diwa_thilak

Active User


Joined: 13 Jul 2006
Posts: 205
Location: At my desk

PostPosted: Fri Jun 05, 2009 12:06 am
Reply with quote

SandhyaRani,

Quote:
CPU normalization factor: 35.3
Unnormalized CPU time: 112.01 seconds


Could you let me know how you have come up with this stats.

What does Unnormlized CPU time mean in your context?
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> JCL & VSAM

 


Similar Topics
Topic Forum Replies
No new posts How to split large record length file... DFSORT/ICETOOL 7
No new posts JCL sort card - get first day and las... JCL & VSAM 9
No new posts To get the the current time DFSORT/ICETOOL 13
No new posts RC query -Time column CA Products 3
No new posts Sort First/last record of a subset th... DFSORT/ICETOOL 7
Search our Forums:

Back to Top