Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Sort taking so much CPU time

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM
View previous topic :: :: View next topic  
Author Message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Sat May 23, 2009 12:20 pm    Post subject: Sort taking so much CPU time
Reply with quote

iam using the below jcl to search the copybook in the cobol program PDs
//LLLLLLLM JOB (YYYYYYY),'SCAN',CLASS=V,MSGCLASS=W,
// NOTIFY=LLLLLLL
//SEARCH EXEC PGM=ISRSUPC,
// PARM=(SRCHCMP,
// 'ANYC MIXED')
//NEWDD DD DSN=XXXXXXX.A.B,DISP=SHR
// DD DSN=XXXXXXX.D.E.DISP=SHR
// DD DSN=ZZZZZZZ.X.Y,DISP=SHR
//OUTDD DD SYSOUT=(A)
//SYSIN DD *
SRCHFOR 'F210CU',W
/* ----------------------------------------------------------------------------

and this step is returing the results fast and not taking mcuh cpu time

but after this step i have coded a sort step in which it will take output file of above step and retrieve only the cobol program name

in that step iam executing SORT program and in include condition i gave
sort options = COPY
Include COND = (position ,EQ,c'string (s) found match line')
ourec fileds=(1:copybook name position)

this step returning the exact results but it is taking lotzzzz of CPU time please llet me know if i can use any other utility which does the performance tuning.

how abt using ICETOOL

and also i wanted to check that user enetered copybook is valid or not by chking in copybook library any idea regarding the same pls suggest.

Thanks & Regarding,
Sandhya Rani.
Back to top
View user's profile Send private message

expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Sat May 23, 2009 12:43 pm    Post subject:
Reply with quote

How much CPU time is consumed, how much elapsed time is used.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Sat May 23, 2009 5:50 pm    Post subject:
Reply with quote

is this a syncsort question?

why don't you use INREC?
Back to top
View user's profile Send private message
Marso

REXX Moderator


Joined: 13 Mar 2006
Posts: 1219
Location: Israel

PostPosted: Sun May 24, 2009 5:16 pm    Post subject:
Reply with quote

Why didn't you post also step 2, the only one that we really need to see??

Also, in the SEARCH step, the result is written to SYSOUT=(A).
How can it be input to the SORT??

Consider using the following options in your search (instead of just ANYC MIXED).
They will make the whole process (search and sort) faster: COBOL, DPBLKCL, DPCBCMT, FMSTOP, NOSUMS, LMTO, NOPRTCC
Back to top
View user's profile Send private message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Tue May 26, 2009 6:56 pm    Post subject: Some more details
Reply with quote

Please find attached documet where i have given the JCL used by me and the

Code:
//TESTJCL1 JOB (@),                                           JOB29708
//         'OPERATIONS',
//         CLASS=K,
//         MSGCLASS=X,
//         REGION=2048K,
//         TIME=NOLIMIT,
//         NOTIFY=&SYSUID
//STEP00  EXEC UCC11RMS,PARM=F
//*****************************************************************
//INITIAL EXEC PGM=ISRSUPC,
//*****************************************************************
// PARM=(SRCHCMP,
// 'ANYC DPCBCMT')
//NEWDD DD DSN=CHGMAN.AXXX.COPYLIB,DISP=SHR
//OUTDD DD DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//SYSIN DD *
SRCHFOR 'RKI073  ',W
//*****************************************************************
//IN1SORT EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.INIT.TEMPP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')
 OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')
//*****************************************************************
//INTSORT EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.INIT,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.INIT.TEMP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')
 OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')
//*****************************************************************
//SEARCH EXEC PGM=ISRSUPC,
//*****************************************************************
// PARM=(SRCHCMP,
//*'ANYC MIXED')
//*'ANYC EXACT')
// 'ANYC DPCBCMT')
//*ANYC,IDPFX,NOPRTCC)
//NEWDD DD DSN=CHGMAN.CXXX.SOURCE,DISP=SHR
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR
//*OUTDD DD SYSOUT=(A)
//OUTDD DD DSN=SX.SXXX.SRCHSTR.TEMP,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//SYSIN DD DSN=SX.SXXX.SRCHSTR.INIT.TEMP,DISP=SHR
//      DD DSN=SX.SXXX.SRCHSTR.INIT.TEMPP,DISP=SHR
//*****************************************************************
//SORT     EXEC PGM=SORT
//*****************************************************************
//SORTIN   DD  DSN=SX.SXXX.SRCHSTR.TEMP,
//             DISP=SHR
//SORTOUT  DD  DSN=SX.SXXX.SRCHSTR.ACTUAL,
//             DISP=(NEW,CATLG,DELETE),
//             UNIT=SYSDA
//*            SPACE=(CYL,(900,900),RLSE),
//*            DCB=(RECFM=VB,LRECL=36,BLKSIZE=0)
//*
//SYSOUT   DD  SYSOUT=*
//SYSPRINT DD  SYSOUT=*
//SYSIN    DD  *
 SORT FIELDS=COPY
 INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')
 OUTREC FIELDS=(1:2,9)
/*
/* ---------------------------------------------------------------------


CPU normalization factor: 35.3
Unnormalized CPU time: 124.36 seconds

I have also used ICETOOL and JCL as follows
Code:
//TESTJCL1 JOB (UU255503701),   
//         'OPERATIONS',       
//         CLASS=K,             
//         MSGCLASS=X,         
//         REGION=2048K,       
//         TIME=NOLIMIT,       
//         NOTIFY=&SYSUID       
// STEP010  EXEC PGM=IEFBR14                                         
//                                                                   
//DD1      DD DSN=S52.SANDHYA.SRCHSTR.INIT,                         
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//                                                                   
//DD2      DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                   
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD3      DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMP,                     
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD4      DD DSN=S52.SANDHYA.SRCHSTR.TEMP,                         
//            DISP=(MOD,DELETE,DELETE),                             
//            UNIT=SYSDA                                             
//DD5      DD DSN=S52.SANDHYA.SRCHSTR.ACTUAL,                       
//            DISP=(MOD,DELETE,DELETE),                             
//           UNIT=SYSDA                                             
//***************************************************************** 
//INITIAL EXEC PGM=ISRSUPC,                                         
//***************************************************************** 
// PARM=(SRCHCMP,                                                   
//*'ANYC MIXED')                                                     
//*'ANYC EXACT')                                                     
// 'ANYC DPCBCMT')                                                   
//*ANYC,IDPFX,NOPRTCC)                                               
//NEWDD DD DSN=CHGMAN.AXXX.COPYLIB,DISP=SHR                         
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR                                       
//*OUTDD DD SYSOUT=(A)                                               
//OUTDD DD DSN=S52.SANDHYA.SRCHSTR.INIT,                             
//             DISP=(NEW,CATLG,DELETE),                             
//             UNIT=SYSDA                                           
//SYSIN DD *                                                         
SRCHFOR 'F209ACE1',W                                                 
//***************************************************************** 
//IN1SORT EXEC PGM=ICETOOL                                           
//***************************************************************** 
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                                 
//INPUT    DD DSN=S52.SANDHYA.SRCHSTR.INIT,DISP=SHR                   
//OUTPUT   DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                     
//            DISP=(NEW,CATLG,DELETE),                                 
//            UNIT=SYSDA                                               
//TOOLIN   DD *                                                       
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL1)                             
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL2)                             
//CTL1CNTL DD *                                                       
  INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')                                 
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')           
/*                                                                     
//CTL2CNTL DD *                                                       
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                       
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')           
/*                                                                     
//*****************************************************************   
//SEARCH EXEC PGM=ISRSUPC,                                             
//*****************************************************************   
// PARM=(SRCHCMP,                                                     
//*'ANYC MIXED')                                                       
//*'ANYC EXACT')                                                       
// 'ANYC DPCBCMT')                                                     
//*ANYC,IDPFX,NOPRTCC)                                                 
//NEWDD DD DSN=CHGMAN.CXXX.SOURCE,DISP=SHR                             
//*DD DSN=ZZZZZZZ.X.Y,DISP=SHR                                         
//*OUTDD DD SYSOUT=(A)                                                 
//OUTDD DD DSN=S52.SANDHYA.SRCHSTR.TEMP,                               
//             DISP=(NEW,CATLG,DELETE),                               
//             UNIT=SYSDA                                             
//SYSIN DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,DISP=SHR                 
//*****************************************************************   
//SORT EXEC PGM=ICETOOL                                               
//*****************************************************************   
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                           
//INPUT1   DD DSN=S52.SANDHYA.SRCHSTR.TEMP,DISP=SHR               
//OUTPU1   DD DSN=S52.SANDHYA.SRCHSTR.ACTUAL,                     
//            DISP=(NEW,CATLG,DELETE),                           
//            UNIT=SYSDA                                         
//TOOLIN   DD *                                                   
  COPY FROM(INPUT1) TO(OUTPU1) USING(CTL1)                       
//CTL1CNTL DD *                                                   
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                   
  SORT FIELDS=COPY                                               
  OUTREC FIELDS=(1:2,9)                                           
/*                                                               
/* ---------------------------------------------------------------


and this ICETOOL also consuming more CPU time
CPU normalization factor: 35.3
Unnormalized CPU time: 112.01 seconds


please suggest me if i can do something to get the fast results
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 500
Location: USA

PostPosted: Tue May 26, 2009 9:22 pm    Post subject:
Reply with quote

Hello Sandhya Rani,

If you are running SyncSort for z/OS, please feel free to email me offline with the complete job listing as a text attachment and I would be happy to further assist you. You can contact me at alissa.margulies@syncsort.com.
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Tue May 26, 2009 9:29 pm    Post subject:
Reply with quote

Hello,

Each step shows amount of cpu used - it will help if you post all of these statistics for each step of both runs.

How many records are being processed?

Where did the term "unnormalized cpu time" originate?
Back to top
View user's profile Send private message
sandhya rani

New User


Joined: 05 Dec 2006
Posts: 22
Location: hyderabad

PostPosted: Thu Jun 04, 2009 12:10 am    Post subject: need information
Reply with quote

Hi iam using ICETOOL as mentioned above the searcg=h step is pretty fast and not taking much time but the sort step is taking lotzz of time please let me knoe if anyone can suggest me something.........hi alissa i have mailed you please let me know if u can suggest me something
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 500
Location: USA

PostPosted: Thu Jun 04, 2009 12:19 am    Post subject:
Reply with quote

Sandhya,

I have not yet received any email from you. If you sent it to me directly at alissa.margulies@syncsort.com, please forward a copy to zos_tech@syncsort.com to see if that can get through.
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 500
Location: USA

PostPosted: Thu Jun 04, 2009 1:00 am    Post subject:
Reply with quote

Ok, I've got it now. I'll review it and get back to you.
Back to top
View user's profile Send private message
Arun Raj

Moderator


Joined: 17 Oct 2006
Posts: 2158
Location: @my desk

PostPosted: Thu Jun 04, 2009 6:55 am    Post subject:
Reply with quote

Sandhya Rani,
Code:
//IN1SORT EXEC PGM=ICETOOL                                           
//*****************************************************************
//TOOLMSG  DD SYSOUT=*                                                 
//DFSMSG   DD SYSOUT=*                                                 
//INPUT    DD DSN=S52.SANDHYA.SRCHSTR.INIT,DISP=SHR                   
//OUTPUT   DD DSN=S52.SANDHYA.SRCHSTR.INIT.TEMPP,                     
//            DISP=(NEW,CATLG,DELETE),                                 
//            UNIT=SYSDA                                               
//TOOLIN   DD *                                                       
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL1)                             
  COPY FROM(INPUT) TO(OUTPUT) USING(CTL2)                             
//CTL1CNTL DD *                                                       
  INCLUDE COND=(5,7,CH,EQ,C'SRCHFOR')                                 
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:14,8,C'''',19:C',W')           
/*                                                                     
//CTL2CNTL DD *                                                       
  INCLUDE COND=(41,15,CH,EQ,C'STRING(S) FOUND')                       
  SORT FIELDS=COPY                                                     
  OUTREC FIELDS=(1:C'SRCHFOR ',C'''',10:3,8,C'''',19:C',W')           
/*     
I am not sure if this could be a reason for the performance difference. But the same output ddname - OUTPUT is used for both the 'COPY' statements used above with a DISP=(NEW,CATLG,DELETE). Wont the 2nd 'COPY' overwrite the results of first 'COPY' thereby missing some search strings passed into the subsequent step?

Before going into performance, are you getting the same results from both the runs?
Back to top
View user's profile Send private message
Terry Heinze

JCL Moderator


Joined: 14 Jul 2008
Posts: 1238
Location: Richfield, MN, USA

PostPosted: Thu Jun 04, 2009 8:56 am    Post subject:
Reply with quote

Define
Quote:
lotzz of time
.
Back to top
View user's profile Send private message
diwa_thilak

Active User


Joined: 13 Jul 2006
Posts: 205
Location: At my desk

PostPosted: Fri Jun 05, 2009 12:06 am    Post subject:
Reply with quote

SandhyaRani,

Quote:
CPU normalization factor: 35.3
Unnormalized CPU time: 112.01 seconds


Could you let me know how you have come up with this stats.

What does Unnormlized CPU time mean in your context?
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
This topic is locked: you cannot edit posts or make replies. Get a job submitted itself every time... arunsoods JCL & VSAM 3 Tue Nov 22, 2016 4:05 pm
No new posts Limit duplicate records in the SORT pshongal SYNCSORT 6 Mon Nov 21, 2016 12:54 pm
No new posts How to convert the VBM file to VB or... Sulabh Agrawal JCL & VSAM 4 Fri Nov 18, 2016 1:04 pm
No new posts Check System time(Minute) Using TIME1... balaji81_k DFSORT/ICETOOL 5 Fri Nov 11, 2016 10:53 am
No new posts Sort records based on numeric field. Alks SYNCSORT 2 Wed Oct 19, 2016 10:14 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us