Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Very high CPU consumption in SUM (Memory objects vs. Hiper)

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
Josechu Lucena

New User


Joined: 27 Apr 2012
Posts: 3
Location: Spain

PostPosted: Mon Apr 30, 2012 3:42 pm    Post subject: Very high CPU consumption in SUM (Memory objects vs. Hiper)
Reply with quote

Hi people,

Running in DFSORT V1R10 I was detect some SORT with SUM option, that increase a lot CPU consumption if is used Memory Objects.

Look a test, a file with a bit more of 6GB of size (with SUM option). First step use memory objects, second step Hiper (in both executions SORT was made 100% in memory, without use of DASD SORTWK* files)

JOBNAME_ STEPNAME PROCSTEP RC EXCP CPU CLOCK SERV
SCJLC0A PASO040M 00 56532 4.69 6.1 14875K
SCJLC0A PASO040H 00 56601 .60 .9 1925K

FIRST STEP COMPLETE OUTPUT (MEMORY OBJECTS):

JOBNAME: SCJLC0A , STEPNAME: PASO040M
BLOCKSET TECHNIQUE IN CONTROL
RECORD TYPE IS F - DATA STARTS IN POSITION 1
RA 0 WR 0 TR 0
C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE E5-K62201
BLOCKSET SORT TECHNIQUE SELECTED
VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AN
- CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R10 - 11:34 ON MON AP
SORT FIELDS=(27,26,BI,A,53,3,BI,A,74,10,BI,A,65,4,BI,A,
56,09,BI,A,69,5,BI,A,84,10,BI,A)
SUM FIELDS=(94,9,PD)
OPTION DYNALLOC=(,6),MOSIZE=MAX,HIPRMAX=0
RECORD TYPE IS F - DATA STARTS IN POSITION 1
RA 0 WR 0 TR 0
C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE E5-K62201
ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED
PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS
SCJLC0A .PASO040M. , INPUT LRECL = 132, BLKSIZE = 32736, TYPE =
MAIN STORAGE = (MAX,30941800,30924486)
MAIN STORAGE ABOVE 16MB = (30863960,30863960)
OPTIONS: OVFLO=RC16,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC4 ,VLSCMP=N,SZERO=Y,
OPTIONS: SIZE=30941800,MAXLIM=2097152,MINLIM=524288,EQUALS=N,LIST=Y,ER
OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=
OPTIONS: RESALL=12288,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT
OPTIONS: TMAXLIM=20971520,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW
OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=Y,TEXIT=N,LISTX=N,EFS=NONE ,EXITC
OPTIONS: HIPRMAX=0 ,DSPSIZE=0 ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMI
OPTIONS: NULLOUT=RC0
BSAM ACCESS METHOD USED FOR SORTOUT
BSAM ACCESS METHOD USED FOR SORTIN
DC 6600000000 TC 0 CS DSVUU KSZ 67 VSZ 67
FSZ=50000000 RC IGN=0 E AVG=132 0 WSP=8572266 C DYN=0 0
MOFSZ=6676,MOSZ=6676,MOSYS=101781(5),MOSTG=101781,MEML=17592186040320(
QP=418 QA=418 HI=6362 LI=5945 MI=6362 TZ=1709312 N1=1709056 N2=1709056
MOFR=0000,MOVR=VV
ESM=29146880,ESO=8744064,ESR=0,ESP=4096,ESS=16384,CES=29146880,HSZ=524
HWSP=4028320,HMAX=0,HES=0,ASV=26055936,EQ=I1,HN=0
OMAX=25015191,NMAX=26055936,ENQT=26055936,CMAX=0,HU=0,BUN=0,MD=N1,DU=0
CT=MAX , SB=4, L=0, D=0000, CCW=1MAM
W 01PP13 02PP13 03PP13 04PP13 05PP13 06PP13
O AZ00 I PP10
BA-K48846 BB-K69370 BC-BASE E8-K61438
CON=1,MUV=0,VOL=10,ENU=0,SBK=0,SRC=0,VEM=0
PWK=0 PSP=0 SWK=0 SSP=0 TWK=0 TSP=0 RWK=0 RSP=0 AWK=0 AWP=0
OUTPUT LRECL = 132, BLKSIZE = 32736, TYPE = FB
IN MAIN STORAGE SORT
INSERT 0, DELETE 49958210
RECORDS - IN: 50000000, OUT: 41790
NUMBER OF BYTES SORTED: 6600000000
RECORDS SORTED - PROCESSED: 50000000, EXPECTED: 50000000
TOTAL WORK DATA SET TRACKS ALLOCATED: 0 , TRACKS USED: 0
MEMORY OBJECT STORAGE USED = 6676M BYTES
HIPERSPACE STORAGE USED = 0K BYTES
DATA SPACE STORAGE USED = 0K BYTES
30915704 WMAIN, 8776 CMAIN, MAX CALLOC, N SCN, B BA, 0 AZ, 1 BZ, NN QC
132 RIN 32736 BLI 32736 BLO 132 RUN 56636 BUN 2817 CPU 00 CVC
255 XIN 127 WIN 50002094 GIN NDEY PFP BJD CMB00 CIX UPTH LMD VS RU
1 STR 0 MOR 0 IPB 200 OPB 0 CYL I MN
EQ=I1 DX=0 D2=0 D3=418 D4=0 AS=0 SA=0 SB=0 SC=0 HN=1
DAT 00 DSR 0304 BINS 50002094 BSZ 140 RCP 272 AJC 0 RLC 0 DUNIT 29
CW1 1 AVK 1 AVR 50000000
CW2 30 AVK 13 AVR 1666226
INIO1 255 AXIO1 255 W1 254 INIO3 200 AXIO3 200 BRUNS 1 VDN
0 MUNIT 0 SUNIT 0 OUNIT
0 SET 0 DEXTOT 0 BLK 50000000 CSZ 6 WE
SORTWK06 EXCP COUNT: 1
SORTWK05 EXCP COUNT: 1
SORTWK04 EXCP COUNT: 1
SORTWK03 EXCP COUNT: 1
SORTWK02 EXCP COUNT: 1
SORTWK01 EXCP COUNT: 1
END OF DFSORT

COMPLETE OUTPUT OF SECOND STEP (HIPER)

JOBNAME: SCJLC0A , STEPNAME: PASO040H
BLOCKSET TECHNIQUE IN CONTROL
RECORD TYPE IS F - DATA STARTS IN POSITION 1
RA 0 WR 0 TR 1
C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE E5-K62201
BLOCKSET SORT TECHNIQUE SELECTED
VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AN
- CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R10 - 11:40 ON MON AP
SORT FIELDS=(27,26,BI,A,53,3,BI,A,74,10,BI,A,65,4,BI,A,
56,09,BI,A,69,5,BI,A,84,10,BI,A)
SUM FIELDS=(94,9,PD)
OPTION DYNALLOC=(,6),MOSIZE=0,HIPRMAX=OPTIMAL
RECORD TYPE IS F - DATA STARTS IN POSITION 1
RA 0 WR 0 TR 1
C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE E5-K62201
ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED
PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS
SCJLC0A .PASO040H. , INPUT LRECL = 132, BLKSIZE = 32736, TYPE =
MAIN STORAGE = (MAX,30941800,30924486)
MAIN STORAGE ABOVE 16MB = (30863960,30863960)
OPTIONS: OVFLO=RC16,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC4 ,VLSCMP=N,SZERO=Y,
OPTIONS: SIZE=30941800,MAXLIM=2097152,MINLIM=524288,EQUALS=N,LIST=Y,ER
OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=
OPTIONS: RESALL=12288,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT
OPTIONS: TMAXLIM=20971520,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW
OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=Y,TEXIT=N,LISTX=N,EFS=NONE ,EXITC
OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=0 ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMI
OPTIONS: NULLOUT=RC0
BSAM ACCESS METHOD USED FOR SORTOUT
BSAM ACCESS METHOD USED FOR SORTIN
DC 6600000000 TC 0 CS DSVUU KSZ 67 VSZ 67
FSZ=50000000 RC IGN=0 E AVG=132 0 WSP=8572266 C DYN=1655 53216
MOFSZ=0,MOSZ=0,MOSYS=0(1),MOSTG=101776,MEML=17592186040320(3)
MOFR=0703,MOVR=VV
ESM=29146880,ESO=8744064,ESR=0,ESP=4096,ESS=16384,CES=29146880,HSZ=524
HWSP=4028320,HMAX=8388608,HES=8388608,ASV=26054801,EQ=I9,HN=1
OMAX=25003686,NMAX=26054801,ENQT=26054801,CMAX=524288,HU=99,BUN=53216,
QP=129 QA=129 HI=6362 LI=6234 MI=6362 TZ=524433 N1=524288 N2=524288 SZ
OMAX=25003686,NMAX=26054801,ENQT=25530368,CMAX=524288,HU=99,BUN=53216,
QP=128 QA=257 HI=6233 LI=6106 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
OMAX=25003686,NMAX=26054801,ENQT=25006080,CMAX=524288,HU=99,BUN=53216,
QP=128 QA=385 HI=6105 LI=5978 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
OMAX=25003686,NMAX=26054801,ENQT=24481792,CMAX=524288,HU=99,BUN=53216,
QP=128 QA=513 HI=5977 LI=5850 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
OMAX=25003686,NMAX=26054801,ENQT=23957504,CMAX=45914,HU=99,BUN=53216,M
QP=12 QA=525 HI=5849 LI=5838 MI=6362 TZ=49152 N1=45914 N2=45914 SZ=13
CT=MAX , SB=4, L=0, D=0000, CCW=1MAM
W 03PP17 05PP17 02PP17 01PP17 04PP17 06PP13
O AZ00 I PP10
DE-K61785 D5-K62201 D3-BASE D7-BASE E8-K61438
CON=1,MUV=0,VOL=10,ENU=0,SBK=0,SRC=0,VEM=0
PWK=5 PSP=1655 SWK=0 SSP=0 TWK=0 TSP=0 RWK=0 RSP=0 AWK=5 AWP=1655
OUTPUT LRECL = 132, BLKSIZE = 32736, TYPE = FB
INSERT 0, DELETE 49958210
RECORDS - IN: 50000000, OUT: 41790
NUMBER OF BYTES SORTED: 6600000000
RECORDS SORTED - PROCESSED: 50000000, EXPECTED: 50000000
TOTAL WORK DATA SET TRACKS ALLOCATED: 1725 , TRACKS USED: 0
MEMORY OBJECT STORAGE USED = 0M BYTES
HIPERSPACE STORAGE USED = 766920K BYTES
DATA SPACE STORAGE USED = 0K BYTES
30915392 WMAIN, 9088 CMAIN, MAX CALLOC, N SCN, A BA, 0 AZ, 1 BZ, NN QC
132 RIN 32736 BLI 32736 BLO 132 RUN 53216 BUN 2817 CPU 00 CVC
203 XIN 14 WIN 161880 GIN NDEY PFP 3 BJD CMB00 CIX UPTS LMD VS RUX
164 STR 164 MOR 479 IPB 31 OPB 0 CYL O MN
EQ=I9 DX=0 D2=81 D3=46 D4=2 AS=0 SA=0 SB=0 SC=0 HN=1
DAT 00 DSR 0304 BINS 0 BSZ 0 RCP 0 AJC 0 RLC 0 DUNIT 0
407 MUNIT 42 SUNIT 31 OUNIT
968 SET 170535 DEXTOT 14513 BLK 50000000 CSZ 11 WE
SORTWK06 EXCP COUNT: 1
SORTWK05 EXCP COUNT: 2
SORTWK04 EXCP COUNT: 2
SORTWK03 EXCP COUNT: 2
SORTWK02 EXCP COUNT: 2
SORTWK01 EXCP COUNT: 2
HSR=1134,HSW=1104,HRE=14679,HWE=1745,HRP=190827,HWP=190827,HWM=191730,
END OF DFSORT

¿Need some PTF to solve it?

¿Is possible to avoid use of MO using SUM operations in a SORT? (V1R10), obviously maintaining other sort's no SUM, with possibility to use Memory Objects. In V1R5 problem doesn't exists, SUM operations are not selected to use with MO...

Many thanks in advance for your help and assistance, regards

Josechu
Back to top
View user's profile Send private message

Bill Woodger

DFSORT Moderator


Joined: 09 Mar 2011
Posts: 7251

PostPosted: Mon Apr 30, 2012 4:27 pm    Post subject: Reply to: Very high CPU consumption in SUM (Memory objects v
Reply with quote

I think it would help if you include the message references with your output. San Jose working-hours are several hours behind you, so this evening (earliest) or tomorrow for any response.

When re-posting, please use the Code tags, which preserve spacing and make things much easier to read. What version of z/OS are you running?
Back to top
View user's profile Send private message
Josechu Lucena

New User


Joined: 27 Apr 2012
Posts: 3
Location: Spain

PostPosted: Mon Apr 30, 2012 5:04 pm    Post subject:
Reply with quote

Many thanks Bill, I'm running in ZOS V1R11 in mostly installations

Consumptions (FIrst step uses 100% MO, second step uses 100% HIPER, identical input file):

Code:
11.34.01 JOB64842 ---- MONDAY,    30 APR 2012 ----                             
11.34.01 JOB64842  IRR010I  USERID ZSTIJLC  IS ASSIGNED TO THIS JOB.           
11.34.01 JOB64842  ICH70001I ZSTIJLC  LAST ACCESS AT 11:23:11 ON MONDAY, APRIL 3
11.34.01 JOB64842  $HASP373 SCJLC0A  STARTED - WLM INIT  - SRVCLASS BATCHPRW - S
11.34.01 JOB64842  IEF403I SCJLC0A - STARTED - TIME=11.34.01                   
11.40.11 JOB64842  -JOBNAME_ STEPNAME PROCSTEP    RC   EXCP    CPU  CLOCK   SERV
11.40.11 JOB64842  -SCJLC0A  PASO040M             00  56532   4.69    6.1 14875K
11.41.09 JOB64842  -SCJLC0A  PASO040H             00  56601    .60     .9  1925K
11.41.09 JOB64842  IEF404I SCJLC0A - ENDED - TIME=11.41.09                     
11.41.09 JOB64842  -SCJLC0A  SRVCLASS(BATCHPRW) TOT:   113K   5.29    7.1 16801K
11.41.09 JOB64842  $HASP395 SCJLC0A  ENDED                                     


Information including message references:

SORT WIITH MO (very HIGH consumption):

Code:
ICE805I 1 JOBNAME: SCJLC0A  , STEPNAME: PASO040M                               
ICE802I 0 BLOCKSET     TECHNIQUE IN CONTROL                                     
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE992I 0 RA 0 WR 0 TR 0                                                       
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE   E5-K62201
ICE143I 0 BLOCKSET     SORT  TECHNIQUE SELECTED                                 
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AN
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R10 - 11:34 ON MON AP
            SORT FIELDS=(27,26,BI,A,53,3,BI,A,74,10,BI,A,65,4,BI,A,             
                         56,09,BI,A,69,5,BI,A,84,10,BI,A)                       
            SUM FIELDS=(94,9,PD)                                               
            OPTION DYNALLOC=(,6),MOSIZE=MAX,HIPRMAX=0                           
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE992I 0 RA 0 WR 0 TR 0                                                       
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE   E5-K62201
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED
ICE252I 1 PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS         
ICE088I 5 SCJLC0A .PASO040M.        , INPUT LRECL = 132, BLKSIZE = 32736, TYPE =
ICE093I 0 MAIN STORAGE = (MAX,30941800,30924486)   
ICE156I 0 MAIN STORAGE ABOVE 16MB = (30863960,30863960)                         
ICE127I 0 OPTIONS: OVFLO=RC16,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC4 ,VLSCMP=N,SZERO=Y,
ICE128I 0 OPTIONS: SIZE=30941800,MAXLIM=2097152,MINLIM=524288,EQUALS=N,LIST=Y,ER
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=
ICE130I 0 OPTIONS: RESALL=12288,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT
ICE131I 0 OPTIONS: TMAXLIM=20971520,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=Y,TEXIT=N,LISTX=N,EFS=NONE    ,EXITC
ICE133I 0 OPTIONS: HIPRMAX=0      ,DSPSIZE=0   ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMI
ICE235I 0 OPTIONS: NULLOUT=RC0                                                 
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTOUT                                   
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTIN                                   
ICE750I 0 DC 6600000000 TC 0 CS DSVUU KSZ 67 VSZ 67                             
ICE752I 0 FSZ=50000000 RC  IGN=0 E  AVG=132 0  WSP=8572266 C  DYN=0 0           
ICE915I 0 MOFSZ=6676,MOSZ=6676,MOSYS=101781(5),MOSTG=101781,MEML=17592186040320(
ICE880I 0 QP=418 QA=418 HI=6362 LI=5945 MI=6362 TZ=1709312 N1=1709056 N2=1709056
ICE916I 0 MOFR=0000,MOVR=VV                                                     
ICE996I 0 ESM=29146880,ESO=8744064,ESR=0,ESP=4096,ESS=16384,CES=29146880,HSZ=524
ICE997I 0 HWSP=4028320,HMAX=0,HES=0,ASV=26055936,EQ=I1,HN=0                 
ICE898I 0 OMAX=25015191,NMAX=26055936,ENQT=26055936,CMAX=0,HU=0,BUN=0,MD=N1,DU=0
ICE889I 0 CT=MAX     , SB=4, L=0, D=0000, CCW=1MAM                                                           
ICE901I 0 W 01PP13 02PP13 03PP13 04PP13 05PP13 06PP13                           
ICE902I 0 O AZ00  I PP10                                                       
ICE751I 1 BA-K48846 BB-K69370 BC-BASE   E8-K61438                               
ICE900I 0 CON=1,MUV=0,VOL=10,ENU=0,SBK=0,SRC=0,VEM=0                           
ICE999I 0 PWK=0 PSP=0 SWK=0 SSP=0 TWK=0 TSP=0 RWK=0 RSP=0 AWK=0 AWP=0           
ICE090I 0 OUTPUT LRECL = 132, BLKSIZE = 32736, TYPE = FB                       
ICE080I 0 IN MAIN STORAGE SORT                                                 
ICE055I 0 INSERT 0, DELETE 49958210                                             
ICE054I 0 RECORDS - IN: 50000000, OUT: 41790                                   
ICE134I 0 NUMBER OF BYTES SORTED: 6600000000                                   
ICE253I 0 RECORDS SORTED - PROCESSED: 50000000, EXPECTED: 50000000             
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 0 , TRACKS USED: 0             
ICE199I 0 MEMORY OBJECT STORAGE USED = 6676M BYTES                             
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES                                   
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES                                   
ICE891I 1 30915704 WMAIN, 8776 CMAIN, MAX CALLOC, N SCN, B BA, 0 AZ, 1 BZ, NN QC
ICE892I 1 132 RIN  32736 BLI  32736 BLO  132 RUN  56636 BUN  2817 CPU  00 CVC   
ICE893I 1 255 XIN 127 WIN 50002094 GIN NDEY PFP   BJD CMB00 CIX UPTH LMD VS   RU
ICE894I 0 1 STR  0 MOR  0 IPB  200 OPB  0 CYL  I   MN                           
ICE881I 1 EQ=I1 DX=0 D2=0 D3=418 D4=0 AS=0 SA=0 SB=0 SC=0 HN=1                 
ICE885I 1 DAT 00 DSR 0304 BINS 50002094 BSZ 140 RCP 272 AJC 0 RLC 0 DUNIT 29
ICE884I 4 CW1 1 AVK 1 AVR 50000000                                         
ICE884I 5 CW2 30 AVK 13 AVR 1666226                                         
ICE888I 1 INIO1 255 AXIO1 255 W1 254 INIO3 200 AXIO3 200 BRUNS 1 VDN       
ICE895I 0 0 MUNIT  0 SUNIT  0 OUNIT                                         
ICE896I 0 0 SET  0 DEXTOT  0 BLK   50000000 CSZ  6 WE                       
ICE804I 1 SORTWK06 EXCP COUNT: 1                                           
ICE804I 1 SORTWK05 EXCP COUNT: 1                                           
ICE804I 1 SORTWK04 EXCP COUNT: 1                                           
ICE804I 1 SORTWK03 EXCP COUNT: 1                                           
ICE804I 1 SORTWK02 EXCP COUNT: 1                                           
ICE804I 1 SORTWK01 EXCP COUNT: 1                                           
ICE052I 0 END OF DFSORT                                                     


SORT WIITH HIPER (normal consumption):

Code:
ICE805I 1 JOBNAME: SCJLC0A  , STEPNAME: PASO040H                               
ICE802I 0 BLOCKSET     TECHNIQUE IN CONTROL                                     
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE992I 0 RA 0 WR 0 TR 1                                                       
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE   E5-K62201
ICE143I 0 BLOCKSET     SORT  TECHNIQUE SELECTED                                 
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AN
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R10 - 11:40 ON MON AP
            SORT FIELDS=(27,26,BI,A,53,3,BI,A,74,10,BI,A,65,4,BI,A,             
                         56,09,BI,A,69,5,BI,A,84,10,BI,A)                       
            SUM FIELDS=(94,9,PD)                                               
            OPTION DYNALLOC=(,6),MOSIZE=0,HIPRMAX=OPTIMAL                       
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE992I 0 RA 0 WR 0 TR 1                                                       
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 E9-K60823 C9-BASE   E5-K62201
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED
ICE252I 1 PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS         
ICE088I 1 SCJLC0A .PASO040H.        , INPUT LRECL = 132, BLKSIZE = 32736, TYPE =
ICE093I 0 MAIN STORAGE = (MAX,30941800,30924486)                               
ICE156I 0 MAIN STORAGE ABOVE 16MB = (30863960,30863960)                         
ICE127I 0 OPTIONS: OVFLO=RC16,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC4 ,VLSCMP=N,SZERO=Y,
ICE128I 0 OPTIONS: SIZE=30941800,MAXLIM=2097152,MINLIM=524288,EQUALS=N,LIST=Y,ER
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=
ICE130I 0 OPTIONS: RESALL=12288,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT
ICE131I 0 OPTIONS: TMAXLIM=20971520,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=Y,TEXIT=N,LISTX=N,EFS=NONE    ,EXITC
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=0   ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMI
ICE235I 0 OPTIONS: NULLOUT=RC0                                                 
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTOUT                                   
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTIN                                   
ICE750I 0 DC 6600000000 TC 0 CS DSVUU KSZ 67 VSZ 67                             
ICE752I 0 FSZ=50000000 RC  IGN=0 E  AVG=132 0  WSP=8572266 C  DYN=1655 53216   
ICE915I 0 MOFSZ=0,MOSZ=0,MOSYS=0(1),MOSTG=101776,MEML=17592186040320(3)         
ICE916I 0 MOFR=0703,MOVR=VV                                                     
ICE996I 0 ESM=29146880,ESO=8744064,ESR=0,ESP=4096,ESS=16384,CES=29146880,HSZ=524
ICE997I 0 HWSP=4028320,HMAX=8388608,HES=8388608,ASV=26054801,EQ=I9,HN=1         
ICE898I 0 OMAX=25003686,NMAX=26054801,ENQT=26054801,CMAX=524288,HU=99,BUN=53216,
ICE880I 0 QP=129 QA=129 HI=6362 LI=6234 MI=6362 TZ=524433 N1=524288 N2=524288 SZ
ICE898I 0 OMAX=25003686,NMAX=26054801,ENQT=25530368,CMAX=524288,HU=99,BUN=53216,
ICE880I 0 QP=128 QA=257 HI=6233 LI=6106 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
ICE898I 0 OMAX=25003686,NMAX=26054801,ENQT=25006080,CMAX=524288,HU=99,BUN=53216,
ICE880I 0 QP=128 QA=385 HI=6105 LI=5978 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
ICE898I 0 OMAX=25003686,NMAX=26054801,ENQT=24481792,CMAX=524288,HU=99,BUN=53216,
ICE880I 0 QP=128 QA=513 HI=5977 LI=5850 MI=6362 TZ=524288 N1=524288 N2=524288 SZ
ICE898I 0 OMAX=25003686,NMAX=26054801,ENQT=23957504,CMAX=45914,HU=99,BUN=53216,M
ICE880I 0 QP=12 QA=525 HI=5849 LI=5838 MI=6362 TZ=49152 N1=45914 N2=45914 SZ=13
ICE889I 0 CT=MAX     , SB=4, L=0, D=0000, CCW=1MAM                             
ICE901I 0 W 03PP17 05PP17 02PP17 01PP17 04PP17 06PP13                           
ICE902I 0 O AZ00  I PP10                                                       
ICE751I 1 DE-K61785 D5-K62201 D3-BASE   D7-BASE   E8-K61438                     
ICE900I 0 CON=1,MUV=0,VOL=10,ENU=0,SBK=0,SRC=0,VEM=0                           
ICE999I 0 PWK=5 PSP=1655 SWK=0 SSP=0 TWK=0 TSP=0 RWK=0 RSP=0 AWK=5 AWP=1655     
ICE090I 0 OUTPUT LRECL = 132, BLKSIZE = 32736, TYPE = FB                       
ICE055I 0 INSERT 0, DELETE 49958210                                             
ICE054I 0 RECORDS - IN: 50000000, OUT: 41790                                   
ICE134I 0 NUMBER OF BYTES SORTED: 6600000000                                   
ICE253I 0 RECORDS SORTED - PROCESSED: 50000000, EXPECTED: 50000000             
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 1725 , TRACKS USED: 0           
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES                                 
ICE180I 0 HIPERSPACE STORAGE USED = 766920K BYTES                               
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES                                   
ICE891I 1 30915392 WMAIN, 9088 CMAIN, MAX CALLOC, N SCN, A BA, 0 AZ, 1 BZ, NN QC
ICE892I 1 132 RIN  32736 BLI  32736 BLO  132 RUN  53216 BUN  2817 CPU  00 CVC   
ICE893I 1 203 XIN 14 WIN 161880 GIN NDEY PFP 3 BJD CMB00 CIX UPTS LMD VS   RUX 
ICE894I 0 164 STR  164 MOR  479 IPB  31 OPB  0 CYL  O   MN                     
ICE881I 0 EQ=I9 DX=0 D2=81 D3=46 D4=2 AS=0 SA=0 SB=0 SC=0 HN=1                 
ICE885I 0 DAT 00 DSR 0304 BINS 0 BSZ 0 RCP 0 AJC 0 RLC 0 DUNIT 0               
ICE895I 0 407 MUNIT  42 SUNIT  31 OUNIT                                         
ICE896I 0 968 SET  170535 DEXTOT  14513 BLK   50000000 CSZ  11 WE               
ICE804I 1 SORTWK06 EXCP COUNT: 1                                               
ICE804I 1 SORTWK05 EXCP COUNT: 2                                               
ICE804I 1 SORTWK04 EXCP COUNT: 2                                               
ICE804I 1 SORTWK03 EXCP COUNT: 2                                               
ICE804I 1 SORTWK02 EXCP COUNT: 2                                               
ICE804I 1 SORTWK01 EXCP COUNT: 2                                               
ICE899I 0 HSR=1134,HSW=1104,HRE=14679,HWE=1745,HRP=190827,HWP=190827,HWM=191730,
ICE052I 0 END OF DFSORT                                                         


Need maintenance in DFSORT V1R10 to solve it?

If not, is possible to avoid use of MO if SORT is making SUM operations?

Thanks in advance, regards

Josechu
Back to top
View user's profile Send private message
sqlcode1

Active Member


Joined: 08 Apr 2010
Posts: 578
Location: USA

PostPosted: Mon Apr 30, 2012 8:39 pm    Post subject:
Reply with quote

Josechu Lucena,

Below are my guesses based on behaviour you are seeing....

Josechu Lucena wrote:

Need some PTF to solve it?

Yes, you are probably missing some PTFs... UQ* ones. Wait for someone to provide detailed list of PTFs.
Josechu Lucena wrote:

Is possible to avoid use of MO using SUM operations in a SORT? (V1R10), obviously maintaining other sort's no SUM, with possibility to use Memory Objects. In V1R5 problem doesn't exists, SUM operations are not selected to use with MO...
Josechu

You have pretty much answered your question unless I am missing something. Hopefully once PTFs are installed, your issue may be resolved. In V1R5 you don't see this problem because PTFs that you are missing, are pre-installed with base(V1R5).

Thanks,
Back to top
View user's profile Send private message
Dave Betten

New User


Joined: 24 Jan 2006
Posts: 26

PostPosted: Mon Apr 30, 2012 9:11 pm    Post subject: Reply to: Very high CPU consumption in SUM (Memory objects v
Reply with quote

This has to do with the sort design being a bit different for memory object sorting and Hiperspace sorting. You have a large number of records with the same key value which causes the number of output records to be very small as compared to the number of input records.

ICE055I 0 INSERT 0, DELETE 49958210
ICE054I 0 RECORDS - IN: 50000000, OUT: 41790

When this situation occurs, memory object sorting can be a bit more cpu intensive. This was one of the reasons in PTF UK62201 (which you have), we altered our algorithms to prefer Hiperspace sorting more often. If instead of trying to force DFSORT to use one or the other with MOSIZE=0 or HIPRMAX=0, you left them at the shipped defaults of MOSIZE=MAX,HIPRMAX=OPTIMAL, DFSORT would probably choose Hiperspace sorting which as you've seen is more efficient in this case.
Back to top
View user's profile Send private message
Josechu Lucena

New User


Joined: 27 Apr 2012
Posts: 3
Location: Spain

PostPosted: Thu May 03, 2012 8:49 pm    Post subject:
Reply with quote

Hi Dave, a pleasure to speack with you another time.

I will test with PTF related, send u results a.s.a.p. Sorry by delay, in Madrid was holiday past two days

Many thanks by your assistance

Josechu
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts ESQA overflow - high ECSA utilization vasanthz All Other Mainframe Topics 1 Thu Dec 29, 2016 7:06 am
No new posts High CPU consumption Job using IAM fi... aswinir JCL & VSAM 15 Thu Dec 01, 2016 8:28 pm
No new posts Not enough virtual memory is availabl... Vinay Pushpala IBM Tools 16 Tue Sep 13, 2016 4:37 pm
No new posts COBOL DB2 - CALL statement - high CPU... TS70363 DB2 15 Sun Sep 11, 2016 6:07 am
No new posts COFVLH02E VLF trimmed objects younger... Robert Sample All Other Mainframe Topics 2 Tue Feb 09, 2016 3:37 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us