IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

DFSORT - SORT CAPACITY EXCEEDED


IBM Mainframe Forums -> DFSORT/ICETOOL
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
Garry Carroll

Senior Member


Joined: 08 May 2006
Posts: 1193
Location: Dublin, Ireland

PostPosted: Sat Oct 04, 2008 10:42 pm
Reply with quote

Would appreciate some assistance/recommendations with the following problem.

We have a DB2/Platinum LOAD/REPLACE job that has failed last 3 times run with the following message:

Code:
ICE805I 0 JOBNAME: KTMPH08B , STEPNAME: RELOAD                                 
ICE802I 0 BLOCKSET     TECHNIQUE IN CONTROL                                     
ICE201I E RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE751I 0 C5-K26318 C6-K90007 C7-K90000 C8-K23476 E4-K90007 C9-BASE   E5-K31980 E6-K34782 E7-K24705   
ICE143I 0 BLOCKSET     SORT  TECHNIQUE SELECTED                                 
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R5 - 06:31 ON SAT OCT 04, 2008 - 
          SORT FIELDS=(00014,008,A,00022,010,A),FORMAT=BI                       
          RECORD TYPE=F,LENGTH=(00044,00044,,00044,00044)                       
          OPTION MSGPRT=ALL,MAINSIZE=20971520,SORTDD=ST01,MSGDDN=ST01MSG,DYNALLOC*
                         =(WORKP,003),FILSZ=E17777776,NOEQUALS                 
ICE201I E RECORD TYPE IS F - DATA STARTS IN POSITION 1                         
ICE751I 0 C5-K26318 C6-K90007 C7-K90000 C8-K23476 E4-K90007 C9-BASE   E5-K31980 E6-K34782 E7-K24705
ICE193I 0 ICEAM2 ENVIRONMENT IN EFFECT - ICEAM2 INSTALLATION MODULE SELECTED   
ICE089I 5 KTMPH08B.RELOAD  .LOAD    , INPUT LRECL = 44, TYPE = F               
ICE092I 0 MAIN STORAGE = (20971520,20971520,20971520)                           
ICE156I 0 MAIN STORAGE ABOVE 16MB = (20896820,20880436)                         
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 
ICE128I 0 OPTIONS: SIZE=20971520,MAXLIM=3145728,MINLIM=450560,EQUALS=N,LIST=Y,ERET=RC16 ,MSGDDN=ST01MSG
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(WORKP   ,003),ABCOD
ICE130I 0 OPTIONS: RESALL=0,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,STIMER=N,COBEXIT=COB2 
ICE131I 0 OPTIONS: TMAXLIM=8388608,ARESALL=0,ARESINV=16384,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0   
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE    ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX 
ICE235I 0 OPTIONS: NULLOUT=RC0                                                 
ICE750I 0 DC 0 TC 0 CS DSVVV KSZ 18 VSZ 18                                     
ICE752I 0 FSZ=17777776 RE  IGN=0 C  AVG=44 0  WSP=1015972 E  DYN=0 0           
ICE915I 0 MOFSZ=882,MOSZ=882,MOSYS=2048(2),MOSTG=29266,MEML=2048(1)             
ICE917I 0 MOQP=56,MOQA=56,MOHI=1830,MOLI=1775,MOMI=1830,MOTZ=882               
ICE916I 0 MOFR=0000,MOVR=VV                                                     
ICE996I 0 ESM=7730432,ESO=7730432,ESR=0,ESP=4096,ESS=16384,CES=7730432,HSZ=524288
ICE997I 0 HWSP=477430,HMAX=7492180,HES=0,ASV=7492180,EQ=I1,HN=0                 
ICE898I 0 OMAX=4099338,NMAX=7492180,TMAX=7492180,CMAX=0,HU=0,BUN=0,MD=NM,DU=0,DR=0,HN=0
ICE889I 0 CT=MAX     , SB=3, L=0, D=0000                                       
ICE901I 0 W 01PS13 02PS13 03PS13                                               
ICE046A C SORT CAPACITY EXCEEDED - RECORD COUNT 68184378                       
ICE753I 1 FWK=(2,18360) SWK=(0,0) TWK=(0,0) RWK=(1,990) TOTAL=(3,19350) BLK=56636                                                               
ICE751I 1 BA-K22788 BB-K24705 C4-K24705 C4-K24705 C4-K24705
ICE052I 0 END OF DFSORT                               


Reviewing previous executions, we notice that for lower record counts MEMORY OBJECT storage is used whereas higher show HIPERSPACE STORAGE being used.

The Db2 table it's loading has 77048404 rows and is increasing in size each week.

Regards,
Garry.
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Sun Oct 05, 2008 12:46 am
Reply with quote

Hello Garry,

Your process has completely exausted all of the available intermediate storage (both hiperspace and dasd).

Are the sort work datasets in the jcl?
Note: DFSORT uses only the first volume of multi-volume work data sets.

Quote:
The amount of intermediate storage required can vary depending on many factors including:

The amount of Hiperspace DFSORT is able to use at the time the sort is run
The amount of main storage available
The degree of randomness of the records to be sorted
The values specified (or defaulted) for options such as DYNALOC, DYNAUTO, DYNSPC, FILSZ/SIZE, AVGRLEN, OR DYNALLOC..
The amount of padding required for short records when VLSHRT is in effect.


Quote:
Programmer Response: Take one or more of the following actions:

If appropriate, increase the amount of main storage available to DFSORT using the options MAINSIZE/SIZE or the JCL option REGION. Increasing the amount of main storage available to DFSORT can help DFSORT use less intermediate storage. Avoid running a large sort in a small amount of main storage.
If dynamic allocation was used, ensure that the values for the options DYNALOC, DYNAUTO, DYNSPC, DYNALLOC, FILSZ/SIZE, and AVGRLEN are appropriate. If necessary, specify these options or change their values.

If your average input record length is significantly different from one-half of the LRECL, specify AVGRLEN=n with a reasonably accurate estimate of the average record length.

If VLSHRT was in effect and the total size of all control fields was significantly larger than the average LRECL for the data set, you may be able to reduce the amount of work space required by reducing the total size of the control fields.
If JCL work data sets were used, increase the amount of work space available to DFSORT.


Possibly your storagem management people can allocate more dasd to the pool of dasd available for sort work.
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Sun Oct 05, 2008 12:50 am
Reply with quote

Hello again,

How long does this process run?

Quote:
increasing in size each week
How much does it increase each week?

It may be time to look into different approaches than this single run . . .
Back to top
View user's profile Send private message
Dave Betten

New User


Joined: 24 Jan 2006
Posts: 26

PostPosted: Mon Oct 06, 2008 1:31 am
Reply with quote

Garry,

The utility is passing FILSZ=17777776, but when DFSORT issues the ICE046A it has already processed 68184378 records. Because the file size being passed is so much smaller than the actual number of records processed, not enough work space was allocated. You need to determine why an incorrect file size is being passed. You may need to do a runstats against the table to get the catalog stats updated.
Back to top
View user's profile Send private message
Garry Carroll

Senior Member


Joined: 08 May 2006
Posts: 1193
Location: Dublin, Ireland

PostPosted: Wed Oct 08, 2008 2:31 pm
Reply with quote

Thanks Dick and Dave. I will follow up with the team that own the job - I think they've got a prior step that may be interfering with calculation of FILSZ.

Regards,
Garry.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> DFSORT/ICETOOL

 


Similar Topics
Topic Forum Replies
No new posts Need to set RC4 through JCL SORT DFSORT/ICETOOL 5
No new posts How to split large record length file... DFSORT/ICETOOL 10
No new posts Modifying Date Format Using DFSORT DFSORT/ICETOOL 9
No new posts Replace Multiple Field values to Othe... DFSORT/ICETOOL 12
No new posts JCL sort card - get first day and las... JCL & VSAM 9
Search our Forums:

Back to Top