|
View previous topic :: View next topic
|
| Author |
Message |
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
I am trying to execute the following sort card with the input files having 120 million records.
JOINKEYS FILES=F1,FIELDS=(1,45,A)
JOINKEYS FILES=F2,FIELDS=(1,45,A)
JOIN UNPAIRED,ONLY,F1
SORT FIELDS=(1,45,CH,A)
My job fails with return code U0016 also i could see the message
WER219I DYNALLOC FAILED RC=(970C) - 3390
WER046A SORT CAPACITY EXCEEDED
Is there anyway to make the sort successful or SYNCSORT itself
unable to handle such volume of records.
anyone please help me. Thanks in advance. |
|
| Back to top |
|
 |
expat
Global Moderator
Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales
|
|
|
|
| What does the manual say about the error codes and messages issued ? |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
| As per manual, it seems intermediate storage space is not available. But how do i increase the storage space. I have tried adding JNF1WKnn DD's. |
|
| Back to top |
|
|
dbzTHEdinosauer
Global Moderator
Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne
|
|
|
|
| One of Syncsort's selling points is their HYPERSORT. Look at that. |
|
| Back to top |
|
|
leo_sangha
New User
Joined: 11 Aug 2005
Posts: 85
Location: England
|
|
|
|
Can you post your JCL ?
WER046A - is because not enough intermediate storage is allocated.
What is the space allocated for sort working files, SORTWKnn ? |
|
| Back to top |
|
|
dbzTHEdinosauer
Global Moderator
Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne
|
|
|
|
| the volume of records that can be sorted has nothing to do with the sort product---------it is dependent upon your hardware. |
|
| Back to top |
|
|
expat
Global Moderator
Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales
|
|
|
|
| As a last resort, and many many years ago - I have allocated six TAPE SORTWKnn statements. And that really is a last resort as the elapsed time rises very sharply, but at least it got the job done. |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
Here is my job
| Code: |
//R010 EXEC PGM=SORT,PARM='DYNALLOC=(3490,255)'
//SORTJNF1 DD DSN=DSN1(0),DISP=SHR
//SORTJNF2 DD DSN=DSN2(0),DISP=SHR
//SORTOUT DD DSN=DSN3,
// DISP=(NEW,CATLG,DELETE),
// UNIT=TAPE36E,
// LABEL=(1,SL,EXPDT=99005),
// DCB=(DLJ.MODLDSCB,RECFM=FB,LRECL=517)
//SYSPRINT DD SYSOUT=*
//SYSOUT DD SYSOUT=*
//SYSIN DD *
JOINKEYS FILES=F1,FIELDS=(1,45,A)
JOINKEYS FILES=F2,FIELDS=(1,45,A)
JOIN UNPAIRED,ONLY,F1
SORT FIELDS=(1,45,CH,A)
/* |
|
|
| Back to top |
|
|
leo_sangha
New User
Joined: 11 Aug 2005
Posts: 85
Location: England
|
|
|
|
Clearly you havent used any work files ?
There are many existing topics in this forum which will guide you. |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
I have tried using that also.. missed to copy that particular JCL. Irrespective of work files i have used, i am getting SORT CAPACITY EXCEEDED message. Also I could see the message like
| Code: |
912 IGD17272I VOLUME SELECTION HAS FAILED FOR INSUFFICIENT SPACE FOR 708
DATA SET SYS09093.T052920.RA000.JOB1A1WC.R0131395
JOBNAME (JOB1A1WC) STEPNAME (R010 )
PROGNAME (SORT ) DDNAME (JNF1WK45)
REQUESTED SPACE QUANTITY = 41501 KB
STORCLAS (SCVIOTST) MGMTCLAS ( ) DATACLAS ( )
STORGRPS (TPUBLIC SGVIO )
912 IKJ56893I FILE JNF1WK45 NOT ALLOCATED+
|
This shows that i dont have enough space in my intermediate volume? |
|
| Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Hello,
You need to post the complete jcl and sort control statements that you are currently using as well as any diagnostics generated by running that jcl amd sort control info.
Why is the dynalloc parameter used, or is it simply always used on your system?
You may also need to consider using MAXSORT. . . |
|
| Back to top |
|
|
Terry Heinze
JCL Moderator
Joined: 14 Jul 2008
Posts: 1249
Location: Richfield, MN, USA
|
|
|
|
Anand B,
Aren't there any examples in the Syncsort documentation showing how to handle large volume sorts? |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
Dick,
This is my complete job
| Code: |
//R010 EXEC PGM=SORT
//SORTJNF1 DD DSN=DSN1(0),DISP=SHR
//SORTJNF2 DD DSN=DSN2(0),DISP=SHR
//SORTOUT DD DSN=DSN3(0),
// DISP=(NEW,CATLG,DELETE),
// UNIT=TAPE36E,
// LABEL=(1,SL,EXPDT=99005),
// DCB=(DLJ.MODLDSCB,RECFM=FB,LRECL=517)
//SORTWK01 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SORTWK02 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SORTWK03 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SORTWK04 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SORTWK05 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SORTWK06 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
... UPTO
//SORTWK23 DD DATACLAS=COMPRESS,
// SPACE=(CYL,(1000,100),RLSE)
//SYSPRINT DD SYSOUT=*
//SYSOUT DD SYSOUT=*
//SYSIN DD *
JOINKEYS FILES=F1,FIELDS=(1,45,A)
JOINKEYS FILES=F2,FIELDS=(1,45,A)
JOIN UNPAIRED,ONLY,F1
SORT FIELDS=(1,45,CH,A)
/* |
When I tried with MAXSORT it shows
| Code: |
WER479A MAXSORT MAY NOT BE USED IN A JOIN APPLICATION
|
Terry,
Unfortunately I dont have any examples in the manual i'm having. If you find anything in online.. please tell me. |
|
| Back to top |
|
|
anandinmainframe
Active User
Joined: 31 May 2007
Posts: 171
Location: India
|
|
|
|
Anand,
Do Check your I/P Files because i have experienced this ABEND U0016. most of the times issue with the I/P file |
|
| Back to top |
|
|
expat
Global Moderator
Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales
|
|
|
|
| anandinmainframe wrote: |
Anand,
Do Check your I/P Files because i have experienced this ABEND U0016. most of the times issue with the I/P file |
The OP has specifically stated the problem which is the cause of the problem. We know what the problem is.
What is the maximum number of SORTWKnn statements that can be used by SYNCSORT.
HAve you considered using tapes for SORTWKnn - although as a last last resort. |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
Yeah, I have tried using tape work datasets also.. no result.  |
|
| Back to top |
|
|
Anuj Dhawan
Superior Member
Joined: 22 Apr 2006
Posts: 6250
Location: Mumbai, India
|
|
|
|
| ABaluchamy wrote: |
| If you find anything in online.. please tell me. |
Suggest you get in contact with Sync sort support via web or Alisa from this Forum |
|
| Back to top |
|
|
leo_sangha
New User
Joined: 11 Aug 2005
Posts: 85
Location: England
|
|
|
|
| ABaluchamy wrote: |
I have tried using that also.. missed to copy that particular JCL. Irrespective of work files i have used, i am getting SORT CAPACITY EXCEEDED message. Also I could see the message like
| Code: |
912 IGD17272I VOLUME SELECTION HAS FAILED FOR INSUFFICIENT SPACE FOR 708
DATA SET SYS09093.T052920.RA000.JOB1A1WC.R0131395
JOBNAME (JOB1A1WC) STEPNAME (R010 )
PROGNAME (SORT ) DDNAME (JNF1WK45)
REQUESTED SPACE QUANTITY = 41501 KB
STORCLAS (SCVIOTST) MGMTCLAS ( ) DATACLAS ( )
STORGRPS (TPUBLIC SGVIO )
912 IKJ56893I FILE JNF1WK45 NOT ALLOCATED+
|
This shows that i dont have enough space in my intermediate volume? |
How does the above message relate to SORT Capacity exceeded ?
You've allocated 23 SORKWKnn files, each having 1000 cylinders as primary quantity. This space should be enough.
ddname JNF1WK45, where is it used ? |
|
| Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Hi Anand,
You have asked for more than 2 complete 3390 devices for sortwk. You need to talk with your storage management people to see if there is that much space available in that dataclas or if there is some other you could use for this job.
Something you might consider is sorting the 2 files separately (with MAXSORT if necessary) and then run this process to join. You can tell the join that the files are already in sequence and prevent sorting them as part of the join.
| Quote: |
| How does the above message relate to SORT Capacity exceeded ? |
If you cannot allocate the sort work, you run with less and possibly you exceed the sort capacity. . .
| Quote: |
| You've allocated 23 SORKWKnn files, each having 1000 cylinders as primary quantity. This space should be enough. |
Did you calculate this or is it just something you believe. No matter, really, as the space request fails. . . |
|
| Back to top |
|
|
Alissa Margulies
SYNCSORT Support
Joined: 25 Jul 2007
Posts: 496
Location: USA
|
|
|
|
| ABaluchamy wrote: |
My job fails with return code U0016 also i could see the message
WER219I DYNALLOC FAILED RC=(970C) - 3390
WER046A SORT CAPACITY EXCEEDED
|
When SyncSort is called upon to take care of dynamically allocating the SORTWK space needed, we simply use the system-provided DYNALLOC facility.
In this particular case, the system DYNALLOC facility reported an error. If you have already referred to your IBM documentation, then you know that the 970C Reason Code indicates a "Severe SMS VTOC service error".
Since the system DYNALLOC facility was unable to acquire any more space, SyncSort then ends up failing and posts the message WER046A SORT CAPACITY EXCEEDED.
You can run a SYNCLIST to check the RETRY subparameter of the DYNALOC option. My suspicion is that it may be set to RETRY=(0,0). If this is the case, you may wish to have your system programmer modify it to reflect RETRY=(5,3) or some other value more appropriate for your site. |
|
| Back to top |
|
|
abin
Active User
.jpg)
Joined: 14 Aug 2006
Posts: 198
|
|
| Back to top |
|
|
CICS Guy
Senior Member
Joined: 18 Jul 2007
Posts: 2146
Location: At my coffee table
|
|
|
|
| abin wrote: |
| The best possible soultion would be to use DYNALLOC. |
Did you bother to read previous replys?
| Alissa Margulies wrote: |
| Since the system DYNALLOC facility was unable to acquire any more space, SyncSort then ends up failing and posts the message WER046A SORT CAPACITY EXCEEDED. |
|
|
| Back to top |
|
|
Alissa Margulies
SYNCSORT Support
Joined: 25 Jul 2007
Posts: 496
Location: USA
|
|
|
|
| abin wrote: |
| You can allocate upto 252 work data sets dynamically. |
Correction: The number of SORTWK data sets that can potentially be allocated is 255. |
|
| Back to top |
|
|
Alissa Margulies
SYNCSORT Support
Joined: 25 Jul 2007
Posts: 496
Location: USA
|
|
|
|
Bill,
I think Abin was suggesting that the RETRY subparameter of the DYNALLOC runtime PARM was a better alternative to changing the DYNALOC installation option. Just my guess... |
|
| Back to top |
|
|
ABaluchamy
New User
Joined: 29 Dec 2006
Posts: 34
Location: INDIA
|
|
|
|
Alissa Margulies Wrote:
| Quote: |
| Since the system DYNALLOC facility was unable to acquire any more space, SyncSort then ends up failing and posts the message WER046A SORT CAPACITY EXCEEDED |
Yes.. I have not authorized to use that much space.. I have contacted Storage team for a solution. |
|
| Back to top |
|
|
|
|
