Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Maximum records that SORT can processed
Goto page 1, 2  Next
 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM
View previous topic :: :: View next topic  
Author Message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Tue Apr 07, 2009 2:34 pm    Post subject: Maximum records that SORT can processed
Reply with quote

I am trying to execute the following sort card with the input files having 120 million records.

JOINKEYS FILES=F1,FIELDS=(1,45,A)
JOINKEYS FILES=F2,FIELDS=(1,45,A)
JOIN UNPAIRED,ONLY,F1
SORT FIELDS=(1,45,CH,A)

My job fails with return code U0016 also i could see the message

WER219I DYNALLOC FAILED RC=(970C) - 3390
WER046A SORT CAPACITY EXCEEDED

Is there anyway to make the sort successful or SYNCSORT itself
unable to handle such volume of records.

anyone please help me. Thanks in advance.
Back to top
View user's profile Send private message

expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Tue Apr 07, 2009 2:40 pm    Post subject:
Reply with quote

What does the manual say about the error codes and messages issued ?
Back to top
View user's profile Send private message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Tue Apr 07, 2009 3:53 pm    Post subject:
Reply with quote

As per manual, it seems intermediate storage space is not available. But how do i increase the storage space. I have tried adding JNF1WKnn DD's.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Tue Apr 07, 2009 4:07 pm    Post subject:
Reply with quote

One of Syncsort's selling points is their HYPERSORT. Look at that.
Back to top
View user's profile Send private message
leo_sangha

New User


Joined: 11 Aug 2005
Posts: 85
Location: England

PostPosted: Tue Apr 07, 2009 4:27 pm    Post subject: Reply to: Maximum records that SORT can processed
Reply with quote

Can you post your JCL ?

WER046A - is because not enough intermediate storage is allocated.
What is the space allocated for sort working files, SORTWKnn ?
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Tue Apr 07, 2009 4:29 pm    Post subject:
Reply with quote

the volume of records that can be sorted has nothing to do with the sort product---------it is dependent upon your hardware.
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Tue Apr 07, 2009 4:31 pm    Post subject:
Reply with quote

As a last resort, and many many years ago - I have allocated six TAPE SORTWKnn statements. And that really is a last resort as the elapsed time rises very sharply, but at least it got the job done.
Back to top
View user's profile Send private message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Tue Apr 07, 2009 5:16 pm    Post subject:
Reply with quote

Here is my job

Code:
//R010     EXEC PGM=SORT,PARM='DYNALLOC=(3490,255)'           
//SORTJNF1 DD  DSN=DSN1(0),DISP=SHR
//SORTJNF2 DD  DSN=DSN2(0),DISP=SHR 
//SORTOUT  DD  DSN=DSN3,                       
//             DISP=(NEW,CATLG,DELETE),                       
//             UNIT=TAPE36E,                                   
//             LABEL=(1,SL,EXPDT=99005),                       
//             DCB=(DLJ.MODLDSCB,RECFM=FB,LRECL=517)           
//SYSPRINT DD  SYSOUT=*                                       
//SYSOUT   DD  SYSOUT=*                                       
//SYSIN    DD  *                                           
    JOINKEYS FILES=F1,FIELDS=(1,45,A)                         
    JOINKEYS FILES=F2,FIELDS=(1,45,A)                         
    JOIN UNPAIRED,ONLY,F1                                     
    SORT FIELDS=(1,45,CH,A)                                   
/*                                                             
Back to top
View user's profile Send private message
leo_sangha

New User


Joined: 11 Aug 2005
Posts: 85
Location: England

PostPosted: Tue Apr 07, 2009 6:16 pm    Post subject: Reply to: Maximum records that SORT can processed
Reply with quote

Clearly you havent used any work files ?
There are many existing topics in this forum which will guide you.
Back to top
View user's profile Send private message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Wed Apr 08, 2009 8:27 am    Post subject:
Reply with quote

I have tried using that also.. missed to copy that particular JCL. Irrespective of work files i have used, i am getting SORT CAPACITY EXCEEDED message. Also I could see the message like

Code:

912  IGD17272I VOLUME SELECTION HAS FAILED FOR INSUFFICIENT SPACE FOR  708
     DATA SET SYS09093.T052920.RA000.JOB1A1WC.R0131395                     
     JOBNAME (JOB1A1WC) STEPNAME (R010    )                               
     PROGNAME (SORT    ) DDNAME (JNF1WK45)                                 
     REQUESTED SPACE QUANTITY = 41501 KB                                   
     STORCLAS (SCVIOTST) MGMTCLAS (        ) DATACLAS (        )           
     STORGRPS (TPUBLIC SGVIO  )                                           
912  IKJ56893I FILE JNF1WK45 NOT ALLOCATED+                               


This shows that i dont have enough space in my intermediate volume?
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Wed Apr 08, 2009 8:43 am    Post subject:
Reply with quote

Hello,

You need to post the complete jcl and sort control statements that you are currently using as well as any diagnostics generated by running that jcl amd sort control info.

Why is the dynalloc parameter used, or is it simply always used on your system?

You may also need to consider using MAXSORT. . .
Back to top
View user's profile Send private message
Terry Heinze

JCL Moderator


Joined: 14 Jul 2008
Posts: 1238
Location: Richfield, MN, USA

PostPosted: Wed Apr 08, 2009 8:52 am    Post subject:
Reply with quote

Anand B,
Aren't there any examples in the Syncsort documentation showing how to handle large volume sorts?
Back to top
View user's profile Send private message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Wed Apr 08, 2009 10:55 am    Post subject:
Reply with quote

Dick,

This is my complete job

Code:

//R010     EXEC PGM=SORT                                     
//SORTJNF1 DD  DSN=DSN1(0),DISP=SHR
//SORTJNF2 DD  DSN=DSN2(0),DISP=SHR
//SORTOUT  DD  DSN=DSN3(0),                     
//             DISP=(NEW,CATLG,DELETE),                       
//             UNIT=TAPE36E,                                 
//             LABEL=(1,SL,EXPDT=99005),                     
//             DCB=(DLJ.MODLDSCB,RECFM=FB,LRECL=517)         
//SORTWK01 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
//SORTWK02 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
//SORTWK03 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
//SORTWK04 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
//SORTWK05 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
//SORTWK06 DD  DATACLAS=COMPRESS,                             
//             SPACE=(CYL,(1000,100),RLSE)                   
... UPTO
//SORTWK23 DD  DATACLAS=COMPRESS,         
//             SPACE=(CYL,(1000,100),RLSE)
//SYSPRINT DD  SYSOUT=*                   
//SYSOUT   DD  SYSOUT=*                   
//SYSIN    DD  *                         
    JOINKEYS FILES=F1,FIELDS=(1,45,A)     
    JOINKEYS FILES=F2,FIELDS=(1,45,A)     
    JOIN UNPAIRED,ONLY,F1                 
    SORT FIELDS=(1,45,CH,A)               
/* 


When I tried with MAXSORT it shows
Code:

WER479A  MAXSORT      MAY NOT BE USED IN A JOIN APPLICATION


Terry,
Unfortunately I dont have any examples in the manual i'm having. If you find anything in online.. please tell me.
Back to top
View user's profile Send private message
anandinmainframe

Active User


Joined: 31 May 2007
Posts: 171
Location: India

PostPosted: Wed Apr 08, 2009 11:29 am    Post subject: Reply to: Maximum records that SORT can processed
Reply with quote

Anand,
Do Check your I/P Files because i have experienced this ABEND U0016. most of the times issue with the I/P file
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Wed Apr 08, 2009 11:40 am    Post subject: Re: Reply to: Maximum records that SORT can processed
Reply with quote

anandinmainframe wrote:
Anand,
Do Check your I/P Files because i have experienced this ABEND U0016. most of the times issue with the I/P file

The OP has specifically stated the problem which is the cause of the problem. We know what the problem is.

What is the maximum number of SORTWKnn statements that can be used by SYNCSORT.

HAve you considered using tapes for SORTWKnn - although as a last last resort.
Back to top
View user's profile Send private message
ABaluchamy

New User


Joined: 29 Dec 2006
Posts: 34
Location: INDIA

PostPosted: Wed Apr 08, 2009 12:03 pm    Post subject:
Reply with quote

Yeah, I have tried using tape work datasets also.. no result. icon_confused.gif
Back to top
View user's profile Send private message
Anuj Dhawan

Senior Member


Joined: 22 Apr 2006
Posts: 6258
Location: Mumbai, India

PostPosted: Wed Apr 08, 2009 12:41 pm    Post subject:
Reply with quote

ABaluchamy wrote:
If you find anything in online.. please tell me.
Suggest you get in contact with Sync sort support via web or Alisa from this Forum
Back to top
View user's profile Send private message
leo_sangha

New User


Joined: 11 Aug 2005
Posts: 85
Location: England

PostPosted: Wed Apr 08, 2009 2:13 pm    Post subject:
Reply with quote

ABaluchamy wrote:
I have tried using that also.. missed to copy that particular JCL. Irrespective of work files i have used, i am getting SORT CAPACITY EXCEEDED message. Also I could see the message like

Code:

912  IGD17272I VOLUME SELECTION HAS FAILED FOR INSUFFICIENT SPACE FOR  708
     DATA SET SYS09093.T052920.RA000.JOB1A1WC.R0131395                     
     JOBNAME (JOB1A1WC) STEPNAME (R010    )                               
     PROGNAME (SORT    ) DDNAME (JNF1WK45)                                 
     REQUESTED SPACE QUANTITY = 41501 KB                                   
     STORCLAS (SCVIOTST) MGMTCLAS (        ) DATACLAS (        )           
     STORGRPS (TPUBLIC SGVIO  )                                           
912  IKJ56893I FILE JNF1WK45 NOT ALLOCATED+                               


This shows that i dont have enough space in my intermediate volume?


How does the above message relate to SORT Capacity exceeded ?

You've allocated 23 SORKWKnn files, each having 1000 cylinders as primary quantity. This space should be enough.

ddname JNF1WK45, where is it used ?
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Wed Apr 08, 2009 11:30 pm    Post subject:
Reply with quote

Hi Anand,

You have asked for more than 2 complete 3390 devices for sortwk. You need to talk with your storage management people to see if there is that much space available in that dataclas or if there is some other you could use for this job.

Something you might consider is sorting the 2 files separately (with MAXSORT if necessary) and then run this process to join. You can tell the join that the files are already in sequence and prevent sorting them as part of the join.

Quote:
How does the above message relate to SORT Capacity exceeded ?
If you cannot allocate the sort work, you run with less and possibly you exceed the sort capacity. . .

Quote:
You've allocated 23 SORKWKnn files, each having 1000 cylinders as primary quantity. This space should be enough.
Did you calculate this or is it just something you believe. No matter, really, as the space request fails. . .
Back to top
View user's profile Send private message
Alissa Margulies

SYNCSORT Support


Joined: 25 Jul 2007
Posts: 500
Location: USA

PostPosted: Sat Apr 11, 2009 2:06 am    Post subject: Re: Maximum records that SORT can processed
Reply with quote

ABaluchamy wrote:
My job fails with return code U0016 also i could see the message

WER219I DYNALLOC FAILED RC=(970C) - 3390
WER046A SORT CAPACITY EXCEEDED

When SyncSort is called upon to take care of dynamically allocating the SORTWK space needed, we simply use the system-provided DYNALLOC facility.

In this particular case, the system DYNALLOC facility reported an error. If you have already referred to your IBM documentation, then you know that the 970C Reason Code indicates a "Severe SMS VTOC service error".

Since the system DYNALLOC facility was unable to acquire any more space, SyncSort then ends up failing and posts the message WER046A SORT CAPACITY EXCEEDED.

You can run a SYNCLIST to check the RETRY subparameter of the DYNALOC option. My suspicion is that it may be set to RETRY=(0,0). If this is the case, you may wish to have your system programmer modify it to reflect RETRY=(5,3) or some other value more appropriate for your site.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM All times are GMT + 6 Hours
Goto page 1, 2  Next
Page 1 of 2

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Removing Duplicates based on certain ... chandracdac DFSORT/ICETOOL 8 Fri Dec 09, 2016 4:40 am
No new posts Limit duplicate records in the SORT pshongal SYNCSORT 6 Mon Nov 21, 2016 12:54 pm
No new posts How to convert the VBM file to VB or... Sulabh Agrawal JCL & VSAM 4 Fri Nov 18, 2016 1:04 pm
No new posts How to split the records using the am... vnktrrd DFSORT/ICETOOL 24 Fri Oct 28, 2016 7:33 pm
No new posts Sort records based on numeric field. Alks SYNCSORT 2 Wed Oct 19, 2016 10:14 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us