Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Problem while sorting nearly 30 million recs using Syncsort

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM
View previous topic :: :: View next topic  
Author Message
Rambhupal.chaudari

New User


Joined: 30 Mar 2007
Posts: 25
Location: Hyderabad

PostPosted: Thu Jul 24, 2008 12:27 pm    Post subject: Problem while sorting nearly 30 million recs using Syncsort
Reply with quote

I want to sort one file which is on tape, with a record length of 5700. This file is having nearly 30 million records. I've used the below jcl.
Code:

//PS010  EXEC PGM=SYNCSORT,PARM='MAXSORT,MINWSP=600,DYNATAPE'
//SYSOUT   DD SYSOUT=*                                     
//SORTIN   DD DSN=xxx.XUNLD.TST.CNTLREC.JUL23,DISP=SHR
//SORTOUT  DD DSN=yyyy.ALLPERS.ASCNDNG.OUTPUT.JUL23P2,
//             DISP=(,CATLG,DELETE),                         
//             UNIT=(CART36,,DEFER),                         
//             LABEL=EXPDT=99000,VOL=(,,,99),               
//             DCB=(B0.DSCB)                                 
//SORTWK01 DD  SPACE=(CYL,(700,700),RLSE),UNIT=WORK         
like this i gave 20 work files.


i want to sort the input file based on some key condition.

Error which i got in sysout is

SYSIN :
SORT FIELDS=(27,22,CH,A)
WER131I PARM FIELD ERROR - MINWSP=6
WER164B 21,716K BYTES OF VIRTUAL STORAGE AVAILABLE, MAX REQUESTED,
WER164B 0 BYTES RESERVE REQUESTED, 2M BYTES USED
WER317I MAXSORT OPTION SELECTED
WER300A SORTBKPT DD STATEMENT REQUIRED
Back to top
View user's profile Send private message

karthikr44

Active User


Joined: 25 Aug 2007
Posts: 235
Location: Chennai

PostPosted: Thu Jul 24, 2008 12:43 pm    Post subject: Reply to: Problem while sorting nearly 30 million recs using
Reply with quote

Hi,


In MAXSORT there is no PARM like MINWSP.

Only MINWKSP exists.

Code:


MINWKSP:

This option specifies the minimum amount of disk SORTWK space that MAXSORT can
use. If the MINWKSP value exceeds the primary allocation and sufficient secondary allocation
cannot be obtained to meet the MINWKSP value at the time of execution, the sort terminates.
It can be restarted later when more space is available.
The MINWKSP value may be specified as a decimal number of cylinders (n) or a decimal
number of megabytes (nM) of work space.
The default MINWKSP value is 500 cylinders.
If MINWKSP is specified as n cylinders, MAXSORT will convert the specification to an
actual byte value. MAXSORT will multiply by n the capacity of a cylinder on the disk allocated
to the lowest-numbered SORTWKnn DD statement.
Note: MINWKSP should be specified as less than or equal to MAXWKSP, if specified.


Regards
R KARTHIK
Back to top
View user's profile Send private message
Rambhupal.chaudari

New User


Joined: 30 Mar 2007
Posts: 25
Location: Hyderabad

PostPosted: Thu Jul 24, 2008 12:52 pm    Post subject: Problem while sorting nearly 30 million recs using
Reply with quote

hi,

thanks karthik..
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Thu Jul 24, 2008 12:54 pm    Post subject:
Reply with quote

Hello,

I suspect that not all 5700 bytes of all 30million records is needed in this new sequence.

If you do a bit of work and reduce the volume of data to be sorted by both limiting the set of records and/or the fields selected from them, your sort will be much more easily accommodated by the system.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6967
Location: porcelain throne

PostPosted: Thu Jul 24, 2008 12:56 pm    Post subject:
Reply with quote

Trying to read your post without code bbtags is a pain. what was somewhat obvious:

Quote:

WER300A SORTBKPT DD STATEMENT REQUIRED


either you need this, or you have entered somuch crap in your control cards that syncsort thinks it needs this dd statement.

Have you even bothered to read about syncsorts' hypersort?
That is a major selling point to this product.

I can not believe that you need 20 sortwk statements for this. Alissa will be along in a while and save your butt.

I would suggest doing some reading about the product.
Can't believe there is not something inhouse for a large sort.

And learn to use bbcode: http://ibmmainframes.com/faq.php?mode=bbcode
Back to top
View user's profile Send private message
UmeySan

Active Member


Joined: 22 Aug 2006
Posts: 755
Location: Germany

PostPosted: Thu Jul 24, 2008 2:26 pm    Post subject:
Reply with quote

Hi !

Normaly, you don't have to bother about SortWorkAreas, because of the
DynamicAllocation of these Areas, if Syncsort is propper installed.

Plse read more about the following in the SortDocumentation. These Parameters will give more space to Sort when sorting huge files.

//STEP50 EXEC PGM=SORT
//SYSOUT DD SYSOUT=*
//*
//$ORTPARM DD DSN=J120830.PARMKA.SORTOSP7(SORTPARM),
// DISP=SHR


Content of SORTPARM:

VSCORE=5M
VSCORET=30M
Back to top
View user's profile Send private message
Rambhupal.chaudari

New User


Joined: 30 Mar 2007
Posts: 25
Location: Hyderabad

PostPosted: Thu Jul 24, 2008 2:49 pm    Post subject: Reply to: Problem while sorting nearly 30 million recs using
Reply with quote

Hi Umey..

Can u please provide any example how to use the parms VSCORE=5M and VSCORET=30M.
Or it may also helpful if you provide any link related to this..

thanks in advance..
Back to top
View user's profile Send private message
gcicchet

Senior Member


Joined: 28 Jul 2006
Posts: 1703
Location: Australia

PostPosted: Thu Jul 24, 2008 3:02 pm    Post subject:
Reply with quote

Hi,

UmeySan did provide you with an example.

The $ORTPARM DD is the statement to be added to your JCL and VSCORE=5M and VSCORET=30M are the parameters needed



Code:
//$ORTPARM DD *
 VSCORE=5M
 VSCORET=30M
/*



Gerry
Back to top
View user's profile Send private message
Rambhupal.chaudari

New User


Joined: 30 Mar 2007
Posts: 25
Location: Hyderabad

PostPosted: Thu Jul 24, 2008 5:31 pm    Post subject: Reply to: Problem while sorting nearly 30 million recs using
Reply with quote

Hi Umey..

Can u please provide any example how to use the parms VSCORE=5M and VSCORET=30M.
Or it may also helpful if you provide any link related to this..

thanks in advance..
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Thu Jul 24, 2008 5:33 pm    Post subject:
Reply with quote

Do you not have access to the documentation at your shop ?
Back to top
View user's profile Send private message
UmeySan

Active Member


Joined: 22 Aug 2006
Posts: 755
Location: Germany

PostPosted: Thu Jul 24, 2008 5:41 pm    Post subject:
Reply with quote

@Rambhupal.chaudari !

As gcicchet said: This is the example.

Also plse read more in the dokumentation of syncsort or also search the web for these keywords.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Sorting of hex values Saurabh_mi DFSORT/ICETOOL 11 Thu May 25, 2017 3:49 pm
No new posts Strings with double quotes having pro... raja Arumugam All Other Mainframe Topics 11 Thu Mar 30, 2017 10:34 am
No new posts Problem reading GTF trace output danik56 ABENDS & Debugging 7 Thu Mar 16, 2017 1:02 pm
No new posts Can you write 2 recs on SORTOUT when ... Sysaron DFSORT/ICETOOL 6 Thu Feb 23, 2017 12:07 am
No new posts ROUNDED Problem with COMPUTE statement shalem COBOL Programming 11 Thu Feb 09, 2017 8:16 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us