View previous topic :: View next topic
|
Author |
Message |
expat
Global Moderator
Joined: 14 Mar 2007 Posts: 8797 Location: Welsh Wales
|
|
|
|
One for our DFSORT development / support guys.
Having tried and also later read through the manual and saw that although SORTWKnn datasets may be multi volume, only the space allocation made upon the first volume will be used by DFSORT.
Are there any plans for DFSORT to support/utilise multi volume work datasets. The problem I encountered was when using PROC SORT within SAS which called to use DFSORT. Unfortunately there is a restriction within SAS that a maximum of 6 SORTWKnn datasets will be used - even though more can be allocated.
The required sortwork space and more was readily available, but was spread over 32 volumes of which SAS restriced me to using only 6 so had constant failures with SB37 on the SORTWKnn DDs.
The file was 49.5 million records, F, LRECL 1420. |
|
Back to top |
|
|
Frank Yaeger
DFSORT Developer
Joined: 15 Feb 2005 Posts: 7129 Location: San Jose, CA
|
|
|
|
Quote: |
Are there any plans for DFSORT to support/utilise multi volume work datasets. |
No.
Quote: |
Unfortunately there is a restriction within SAS that a maximum of 6 SORTWKnn datasets will be used - even though more can be allocated. |
That's an odd restriction considering that DFSORT can use up to 255 work data sets. Are these SORTWKnn DD data sets? If so, I wonder if you could get around the restriction by removing the SORTWKnn DD data sets and using:
Code: |
//DFSPARM DD *
OPTION DYNALLOC=(,32)
|
Perhaps that will allow DFSORT to use 32 dynamically allocated work data sets without SAS interfering? (That's just a guess - I have no knowledge of how SAS works.)
If that doesn't work, then I suggest you contact SAS and complain about THEIR restriction. |
|
Back to top |
|
|
Dave Betten
New User
Joined: 24 Jan 2006 Posts: 26
|
|
|
|
Unfortunately we do not have plans to support multi-volume sortwork data sets. However, I believe you can get past the limit of 6 sortworks by doing the following.
Pass the option DYNALLOC to SAS which says to let the sort program allocate the work data sets.
Add the following to your JCL to tell DFSORT how many work data sets to use.
//DFSPARM DD *
OPTION DYNALLOC=(,32)
/*
This should cause DFSORT to dynamically allocate 32 sortwork data sets instead of the SAS program allocating its own work data sets for DFSORT to use. |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8697 Location: Dubuque, Iowa, USA
|
|
|
|
Quote: |
SAS restriced me to using only 6 |
What does your SORTWKNO option in SAS look like? Did you try running
Code: |
PROC SORT ... SORTWKNO=12; |
to see if you can get more than six?
This must be a site restriction -- we regularly use up to 12 volumes in SAS sorts and other than people trying to run 5 or 6 sorts of 30 million records at the same time, we don't have many issues with sort work space. |
|
Back to top |
|
|
expat
Global Moderator
Joined: 14 Mar 2007 Posts: 8797 Location: Welsh Wales
|
|
|
|
Hi guys,
Thank you for the responses. Much appreciated.
Robert, yes I did try to use the OPTION SORTWKNO= parameter but it was rejected. Will rerun and try putting the parameter in the PROC SORT as you have shown.
I will also try to use the parameters given above and post back the results. |
|
Back to top |
|
|
expat
Global Moderator
Joined: 14 Mar 2007 Posts: 8797 Location: Welsh Wales
|
|
|
|
Thank you gentleman,
The insertion of the DFSPARM DD into the JCL worked, although I did also have to specify the SAS system option of SORTPGM=SORT to prevent the SAS sort program from making the SORTWK allocations and using the maximum of 6 restriction. |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8697 Location: Dubuque, Iowa, USA
|
|
|
|
Great to hear you got it to work -- sometimes SAS option settings can be tricky since it can get pretty deep into the system ... sigh. |
|
Back to top |
|
|
expat
Global Moderator
Joined: 14 Mar 2007 Posts: 8797 Location: Welsh Wales
|
|
|
|
Yes, eventually. Still managed to retain a couple of handfulls of hair too
Obviously each and every site has its own base settings for OPTIONS, and the bit that got me was when I first tried the fix suggested by Frank / Dave, and it failed. Only after finding the part about SORTPGM=SORT to totally bypass any actions from the SAS product sort did it work.
Who says that you can't teach an old dog new tricks |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8697 Location: Dubuque, Iowa, USA
|
|
|
|
Quote: |
Who says that you can't teach an old dog new tricks |
Uh ... arf? I learn new stuff every day! |
|
Back to top |
|
|
enrico-sorichetti
Superior Member
Joined: 14 Mar 2007 Posts: 10873 Location: italy
|
|
|
|
it' s much easier to teach an old dog new tricks than the other way around |
|
Back to top |
|
|
|